Skip to content

Multi Provider

Configure and switch between multiple LLM providers at runtime

Run the same prompt across Claude, OpenAI, and Ollama simultaneously using one unified interface that normalizes responses and token usage.

Community — runs on the OSS / Community SDK edition.

Difficulty: Starter 🟢 · LLM

  • Summary: Using multiple providers in one application
  • Scenario: Configure and switch between multiple LLM providers at runtime
  • tech_tags in manifest: LLM — example id multi-provider in conformance/examples_manifest.json.
  • SDK: Use an installed SDK tree (NXUSKIT_SDK_DIR, NXUSKIT_LIB_PATH as needed); test-examples.sh resolves Go/Rust/Python deps from that tree only — see README.md, scripts/setup-sdk.sh, and scripts/test-examples.sh.
  • Languages in this example: go, python, rust (paths under this directory; Python may live under a sibling python/ or shared reference per Language Implementations).
  • Models: Set cloud provider API keys and/or run Ollama locally when you execute the Run steps (interactive flags like --help / --verbose are documented below).

Multi-vendor AI gateway, provider comparison tool

LLM

LanguagePathStatus
Rustrust/Available
Gogo/Available
Pythonpython/Available

Attach an installed SDK (NXUSKIT_SDK_DIR). See the repository README.md and scripts/test-examples.sh.

Terminal window
# From `/examples/patterns/multi-provider`:
cd rust && cargo build
cd go && make build
cd python && python3 main.py --help
Terminal window
cd rust
cargo run
Terminal window
cd go
make build && bin/multi-provider
Terminal window
cd python
python main.py