Ollama

Connect to a local Ollama instance for private LLM inference

Run open-source LLMs on your own hardware using the same nxusKit interface you already use for Claude and OpenAI.

Edition

Community — runs on the OSS / Community SDK edition.

What this demonstrates

Difficulty: Starter 🟢 · LLM

• Summary: Using Ollama for local inference
• Scenario: Connect to a local Ollama instance for private LLM inference
• tech_tags in manifest: LLM — example id ollama in conformance/examples_manifest.json.

Prerequisites

• SDK: Use an installed SDK tree (NXUSKIT_SDK_DIR, NXUSKIT_LIB_PATH as needed); test-examples.sh resolves Go/Rust/Python deps from that tree only — see README.md, scripts/setup-sdk.sh, and scripts/test-examples.sh.
• Languages in this example: go, rust (paths under this directory; Python may live under a sibling python/ or shared reference per Language Implementations).
• Models: Set cloud provider API keys and/or run Ollama locally when you execute the Run steps (interactive flags like --help / --verbose are documented below).

Real-World Application

On-premise AI deployment, air-gapped inference

Technologies

LLM

Language Implementations

Language	Path	Status
Rust	rust/	Available
Go	go/	Available

Build

Attach an installed SDK (NXUSKIT_SDK_DIR). See the repository README.md and scripts/test-examples.sh.

# From `/examples/integrations/ollama`:
cd rust && cargo build
cd go && make build

Run

Rust

cd rust
cargo run

Go

cd go
make build && bin/ollama