Skip to content

LM Studio

Connect to a local LM Studio server for desktop LLM inference

Run LLM inference on your own machine — connect nxusKit to LM Studio and prototype without cloud dependencies or API keys.

Community — runs on the OSS / Community SDK edition.

Difficulty: Starter 🟢 · LLM

  • Summary: Using LM Studio for local inference
  • Scenario: Connect to a local LM Studio server for desktop LLM inference
  • tech_tags in manifest: LLM — example id lmstudio in conformance/examples_manifest.json.
  • SDK: Use an installed SDK tree (NXUSKIT_SDK_DIR, NXUSKIT_LIB_PATH as needed); test-examples.sh resolves Go/Rust/Python deps from that tree only — see README.md, scripts/setup-sdk.sh, and scripts/test-examples.sh.
  • Languages in this example: go, rust (paths under this directory; Python may live under a sibling python/ or shared reference per Language Implementations).
  • Models: Set cloud provider API keys and/or run Ollama locally when you execute the Run steps (interactive flags like --help / --verbose are documented below).

Developer local testing, offline prototyping

LLM

LanguagePathStatus
Rustrust/Available
Gogo/Available

Attach an installed SDK (NXUSKIT_SDK_DIR). See the repository README.md and scripts/test-examples.sh.

Terminal window
# From `/examples/integrations/lmstudio`:
cd rust && cargo build
cd go && make build
Terminal window
cd rust
cargo run
Terminal window
cd go
make build && bin/lmstudio