Timeout Config

Configure request timeouts and connection pool settings

Take control of LLM request timing with per-phase timeout configuration that catches network failures fast without killing long-running streams.

Edition

Community — runs on the OSS / Community SDK edition.

What this demonstrates

Difficulty: Starter 🟢 · LLM

• Summary: Timeout configuration and connection management
• Scenario: Configure request timeouts and connection pool settings
• tech_tags in manifest: LLM — example id timeout-config in conformance/examples_manifest.json.

Prerequisites

• SDK: Use an installed SDK tree (NXUSKIT_SDK_DIR, NXUSKIT_LIB_PATH as needed); test-examples.sh resolves Go/Rust/Python deps from that tree only — see README.md, scripts/setup-sdk.sh, and scripts/test-examples.sh.
• Languages in this example: go, rust (paths under this directory; Python may live under a sibling python/ or shared reference per Language Implementations).
• Models: Set cloud provider API keys and/or run Ollama locally when you execute the Run steps (interactive flags like --help / --verbose are documented below).

Real-World Application

Latency-sensitive services, SLA-bound AI endpoints

Technologies

LLM

Language Implementations

Language	Path	Status
Rust	rust/	Available
Go	go/	Available

Build

Attach an installed SDK (NXUSKIT_SDK_DIR). See the repository README.md and scripts/test-examples.sh.

# From `/examples/patterns/timeout-config`:
cd rust && cargo build
cd go && make build

Run

Rust

cd rust
cargo run

Go

cd go
make build && bin/timeout-config