Cut Inference Cost For Coding Agents Without Changing Agent Code

NVIDIA Switchyard is a Rust+Python LLM routing layer that picks the cheapest capable model per call while staying OpenAI/Anthropic API compatible. It works as a NeMo Relay plugin, a LiteLLM routing plugin, an embeddable library (switchyard-libsy), or a standalone proxy that Claude Code and Codex CLI can point at.

AI Tools | Rust · llm-routing · model-routing