bitrouter

The minimal interpretable model router that learns & adapts to your agent workflows

★ 23117 forksRustApache-2.0bitrouter

Rust LLM router and gateway that sits in front of any agent harness: routes each model call, MCP tool/skill, and ACP sub-agent to the cheapest adequate path, with OTel telemetry and a git-owned policy-lock it improves from admitted eval evidence. Reports ~33% cost cut on Terminal-Bench 2.1 at near-parity accuracy.

Use Cases

Cut agent-loop token spend by routing routine steps to cheaper modelsDrop-in proxy via OPENAI_BASE_URL swap for any agent harnessMulti-provider and multi-account failover with cross-protocol translationMCP gateway aggregating upstream tools and skills at /mcpRoute sub-agents over ACP stdio as first-class primitivesExport per-hop cost, token, latency and outcome traces to OTLP backendsEval-driven policy-lock generation with git-reviewable diffsGuardrails and request checks on agent traffic

Built With

Language: Rust
Frameworks: MCP · Agent Client Protocol (ACP) · OpenTelemetry · Claude Code plugin · Codex plugin · OpenAI Chat Completions API · Anthropic Messages API · Gemini API

bitrouter

Use Cases

Built With

Tags