Serve Pooled Models Through An Openai-compatible Local Proxy

A Python CLI, library, and local proxy that routes requests across a catalog of LLM providers and models, with failover and OpenAI-compatible endpoints. Includes an MCP server and integrations for coding agents.

AI Tools | Python · LLM gateway · model routing