Vibe Coding Discoverfreellmpool
View on GitHubFree LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.
A Python CLI, library, and local proxy that routes requests across a catalog of LLM providers and models, with failover and OpenAI-compatible endpoints. Includes an MCP server and integrations for coding agents.
Use Cases
Route requests across multiple LLM providersFail over when a provider is unavailable or rate limitedServe pooled models through an OpenAI-compatible local proxyRun coding agents against free or low-cost modelsCall pooled models from an MCP-compatible agentCompare responses from multiple models
Built With
- Language
- Python
Tags
LLM gateway · model routing · provider failover · OpenAI-compatible API · free LLMs · rate limiting · local proxy · MCP server · coding agents · speech-to-text