Cache Repeated Requests

Self-hosted LLM gateway and tier-routing proxy for Claude Code, Cursor, Codex, and other AI coding tools. Routes requests across local and cloud providers, with semantic caching, prompt compression, and MCP tool support.

AI Tools | JavaScript · LLM gateway · model routing