Self-host A Privacy-preserving Llm Proxy

A Go, cloud-native gateway that unifies many LLM providers (OpenAI, Anthropic, Groq, Ollama, DeepSeek, and more) behind one OpenAI-compatible API. Adds MCP tool discovery, streaming, vision, OIDC auth, and OpenTelemetry/Prometheus metrics for self-hosted LLM traffic.

AI Tools | Go · llm-gateway · proxy