Consumer-gpu Model Serving For Code Llms

Self-hosted AI coding assistant and open-source Copilot alternative: inline code completion, IDE chat, and a RAG answer engine over your repos and internal docs. Ships a Rust server with OpenAI-compatible APIs, supports consumer GPUs, and needs no external DB or cloud.

AI Coding | Rust · self-hosted · code-completion