Vibe Coding DiscoverCamelid
View on GitHubCamelid: a Rust-native local inference backend with evidence-gated model compatibility.
Rust-native local inference backend and chat app for tested GGUF models, with Metal, CUDA, and CPU execution paths. Includes an OpenAI-compatible API, embeddings and reranking, and approval-gated coding tools.
Use Cases
Run GGUF language models locallyServe an OpenAI-compatible APIBuild local chat applicationsUse local models for coding assistanceRun approval-gated coding agentsGenerate embeddings and rerank textChat with images using supported vision modelsTranscribe voice input locally
Built With
- Language
- Rust
- Frameworks
- Candle · llama.cpp · Tauri · Axum
Tags
local inference · GGUF · LLM · Rust · Apple Silicon · Metal · CUDA · OpenAI-compatible API · quantization · offline AI · embeddings · reranking · multimodal · agentic coding