Vibe Coding Discoverharbor
View on GitHubStop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.
Harbor is a CLI and companion app that boots a fully pre-wired local LLM stack via Docker Compose. One command starts backends (Ollama, llama.cpp, vLLM, MLX), frontends (Open WebUI, LibreChat), and services like SearXNG, Speaches, and ComfyUI, with cross-service config handled for you.
Use Cases
Spin up a local LLM stack with one commandRun Ollama/llama.cpp/vLLM backends pre-wired to a chat UIAdd local web RAG via SearXNG and Open WebUIEnable local TTS/STT voice chat with SpeachesPoint coding agents like Codex/Claude at a local backendRun agentic coding workflows through Harbor Boost modulesGenerate images locally with ComfyUISelf-host an OpenAI-compatible inference server
Built With
- Language
- Python
- Frameworks
- Docker Compose · llama.cpp · vLLM · Ollama · Open WebUI · MLX · Docker Model Runner · ComfyUI · SearXNG · n8n · LibreChat · AnythingLLM · LightRAG · Traefik · Text Embeddings Inference
Tags
llm-stack · docker-compose · local-llm · self-hosted · cli · orchestration · inference · open-webui · ollama · llamacpp · vllm · mcp · llm-ops · homelab · agents