Run Private/offline Inference Without Sending Data To Cloud Apis

Ollama is a Go-based local LLM runtime that downloads, runs, and serves open models (Gemma, Qwen, DeepSeek, Llama) via a CLI and REST API on port 11434. It powers local inference for coding agents, chat UIs, and RAG apps, and supports custom Modelfiles and imports.

AI Frameworks | Go · llm · local-llm