Run Local Llms On Apple Silicon

Native Zig inference server and macOS app for running MLX and GGUF models on Apple Silicon. Exposes OpenAI, Anthropic, and Ollama-compatible APIs, with a built-in chat and agent UI plus image, video, audio, music, and 3D generation.

AI Frameworks | Zig · local inference · Apple Silicon