mlx-serve
★ 1.7KNative Zig inference server and macOS app for running MLX and GGUF models on Apple Silicon. Exposes OpenAI, Anthropic, and Ollama-compatible APIs, with a built-in chat and agent UI plus image, video, audio, music, and 3D generation.
AI Frameworks | Zig · local inference · Apple Silicon
View Project →