Perform Multi-gpu Inference

DwarfStar is a model-specific native inference engine for running DeepSeek, GLM, and Qwen models on Apple Silicon, CUDA, and ROCm hardware. It includes a CLI, HTTP server, coding agent, vision support, and multi-GPU execution.

AI Frameworks | C · local inference · LLM inference