Run Local Llm Inference On Amd Strix Halo Hardware

A C++ inference engine optimized for AMD Strix Halo systems with ROCm. It serves supported language, audio, image, and video models through a local OpenAI-compatible API.

AI Frameworks | C++ · LLM inference · local AI