Run Model Architectures Like Llama Or Mistral Locally

Modular's open-source platform hosting MAX (an inference framework with an OpenAI-compatible server and accelerator kernels) and the Mojo language, including its compiler, standard library, and Python model pipelines.

AI Frameworks | Mojo · max · llm-inference