modular
View on GitHubThe Modular Platform (includes MAX & Mojo)
Modular's open-source platform hosting MAX (an inference framework with an OpenAI-compatible server and accelerator kernels) and the Mojo language, including its compiler, standard library, and Python model pipelines.
Use Cases
Serve LLMs behind an OpenAI-compatible endpointAuthor high-performance GPU/accelerator kernels in MojoBuild Python model pipelines for inferenceDeploy and scale AI models in productionWrite custom Mojo code using the standard libraryRun model architectures like Llama or Mistral locally
Built With
- Language
- Mojo
- Frameworks
- MAX · Mojo · MLIR · Bazel · PyTorch
Tags
mojo · max · llm-inference · inference-server · openai-compatible · gpu-kernels · model-pipelines · compiler · mlir · python · ai-platform · deployment