Train A Small Llm From Scratch In A Free Colab T4 In ~5 Minutes

GuppyLM is a ~9M parameter vanilla transformer trained from scratch to chat as a fish persona. It includes data generation, BPE tokenizer training, training loop, inference, ONNX/WASM browser demo, and Colab notebooks, making it a compact reference for building your own tiny LLM.

AI Frameworks | Python · llm · tiny-llm