Generate Synthetic Conversation Datasets From Templates

GuppyLM is a ~9M parameter vanilla transformer trained from scratch to chat as a fish persona. It includes data generation, BPE tokenizer training, training loop, inference, ONNX/WASM browser demo, and Colab notebooks, making it a compact reference for building your own tiny LLM.

AI Frameworks | Python · llm · tiny-llm