-
Building a Tokenizer From Scratch: Byte-Pair Encoding, Verified on Real Data (Ep:00.02)
Whole-word tokenization hits a wall the first time it meets a word it’s never seen. This episode builds Byte-Pair Encoding from raw Python, trains it on the real TinyStories corpus,…
-
Colab Setup + TinyStories — Picking the Right Dataset to Train an LLM From Scratch (Ep:00.01)
Set up a free Google Colab environment for training an LLM from scratch, and learn why dataset choice matters more than model size when you’re training small. We load TinyStories…
-
From Scratch to Agents — Build a Real LLM, Fine-Tune It, Add RAG, Make It an Agent (Ep:00.00)
A hands-on, code-only course: build a real GPT-style LLM from scratch on Google Colab’s free tier, pretrain it on real text, fine-tune it with LoRA, add RAG, and turn it…
