-
Building a Tokenizer From Scratch: Byte-Pair Encoding, Verified on Real Data (Ep:00.02)
Whole-word tokenization hits a wall the first time it meets a word it’s never seen. This episode builds Byte-Pair Encoding from raw Python, trains it on the real TinyStories corpus,…
-
Byte-Pair Encoding Explained: Why Tokenization Isn’t Just Splitting on Spaces (Ep.01.00)
Every episode of Module 00 quietly relied on .split() — text broken into whole words at whitespace, no questions asked. It was a deliberate simplification, flagged twice and never resolved.…