-
Perplexity Can Lie: Why Which Tokens You Evaluate On Changes the Answer (Ep:05.07)
Full-sequence perplexity makes an unmasked-trained model look better than a masked-trained one — the opposite of the truth. Module 5 of From Zero to Agents derives perplexity from cross-entropy, then…