How Language Models Work

Lesson 09

Hallucination

It isn’t lying. It’s finishing the sentence.

The model has exactly one move: continue the text plausibly. Watch it use that move twice, once where the plausible thing is true and once where it isn’t.