How Language Models Work

Lesson 08

The context window

It has no memory. It has a window.

The model remembers nothing between messages. Every turn, the app re-sends the entire conversation and it reads fresh. That re-sent text has a size limit.

What the model actually receives