Context Window

AI doesn't have memory. It has a room.

The first time I really felt this, I was deep in one chat trying to build something, hours in, probably a hundred messages deep. And it started getting dumber. Forgetting things I'd just said. Contradicting itself.

I assumed it was broken. It wasn't. I'd just become a hoarder.

Here's the thing. Everything you give an AI has to fit in one room, all at once. Your message, the whole conversation so far, any files you've uploaded, and the hidden instructions the app feeds it (stuff like "you are a helpful assistant, today's date is...").

All of it stacked in the same room. So think of the "context window" as just the size of that room.

And here's the part most people never realize. Every time you hit send, the AI re-reads the entire room from scratch. It isn't remembering your earlier messages the way a person would. It's reading all of them again, top to bottom, every single turn.

Different models hand you different-sized rooms, and the gap between them is enormous.

• A small or older model like GPT-4o is a studio apartment. Around 128,000 tokens, a few hundred pages.
• A mainstream workhorse like GPT-5.1 is a proper house. Around 272,000 tokens.
• The frontier models are mansions. Anthropic's Claude Opus and Google's Gemini each hold about 1,000,000 tokens (roughly 750,000 words, around 1,500 pages).

Don't bother memorizing the numbers, they climb every few months. The point is the spread: the biggest rooms hold close to ten times what the smallest do, and they keep growing. (Tokens are the unit a room gets measured in, and they're worth their own entry.)

That sounds like an unlimited amount of space. It is not. Bigger isn't automatically better. A mansion packed wall to wall with junk is still a mansion you can't find anything in. Cram the room full and the AI starts losing track of what's where, even though it all technically "fits." That's why a long, sprawling chat slowly starts to feel dumber than a fresh one. You haven't broken anything. The room just got cluttered.

So when you say "but I told you this an hour ago" and it stares back blankly, that's not amnesia. The room filled up and the early stuff got pushed out the door to make space for the new stuff. You're the hoarder now, expecting someone to find one specific receipt in a mansion stuffed to the ceiling with trash.

Once you can see the room, you stop fighting it.

Start fresh chats. Keep the room clean.