What a model actually keeps
How AI memory works, and why it forgets
A chat model does not remember your life by default. It sees a limited window of text. When that window fills, the start falls out unless something else saved it.
What it is
The context window is how much text the model can look at during one reply. It is a limit, measured in tokens. It is not a diary.
Weights are what training wrote into the model. They change who it is in general. They are not a note that you prefer the window seat.
A separate memory store — a file, a database, a saved fact reloaded next time — is a different object. If that store is empty, the model wakes cold.
How it works
When the conversation outgrows the window, something has to give. Products summarize, drop the oldest turns, or both. Summaries lose detail. That loss is called compaction, and it is lossy.
Retrieval (often called RAG) searches a library and pastes the relevant bits into the window. The model did not 'know' the page. It was shown the page for this reply.
Training again on new material can blur older skills. That failure is catastrophic forgetting. It is why 'just keep training' is not the same as remembering.
Why it matters
If you need a fact next week, write it down and load it on purpose. Hoping the chat will still be holding it is how people lose the start of the work.
Forgetting is sometimes the right design. Keeping every token forever costs energy, mixes private notes into later answers, and makes the important parts harder to find.
Sources
- Each model card states its context limit. That number is the window, not a promise of perfect recall.
- Retrieval-augmented generation: Lewis et al., NeurIPS 2020. The model answers from retrieved text plus what it already learned.
- Catastrophic forgetting in neural nets has been studied since McCloskey and Cohen, 1989. New training can overwrite old skill.
See it in the City
- Memory, Archives & Cultural Practices
The City calls the fade attenuation. Used patterns stay warm. Unused ones are allowed to go cold. They are not deleted. They are released from permanent care.