Back to section
Event · 2020-05

Memory and context

Retrieval (RAG)

The workaround the industry lived on while context was short. Now a complement rather than a crutch.

RAG separates knowledge from model parameters: before answering, a system retrieves relevant documents and adds them to the input. This makes facts and citations easier to update, but quality depends on retrieval, document chunking and the model's ability to distinguish evidence from its own guess.

Sources
arXiv · RAGOpen primary source