Back to section
Event · now

Memory and context

Lost in the middle

Long context fits, but attention to its middle sags: the model recalls the start and the end better than what lies between.