The Mirror Test, Part 2: The Middle Doesn’t Pay

Machines and brains both lose the middle of the story, and the shared blind spot reveals what memory is actually for.

This is Part 2 of The Mirror Test, a series on the neuroscience that mirrors AI’s most famous failures.

---

In the summer of 2023, a team of researchers from Stanford, Berkeley, and a small retrieval startup called Samaya AI ran one of the simplest experiments in the history of language model evaluation. They asked a model a trivia question, who received the first Nobel Prize in physics, and handed it twenty Wikipedia passages to answer from. One passage contained the answer. Nineteen were plausible distractors about other physicists and other prizes. Then they did the only interesting thing: they slid the answer-bearing passage through the stack, first position, fifth, tenth, fifteenth, twentieth, and measured accuracy at every stop.

The result was a curve every psychology undergraduate has seen before, drawn by a machine that had never taken the class.

When the answer sat in the first position, GPT-3.5-Turbo answered correctly 75.8 percent of the time. When the answer sat at the end, 63.2 percent. And when the answer sat in the middle of the stack, accuracy fell to 53.8 percent. Plotted across positions, the numbers trace a U: high at the edges, sagging in the center. Nelson Liu and his colleagues gave the phenomenon a name the field adopted within months, lost in the middle.

One comparison in the paper goes further. Tested with no documents at all, forced to answer from whatever it absorbed in training, the same model scored 56.1 percent. Which means that handing the model the correct answer, buried in the middle of a stack it was explicitly told to use, made it perform worse than handing it nothing. The middle of a context window is not merely a weak place to put information. It can be a place where information goes to subtract.

The team pushed on the finding to see if it would break. It would not. The U survived in base models that had never been instruction-tuned, so polite formatting was not the culprit. It survived in a synthetic task where the documents were replaced by random UUID key-value pairs, so language itself was not the culprit; some models failed to retrieve a matching string from the middle of a list even when retrieval was the entire task. It appeared in GPT-4 on a spot-check subset, at higher accuracy but the same shape. The middle was not a quirk of one model or one task. It was a place.

It still is. Three years of mitigation work have flattened the sag on frontier models, and papers measuring and correcting the surviving bias were still appearing in 2026. The curve has softened. It has not left.

The paper’s related-work section closes a loop the authors saw themselves. Alongside citations to transformer architectures and retrieval systems sits a reference from outside the field entirely: a nineteenth-century German psychologist and a 1962 study of people memorizing word lists. The discoverers of the machine’s blind spot recognized it on sight, because the same blind spot has a hundred-year-old name.

The attention economy of a context window

Nothing in the transformer’s design says the middle should suffer. Self-attention is, on paper, position-agnostic: every token can attend to every other token, and the mechanism is technically as capable of retrieving the tenth document as the first. The U-curve is not an architectural mandate. It is a habit the models acquire.

Two habits, in fact, one for each end of the U.

The habit that favors the beginning surfaced in a place nobody was looking for psychology: an efficiency paper. In late 2023, Guangxuan Xiao and his collaborators were trying to make language models run on endless streaming text by keeping only a sliding window of recent tokens in memory and discarding the rest. The obvious approach failed catastrophically. On a long book, a Llama-2 model with a sliding window produced a perplexity of 5158, which is a technical way of saying its predictions had dissolved into static. Then they tried keeping just the first four tokens of the text alongside the recent window. Perplexity fell to 5.40. The model was healthy again. Four tokens out of tens of thousands carried that much of the model’s stability, and one detail removes any romantic interpretation: substituting those four tokens with four newline characters restored perplexity to 5.60. The content of the beginning barely mattered. The model had learned to lean on the beginning as a structural anchor, a phenomenon the authors named attention sinks. Softmax attention must distribute its mass somewhere on every step, and the tokens that are visible from everywhere, the earliest ones, become the default dumping ground. The beginning of a context is not privileged because it is informative. It is privileged because it is always there.

The habit that favors the end is older and plainer. Next-token prediction lives on adjacency; during training, the most recent tokens are overwhelmingly the most predictive ones, and models learn attention patterns that lean local. Small models, in fact, learn only this: Llama-2 at seven billion parameters shows recency bias and nothing else. The full U, with its primacy limb, appears at thirteen billion and seventy billion. The machine’s preference for beginnings is not built in. It arrives with scale, learned from data, twice as strange for it.

So each edge of the context has a structural sponsor. The beginning has the sink. The end has adjacency. The middle has no sponsor at all, and in an economy where attention mass is finite and must sum to one, having no sponsor means going hungry.

A man alone with two thousand syllables

A hundred and forty years before anyone plotted a context window, a German psychologist decided that memory could be measured, and that the only uncontaminated subject available was himself.

Hermann Ebbinghaus’s problem was meaning. Real words come pre-loaded with associations, and associations are invisible confounds; a list containing the word mother is not a fair test of raw memory. His solution was to invent a material with no meaning to load: the nonsense syllable, consonant-vowel-consonant, thousands of them. Then he sat down, alone, and learned lists of these syllables to perfection, and relearned them after delays, and recorded every trial, session after session, for months at a stretch. The discipline of it is hard to overstate. He fixed his daily routine so that time of day could not contaminate the data. He read the syllables aloud to a steady beat so that pacing could not contaminate the data. He was experimenter and subject and laboratory in one body, and he kept at it long enough to learn, by his own accounting, thousands of lists. His severest critics could accuse him of a sample size of one, and did; nobody could accuse him of imprecision about that one. Out of the solitary grind came a measurement trick that still carries his name in spirit, savings: relearn a list after a delay, count how many fewer repetitions the second mastery takes, and the difference is memory made visible, whether or not a single syllable can be consciously recalled. The 1885 monograph built from these numbers founded experimental memory research, and buried in its findings is the ancestor of our curve: items in the middle of a serial list cost him more repetitions to learn than items at either edge.

The famous curve itself belongs to a later man and a cleaner method. Ebbinghaus measured serial learning, mastering a list in order. In 1962 Bennet Murdock ran the free-recall version, read people a list once, let them recall the words in any order, and plotted recall probability against list position. The result is the canonical serial position curve, printed in every cognitive psychology textbook since: a primacy limb, a recency limb, a sagging middle, and lawful behavior as list length and presentation speed vary. The resemblance to the machine’s plot is not approximate. Laid side by side, the two curves could be mistaken for replications of one experiment.

Psychology then did what the machine-learning field is still in the middle of doing: it took the curve apart. In 1966 Glanzer and Cunitz split the two limbs with a single manipulation. Have people count backward for thirty seconds before recalling, and the recency advantage vanishes while primacy stands untouched. Slow the presentation down, and primacy grows while recency ignores the change. Two limbs, two dissociable causes. In 1971 Rundus had people rehearse out loud and simply counted: early list items collect far more rehearsals, and rehearsal is what escorts an item into durable memory. The last few items need no escort; they survive briefly in a short-lived store and are read out from it, which is why thirty seconds of counting is enough to evict them. The textbook reading assembled from these results says the two limbs come from two different memory systems, one durable and rehearsal-fed, one fast and fragile. That reading has been argued with ever since, and the argument matters for our mirror, so it returns below.

Two curves, one economy

Now hold the two curves up to each other, and be precise about what is and is not shared.

The machine’s primacy limb runs, on the leading hypothesis, on attention sinks and learned positional habits. The brain’s primacy limb runs on rehearsal escorting early items into long-term storage. These mechanisms share nothing. The machine’s recency limb runs on adjacency and local attention. The brain’s recency limb runs on a short-lived store that a half minute of distraction can empty. These mechanisms share nothing either. No component, no process, no substrate carries over from one system to the other. A transformer has no rehearsal loop and no fragile buffer; a brain has no softmax and no key-value cache. Anyone claiming the transformer secretly has a hippocampus has left the evidence behind.

What the two systems share is not machinery. It is a predicament. Each faces a sequence longer than its capacity to treat every position as special. Each must spend a finite processing budget across that sequence. And in any such economy, the edges enjoy an accounting advantage that no interior position can match: they are self-indexing. First and last are absolute addresses, findable without content, stable no matter what the sequence contains. The middle has no address of its own. To recover something from the middle, a system must index it by what it says rather than where it sits, and content-indexing is exactly the expensive operation both systems are rationing. Under that shared constraint, two utterly different learners converged on the same allocation: anchor the edges, let the middle fend for itself. The convergence is the finding. The curve is what economics looks like when it is drawn by memory.

Psychology offers an important warning against taking the mechanism too literally. One influential model, SIMPLE, developed by Gordon Brown, Ian Neath, and Nick Chater, can reproduce the human serial-position curve without assuming separate short- and long-term memory stores. Its basic idea is simpler: memory depends on distinctiveness. Items near the beginning and end of a sequence are easier to distinguish from their neighbors, while items in the middle are surrounded on both sides and are easier to confuse. That does not mean transformers suffer from the same kind of positional crowding. Whether they do is an empirical question. The point is that even in human memory, the familiar U-shaped curve does not uniquely identify the mechanism beneath it. Psychologists still debate whether the curve reflects multiple memory systems or a single representational geometry; machine-learning researchers likewise debate whether attention sinks produce the model’s primacy bias or merely travel with it. The comparison does not require either debate to be settled. Different mechanisms can arrive at the same solution to the same constraint: when a finite system cannot treat every position as equally important, the edges acquire advantages and the middle pays the price.

The strongest evidence that the constraint is doing the work is what the engineers did next, without reading a page of the psychology. Prompt guides across the industry now instruct users to place critical information at the beginning or end of the context. Retrieval pipelines re-rank their best passages to the front of the stack. Liu’s own paper closes by recommending exactly this. Every one of these remedies was standard advice in memory research decades ago, tell the audience the important thing first and last, put the material you must retain at the edges of the session. Two fields, separated by a century and a substrate, rediscovered the same folk wisdom because they were negotiating with the same landlord.

The middle is where the cost lives

Every finite memory is a forecast about what will be asked later, and the curve is the shape of that forecast’s budget. Edges are cheap to keep because position pays their storage: first and last index themselves. The middle must earn its keep through content, and content-indexing costs work at encoding time, work that a system built for throughput would rather not spend on every item. So the middle is not where memory fails. The middle is where memory economizes.

What is striking is that both systems, having abandoned the middle by default, invented ways to buy it back, and the purchases rhyme. Humans buy back the middle with meaning. A grocery list dissolves into its middle until it becomes a story, a route through the store, a ridiculous image linking bread to bleach; chunking, narrative, and deliberate rehearsal all convert position-indexed material into content-indexed material, paying the encoding cost that raw listening declined to pay. The ancient memory arts were nothing but this purchase, systematized. Machines buy back the middle with engineering. Retrieval systems fetch the relevant passage so it need not be remembered at all; re-rankers move it to a self-indexing edge; long-context training curricula drill mid-sequence retrieval until the habit of neglect weakens. Different currencies, same transaction: structure spent to rescue what position abandoned.

Seen this way, the twin U-curves stop looking like twin failures. A system that remembered every position equally would be spending premium encoding on material that will mostly never be asked about, and neither evolution nor gradient descent tolerates that kind of waste for long. The sag in the middle is not damage. It is a decision, made independently by the only two general-purpose learners we know of, about what remembering is for.

At a party, you remember the first person you met, because nothing was competing when they arrived, and the last, because they are still with you at the door. Everyone in between must do something memorable to be kept. The curve was never about lists or context windows. It is the price sheet of a finite mind, and both kinds of mind, it turns out, shop at the same store.

What the Brain Knew

Anchors are free at the edges and expensive everywhere else, so a finite mind rations its middle and buys it back only when the content earns the cost. Memory’s job was never storage. It is triage, and the sagging center of the curve is triage working exactly as designed.

---

The Mirror Test is a series. Machines fail, brains explain, and every reflection redraws the map of intelligence.