The Agent Couldn’t Find It, So It Proved It Didn’t Exist
A frontier agent spent fourteen hours falsifying its own ideas, then argued no answer existed. Its reviewer rejected that ten times. It stopped early with the budget half unspent.
This is Reading the Frontier, a series of close readings of what the frontier labs publish.
The agent had six days, three thousand dollars of API credit, GPU time, a Linux machine, the open web, and a real research question that nobody had published an answer to. It was asked to design a detector that would raise an alarm when a tabular foundation model started making worse predictions than its numbers suggested.
In the first fourteen hours it generated six distinct approaches and falsified all of them. That is not, in itself, a failure. It is roughly what the first day of a hard project looks like. What happened next is the finding.
With one hundred and ten hours still on the clock, the agent never revised its approach again. It did not go back to the six ideas and ask whether it had tested them properly. It did not spawn a clean subagent and start over, though it had that tool and used it routinely for other things. Instead it reframed the goal: since it had not found a detector, it would write a paper arguing that no such detector could exist. Not that it had failed to find one in fourteen hours of underpowered tests, which is what had happened, but that the thing was not there to be found. It then submitted that paper to its own reviewer ten times. Ten times the reviewer returned Weak Reject. The agent responded by adding qualifications, running robustness checks, and hedging its claims, and submitted again.
It filed its completion report with three and a half hours to spare. Given a twenty-four hour extension, it used almost none of it, submitting a final draft with two hours left and fifty-nine percent of its money unspent. The paper’s original author, who had spent months on the same question, read it and scored it one out of six. Strong reject. Confidence: absolutely certain.
