Robonaissance
Subscribe
Sign in
Home
Foundations
Thinking
World Models
Agents
Robotics
Machine Minds
🔭 LEAP
🐹 Pompom
Archive
About
Whatever You Ask For
Latest
Top
Discussions
Whatever You Ask For
Machines now grant whatever we ask, better every year. Choosing what to ask was never their half of the problem. It is ours, and we are bad at it…
Aug 26
•
Hugo
6
5
5
Whatever You Ask For, Part 13: The Only Question Left Is What You Ask
No metric resists being gamed, so what separates good goal-setting from bad is the posture toward the number, not the number. And the one question no…
Aug 24
•
Hugo
4
Whatever You Ask For, Part 12: We Are Training Children to Be the Machines
School trains a child to maximize a score inside fixed rules. That is the definition of an optimizer, the one thing machines are sure to win. We are…
Aug 21
•
Hugo
8
1
Whatever You Ask For, Part 11: You Have Never Read Your Actual Objective
You have an objective you would state out loud and a different one your week is actually running. The gap is not hypocrisy. It is an unaudited reward…
Aug 20
•
Hugo
1
3
Whatever You Ask For, Part 10: We Are the Species That Sets the Goals
A nerve that takes a five-metre detour. A process with no author. One thing cannot get its goals wrong; another cannot refuse them. We are the middle…
Aug 19
•
Hugo
9
4
1
Whatever You Ask For, Part 9: Your Worth Was Never Your Cleverness
For a few centuries, thinking well was scarce and therefore valuable. That was an accident of supply. The popular replacements make the same mistake in…
Aug 18
•
Hugo
8
1
1
Whatever You Ask For, Part 8: The Genie Never Picks the Wish
The same method predicts protein structures and wins at chess, with no view on which is worth doing. The genie grants anything. It has never once picked…
Aug 18
•
Hugo
5
8
2
Whatever You Ask For, Part 7: The One Step No Machine Can Take, and We Are Bad at It
A tumour two experts read in opposite ways. Grant reviewers who agree barely more than chance. The step that cannot be handed to a machine is the step…
Jul 28
•
Hugo
4
Whatever You Ask For, Part 6: Machines Can Learn What We Do, Not What We Want
Twenty-five years of trying to automate the asking. A robot that wants your coffee. A proof that behaviour cannot reveal intent. Every attempt to…
Jul 26
•
Hugo
2
Whatever You Ask For, Part 5: Your Organization Was Reward Hacking Before the Machines Arrived
A sales target that invented three million accounts. A law nobody wrote. A clock that stops at the hospital door. Machines did not bring this problem…
Jul 25
•
Hugo
4
8
1
Whatever You Ask For, Part 4: The Machine Did Exactly What You Said
A program that pauses Tetris forever. A boat that never finishes the race. A model that rewrites the scoring code. None of them broke a rule. That is…
Jul 24
•
Hugo
2
1
Whatever You Ask For, Part 3: Somebody Wrote the Machine’s Goal in an Afternoon
A blog post nobody noticed. A number written for 2016. A courtroom in 2026. Every optimizing system has one human input, and it fails by design.
Jul 23
•
Hugo
2
2
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts