This is The Attention Wager, a close reading of Attention Is All You Need, one section and one bet at a time.
The Attention Wager, Part 7: Judgment Day
The efficiency argument had a condition printed beside it: that sequences stay shorter than the model is wide. Attention was borrowed from a theory about spending less.
