The Attention Wager, Part 2: Three Matrices
Three matrices, one softmax, and a denominator nobody quotes. How a lookup table learned to blend. The oldest idea in memory, finally made differentiable.
This is The Attention Wager, a close reading of Attention Is All You Need, one section and one bet at a time.
