The Augur Dispatch

StateBench: a bigger context window still needs bookkeeping

8:47

Send us Fan Mail

A model can fit the whole amendment history into its context window and still lose track of what changed. Allen AI's StateBench gives buyers a reason to ask for evidence about the final state, not just the size of the input. Augur examines the sharp length-related decline on harder synthetic tracking tasks, what the architecture experiments do and don't establish, and why…