The Augur Dispatch

Who grades your AI grader? Allen AI's 52-point warning

8:34

Send us Fan Mail

The work stayed the same. The AI grader's verdict didn't. Allen AI reports a 52.6-percentage-point accuracy swing when GPT-5.4 lost a reviewer-authority cue in a research-novelty prompt. Augur explains why this wasn't a clean paraphrase test, what the assumed labels for generated ideas leave uncertain, and why teams should test the grader as well as the system it scores. The…