Coding Chats
LLM as a Judge: Why Your AI Might Be Marking Its Own Homework
1:07:09
Coding Chats episode 76 - John talks to Laura Dietz - a computer science professor whose work focuses on whether AI evaluation metrics actually tell the truth. She's known for her critical take on "LLM as a judge" — not because she thinks it's useless, but because she wants numbers that mean something rather than numbers that just make a system look good.
The conversation tackles some…