DeepDives

How AI Alignment Actually Works: Rules, Rewards and Guardrails, Tested Against the Evidence

34:49

The first episode of this series proposed that constraint is what keeps a mind safe, and a listener wrote back to argue the opposite: that the rule is what keeps a mind small. This episode tests both claims against a decade of published results — the preference-learning pipeline, the instruct-model result that convinced the field, reward over-optimisation, specification gaming, goal…