Shared Everything
(Re)Engineering the Inference Stack
29:31
In this episode, we're joined by Stephen Bates, AMD Fellow in the AI Group, and Alon Horev, Co-founder and CTO of VAST Data, to explore one of the biggest architectural shifts happening in AI today: the move from training to inference. Using AMD and VAST's expanded partnership as a starting point, the conversation examines why KV cache has become a critical part of AI infrastructure, how…