The Cost of Context: Unpacking Netflix’s LLM-Native Ranker
15:39
This episode explores how Netflix is integrating Large Language Models (LLMs) into its recommendation engine to capture subtle user preferences and semantic understanding beyond traditional methods. It discusses Netflix's "GenRec" architecture, where LLMs are used for nuanced ranking, and highlights the significant challenge of managing "the cost of context" when deploying these powerful models…