Forward Deployed

Evals - Beyond the Vibe Check | LangChain, Langfuse, Mercor, CoreWeave & Galileo

1:23:55

Everyone says they do evals. Almost nobody does. LangChain actually put a number on it: around 89% of teams have observability set up, and only about a third ever do anything with what it collects.

So I got five people who do this for a living in a room, from LangChain, Mercor, Galileo, Langfuse, and CoreWeave. Side note, three of those companies got acquired in the past year. Galileo to Cisco,…