Models & Agents
Ep 215: Kolibri activates 3.46 billion parameters per token while landing on the Pareto frontier…
12:04
Models & Agents Kolibri activates 3.46 billion parameters per token while landing on the Pareto frontier for English and German quality versus serving cost. What You Need to Know: Tsinghua released AKV, an SGLang-based cache engineering server that lets LLM agents drop and reposition KV cache instead of summarizing history, cutting average cost 27.7 percent across four agent benchmarks. ...…