Who watches the agents? Observability, evals, and guardrails at scale | Grafana Labs’ Devin Cheevers
When an agent takes thousands of actions a day, someone has to keep watch over what it’s doing. Grafana Labs director of product Devin Cheevers saw how much can slip past unnoticed when a one-line timestamp added to an agent’s system prompt wiped out its cache hit rate with the LLM provider. Recorded on site at Grafana’s ObservabilityCON in San Francisco, host Andrew Zigler sits down with Devin to talk through why vibes don’t scale once more teams contribute to an agent, and how evals let dom...
You May Also Like

Mark Tilbury
Mark Tilbury Fan

Theo - t3․gg
Theo - t3․gg

Artificial Intelligence Masterclass
AI Masterclass

All-In with Chamath, Jason, Sacks & Friedberg
All-In Podcast, LLC

Security Weekly News (Audio)
Doug White

Security Weekly Podcast Network (Video)
Security Weekly Productions

Security Weekly Podcast Network (Audio)
Security Weekly Productions

RadioCSIRT
Marc Frédéric GOMEZ

TBPN
John Coogan & Jordi Hays

Rabbit Hole Recap
ODELL and Marty Bent
Community discussion