Season 2 · Episode 1932
How Do You QA a Probabilistic System?
LLMs break traditional testing. Here’s the 3-pillar toolkit teams use to catch hallucinations and garbage outputs at scale.
My Weird Prompts · Daniel Rosehill
April 2, 202624m 2s
Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Traditional unit tests fail for probabilistic LLMs. We break down the modern toolkit for automated quality evaluation, from heuristic safety nets to LLM-as-judge grading. Learn how to catch hallucinations, manage bias, and build a manufacturing line for intelligence that actually scales.