Season 2 · Episode 1811
Stop Hardcoding User Names in AI Prompts
Three methods for storing user identity in AI agents—and why the "Fat System Prompt" breaks production apps.
My Weird Prompts · Daniel Rosehill
March 31, 202627m 27s
Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
When building voice agents, how do you store persistent user details like a child's name without cluttering prompts or killing latency? This episode dissects three engineering patterns: the "Fat System Prompt," pre-pending context, and lightweight key-value stores with tool-calling. We explore the trade-offs in token cost, latency, and reliability, using a real-world parenting advice agent as the test case. Learn why the "engineer's choice" for 2026 involves SQLite, orchestration layers, and keeping your context window clean.