135: Database Knob Tuning and AI with Andy Pavlo and Dana Van Aken of OtterTune
This week on The Data Stack Show, Eric and Kostas chat with Andy Pavlo and Dana Van Aken, the CEO and CTO at OtterTune. During the episode, the group discusses the challenges of tuning database systems, the role of machine learning in automating the process, the importance of workload capture, the benefits of using automated recommendations for index optimization and overall system health, the challenges of managing configuration knobs in database systems and more.
Audio is streamed directly from the publisher (afp-928695-injected.calisto.simplecastaudio.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Highlights from this week’s conversation include:
- Origins of OtterTune (4:43)
- The problem of knob tuning (6:25)
- Roles of machine learning (9:32)
- OtterTune’s development and industry recognition (12:03)
- The challenges of database tuning and the role of human expertise (16:15)
- Tuning in production (20:23)
- Observability and Data Collection (23:37)
- Data Security and Privacy (29:59)
- Optimizing on-prem vs. cloud workloads (35:52)
- Performance benchmarks (40:20)
- Future opportunities OtterTune is focusing on (43:55)
- Importance of automated tuning services (50:45)
- Challenges in Benchmarking Real Workloads (58:43)
- The Story Behind the Name OtterTune (1:08:58)
- Balancing Technology and Human Factors (1:13:23)
The Data Stack Show is a weekly podcast powered by RudderStack, the CDP for developers. Each week we’ll talk to data engineers, analysts, and data scientists about their experience around building and maintaining data infrastructure, delivering data and data products, and driving better outcomes across their businesses with data.
RudderStack helps businesses make the most out of their customer data while ensuring data privacy and security. To learn more about RudderStack visit rudderstack.com.
Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.