
Episode 266
AI in the Cloud: Security, Serverless, and Cost Control
September 8, 202512m 45s
Audio is streamed directly from the publisher (media.transistor.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
AI isn’t niche anymore—and the cloud put it in everyone’s hands. In this episode, we break down how AI at cloud scale is changing the game, why securing it is urgent, and practical ways to keep costs under control without slowing innovation.
You’ll learn:
- The big unlocks: real-time threat detection, anomaly spotting, personalization, and automated deployment at scale
- How serverless democratizes AI with thousands of concurrent functions—plus cloud-agnostic tools like Lithops to avoid lock-in
- Making stateless work for ML by using Redis as shared memory so algorithms like K-means can run across serverless functions
- Lock-based vs. lock-free designs—and when each approach is faster for clustering and other parallel workloads
- Why MLC Ops matters: protecting AI systems against data poisoning, adversarial inputs, model theft, and supply chain risks
- What regulations like the EU AI Act and US EO 12110 mean for businesses, with a focus on safety, privacy, fairness, and explainability
- Security best practices: model encryption, strict access control, data verification, confidential AI environments, and open source tools like Sigstore and SLSA
- The hidden costs of AI in the cloud—GPUs, storage, network egress, managed services, and idle resources
- Proven cost optimizations: spot/preemptible instances, checkpointing, storage tiering, model compression, efficient architectures, transfer learning, and a FinOps culture
If this episode helped you map the AI-in-the-cloud landscape, subscribe, share, and leave a review. Got thoughts on self-learning defenses—systems that adapt to never-before-seen threats? Send them our way and keep the conversation going.
Topics
cloudaiAI in the cloudserverless AIcloud democratizationLithopsRedisK-means clusteringlock-free concurrencylock-based concurrencyMLOpsMLC Opsdata poisoningadversarial attacksmodel theftmodel inversionAI supply chain securityconfidential computingSigstoreOpenSSF ScorecardsSLSAEU AI Acttransparency and explainabilityGPU costsA100H100network egress feesVertex AISageMakerspot instancescheckpointingstorage tieringmodel compressionquantizationpruningknowledge distillationbatchingtransfer learningFinOpscost optimizationvendor lock-in avoidance