PLAY PODCASTS
390: When to Choose Local LLMs vs APIs

390: When to Choose Local LLMs vs APIs

The Bootstrapped Founder

May 16, 202516m 39s

Audio is streamed directly from the publisher (2.gum.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Show Notes

When I started Podscan, I wanted to go full local AI. Self-hosted, self-managed, self-serving. But that tune has changed. Here's what to think about when contemplating a local AI strategy.

The blog post: https://thebootstrappedfounder.com/when-to-choose-local-llms-vs-apis-a-founders-real-world-guide/
The podcast episode: https://tbf.fm/episodes/390-when-to-choose-local-llms-vs-apis


Check out Podscan, the Podcast database that transcribes every podcast episode out there minutes after it gets released: https://podscan.fm
Send me a voicemail on Podline: https://podline.fm/arvid

You'll find my weekly article on my blog: https://thebootstrappedfounder.com

Podcast: https://thebootstrappedfounder.com/podcast

Newsletter: https://thebootstrappedfounder.com/newsletter


My book Zero to Sold: https://zerotosold.com/

My book The Embedded Entrepreneur: https://embeddedentrepreneur.com/

My course Find Your Following: https://findyourfollowing.com

Here are a few tools I use. Using my affiliate links will support my work at no additional cost to you.
- Notion (which I use to organize, write, coordinate, and archive my podcast + newsletter): https://affiliate.notion.so/465mv1536drx
- Riverside.fm (that's what I recorded this episode with): https://riverside.fm/?via=arvid
- TweetHunter (for speedy scheduling and writing Tweets): http://tweethunter.io/?via=arvid
- HypeFury (for massive Twitter analytics and scheduling): https://hypefury.com/?via=arvid60
- AudioPen (for taking voice notes and getting amazing summaries): https://audiopen.ai/?aff=PXErZ
- Descript (for word-based video editing, subtitles, and clips): https://www.descript.com/?lmref=3cf39Q
- ConvertKit (for email lists, newsletters, even finding sponsors): https://convertkit.com?lmref=bN9CZw

Topics

AI-driven Business OperationsLocal Language ModelsAPIsCost EfficiencyControlScalabilityPrivacyAI Model DeploymentBusiness RequirementsContext SizeVendor Lock-inPractical ChoicesCustomer-focusedNatural Language ModelsAI InfrastructureSustainable BusinessInstant ResponsesPrivacy ConstraintsHardware InvestmentsStandardizationFlexibilityLocal SolutionsBusiness Logic