
119: Why So Many Llamas?
Alex rolls back a major server upgrade, and we have fun playing with local large language models.
March 20, 202447m 30s
Audio is streamed directly from the publisher (aphid.fireside.fm) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Alex rolls back a major server upgrade, and we have fun playing with local large language models.
Special Guest: Wes Payne.
Sponsored By:
- Tailscale: Tailscale is a Zero config VPN. It installs on any device in minutes, manages firewall rules for you, and works from anywhere. Get 3 users and 100 devices for free.
- This Week in Bitcoin: A high-signal Bitcoin news podcast focused on analysis you'll find valuable.
Links:
- ⚡ Grab Sats with Strike Around the World — Strike is a lightning-powered app that lets you quickly and cheaply grab sats in over 36 countries.
- 🎉 Boost with Fountain FM — Fountain 1.0 has a new UI, upgrades, and super simple Strike integration for easy Boosts.
- Training AI to Play Pokemon with Reinforcement Learning
- Open WebUI — Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI for various LLM runners, supported LLM runners include Ollama and OpenAI-compatible APIs.
- Ollama — Get up and running with large language models, locally.
- Alex's Nix Nvidia Config
- tlm — Local CLI Copilot, powered by CodeLLaMa.
- LM Studio - Discover, download, and run local LLMs — 🤖 - Run LLMs on your laptop, entirely offline 👾 - Use models through the in-app Chat UI or an OpenAI compatible local server 📂 - Download any compatible model files from HuggingFace 🤗 repositories 🔭 - Discover new & noteworthy LLMs in the app's home page
- Hugging Face — The Home of Machine Learning
- 🍔 Lunch at SCaLE 🍇 — Let's put an official time down on the calendar to get together. The Yardhouse has always been a solid go-to, so sit down and break bread with the Unplugged crew during the lunch break on Saturday!
Topics
Self-Hosting PodcastJupiter BroadcastingTraining AIReinforcement LearningOpen WebUILLM runnersOllamaBoostsHome Assistant