Episode 249

Going Beyond requirements.txt With pylock.toml and PEP 751

May 16, 20251h 31m

Audio is streamed directly from the publisher (dts.podtrac.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.

Original episode page

Show Notes

What is the best way to record the Python dependencies for the reproducibility of your projects? What advantages will lock files provide for those projects? This week on the show, we welcome back Python Core Developer Brett Cannon to discuss his journey to bring PEP 751 and the pylock.toml file format to the community. Brett has been working on a way to move beyond the <code>requirements.txt</code> file for over six years. He was on the show previously to discuss his work on PEP 665, which was rejected. He decided to continue to push forward, authoring PEP 751 last year, which was accepted at the end of March this year. The PEP calls for a new file format to record your project’s dependencies. The goal was to have a standardized immutable record for what should be installed to reproduce your project in a virtual environment. He discusses working with other packaging projects and the compromises involved in creating a standard. <div class="alert alert-primary" role="alert"> Course Spotlight: <a href="https://realpython.com/courses/python-subprocess-module/">Using the Python subprocess Module</a> In this video course, you’ll learn how to use Python’s subprocess module to run and control external programs from your scripts. You’ll start with launching basic processes and progress to interacting with them as they execute. </div> Topics: <ul> <li>00:00:00 – Introduction</li> <li>00:02:38 – Brett’s roles within the Python community</li> <li>00:05:41 – How to move beyond requirement.txt?</li> <li>00:10:58 – What does the community use as project artifacts?</li> <li>00:15:28 – Building on the success of pyproject.toml</li> <li>00:17:44 – Introducing PEP 665</li> <li>00:19:49 – Software Bills of Materials and security</li> <li>00:25:20 – Back to lock files and security</li> <li>00:31:08 – Video Course Spotlight</li> <li>00:32:27 – Not giving up on the idea</li> <li>00:34:01 – Leading into PEP 751</li> <li>00:38:54 – Working toward a single multi-platform file</li> <li>00:43:02 – The final push</li> <li>00:48:54 – Leaving room for flexibility</li> <li>00:53:50 – And it’s done, PEP 751 accepted unconditionally</li> <li>00:58:06 – Keynote speaker at EuroPython 2025</li> <li>00:58:45 – What are uv workspaces?</li> <li>01:01:02 – Considering the use of lock files in data science</li> <li>01:05:23 – Updates about Python for WASI and Emscripten</li> <li>01:13:51 – Clarification on WASI </li> <li>01:20:28 – Future conversation about Python launcher</li> <li>01:23:04 – What are you excited about in the world of Python?</li> <li>01:24:25 – What do you want to learn next?</li> <li>01:28:41 – What’s the best way to follow your work online?</li> <li>01:31:00 – Thanks and goodbye</li> </ul> Show Links: <ul> <li><a href="https://snarky.ca/">Tall, Snarky Canadian</a></li> <li><a href="https://www.youtube.com/watch?v=wgxBHuUOmjA">BREAKING: Guido van Rossum Returns as Python’s BDFL - YouTube</a></li> <li><a href="https://packaging.python.org/en/latest/">Python Packaging User Guide</a></li> <li><a href="https://peps.python.org/pep-0751/">PEP 751 – A file format to record Python dependencies for installation reproducibility</a></li> <li><a href="https://peps.python.org/pep-0665/#file-format">PEP 665 – A file format to list Python dependencies for reproducibility of an application</a></li> <li><a href="https://packaging.python.org/en/latest/specifications/pylock-toml/#pylock-toml-spec">pylock.toml Specification - Python Packaging User Guide</a></li> <li><a href="https://packaging.python.org/en/latest/specifications/inline-script-metadata/">Inline script metadata - Python Packaging User Guide</a></li> <li><a href="https://peps.python.org/pep-0723/">PEP 723 – Inline script metadata</a></li> <li><a href="https://docs.astral.sh/uv/concepts/projects/workspaces/">Using workspaces - uv</a></li> <li><a href="https://www.youtube.com/watch?v=UTduy7Qkvk8">Do you have a flag? - Eddie Izzard - YouTube</a></li> <li><a href="http://www.openmathlib.org/OpenBLAS/">OpenBLAS : An optimized BLAS library</a></li> <li><a href="https://ep2025.europython.eu/">EuroPython 2025 - July 14 to 20, 2025 - Prague, Czech Republic & Remote</a></li> <li><a href="https://bytecodealliance.org/">Bytecode Alliance</a></li> <li><a href="https://bytecodealliance.zulipchat.com/">Recent conversations - Bytecode Alliance - Zulip</a></li> <li><a href="https://snarky.ca/my-impressions-of-gleam/">My impressions of Gleam</a></li> <li><a href="https://snarky.ca/my-impressions-of-rescript/">My impressions of ReScript</a></li> <li><a href="https://exercism.org/tracks/python">Python on Exercism</a></li> <li><a href="https://letterboxd.com/nothingbutsnark/films/">Brett Cannon’s Films - Letterboxd</a></li> <li><a href="https://opensource.snarky.ca/About+Me/Media+I+Like">Media I Like - Open Source by Brett Cannon</a></li> <li><a href="https://bsky.app/profile/snarky.ca">Brett Cannon (@snarky.ca) — Bluesky</a></li> <li><a href="https://fosstodon.org/@brettcannon">Brett Cannon (@[email protected]) - Fosstodon</a></li> </ul> Level up your Python skills with our expert-led courses: <ul> <li><a href="https://realpython.com/courses/basics-exercises-install-packages-with-pip/">Python Basics Exercises: Installing Packages With pip</a></li> <li><a href="https://realpython.com/courses/packaging-with-pyproject-toml/">Everyday Project Packaging With pyproject.toml</a></li> <li><a href="https://realpython.com/courses/python-subprocess-module/">Using the Python subprocess Module</a></li> </ul> <a rel="payment" href="https://realpython.com/join">Support the podcast & join our community of Pythonistas</a>

← All episodes of The Real Python Podcast