66: Inside Bento - Serverless Jupyter Notebooks at Meta
Meta Tech Podcast · Pascal Hartig
Audio is streamed directly from the publisher (traffic.libsyn.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Bento is Meta's internal distribution of Jupyter Notebooks, an open-source web-based computing platform. Host Pascal is joined by Steve who worked with his team on building many features on top of Jupyter, including scheduled notebooks, sharing with colleagues and running notebooks without a remote server component by leveraging Webassembly in the browser.
Got feedback? Send it to us on Threads (https://threads.net/@metatechpod), Twitter (https://twitter.com/metatechpod), Instagram (https://instagram.com/metatechpod) and don't forget to follow our host @passy (https://twitter.com/passy, https://mastodon.social/@passy, and https://threads.net/@passy_). Fancy working with us? Check out https://www.metacareers.com/.
Links
-
Scheduling Jupyter Notebooks at Meta: https://engineering.fb.com/2023/08/29/security/scheduling-jupyter-notebooks-meta/
-
Serverless Jupyter Notebooks at Meta: https://engineering.fb.com/2024/06/10/data-infrastructure/serverless-jupyter-notebooks-bento-meta/
-
Jupyter Notebooks: https://jupyter.org/
Timestamps
-
Intro 0:06
-
Who is Steve? 1:49
-
What are Jupyter and Bento? 2:48
-
Who is Bento for? 3:40
-
Internal-only Bento features 4:42
-
Scheduled notebooks 11:39
-
Integrating with existing batch jobs 17:10
-
The case for serverless notebooks 20:59
-
Enter wasm 24:29
-
Upgrade paths from serverless to server 26:29
-
Bringing more Python libraries to the browser 30:21
-
Adding magick(s) 31:52
-
DataFrame magic and AI 36:41
-
What's next? 38:29
-
Outro 43:17