Emergency Pod: OpenAI's new Functions API, 75% Price Drop, 4x Context Length (w/ Alex Volkov, Simon Willison, Riley Goodside, Joshua Lochner, Stefania Druga, Eric Elliott, Mayo Oshin et al)
Latent Space: The AI Engineer Podcast · Simon Willison, Alex Volkov, and Riley Goodside
Audio is streamed directly from the publisher (api.substack.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Full Transcript and show notes: https://www.latent.space/p/function-agents?sd=pf
Timestamps:
[00:00:00] Intro
[00:01:47] Recapping June 2023 Updates
[00:06:24] Known Issues with Long Context
[00:08:00] New Functions API
[00:10:45] Riley Goodside
[00:12:28] Simon Willison
[00:14:30] Eric Elliott
[00:16:05] Functions API and Agents
[00:18:25] Functions API vs Google Vertex JSON
[00:21:32] From English back to Code
[00:26:14] Embedding Price Drop and Pinecone Perspective
[00:30:39] Xenova and Huggingface Perspective
[00:34:23] Function Selection
[00:39:58] Designing Code Agents with Function API
[00:42:16] Models as Routers
[00:46:48] Prompt Engineering replaced by Finetuning
[00:52:15] The 2 Code x LLM Paradigms
[00:56:30] Smol Models for the future
[00:58:54] The Evolution of the GPT API
[01:03:27] Functions API Security vs Prompt Injection
[01:16:18] GPT Model Upgrades
[01:17:36] JSONformer
[01:21:03] Closing Comments - What We Want Next
This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.latent.space/subscribe