Chris Cole - Running LLMs on Microcontrollers
A discussion about AI at the edge.
The TMPDIR podcast · Cliff Brake and Khem Raj
Audio is streamed directly from the publisher (storage.googleapis.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Available on your favorite podcast platform.
In this episode, we discuss aspects running AI on edge systems (both microcontrollers and embedded Linux). Chris has a lot of experience doing this and has used AI at the edge in multiple projects to solve real problems. This episode provides an overview of the technology and will help you understand the steps to implementing an AI model in your system.
Chris has published an open source project for implementing neural networks on embedded systems.
Discuss this episode at our community site.