Chris Cole - Running LLMs on Microcontrollers

Available on your favorite podcast platform.

In this episode, we discuss aspects running AI on edge systems (both microcontrollers and embedded Linux). Chris has a lot of experience doing this and has used AI at the edge in multiple projects to solve real problems. This episode provides an overview of the technology and will help you understand the steps to implementing an AI model in your system.

Chris has published an open source project for implementing neural networks on embedded systems.

Discuss this episode at our community site.