The New Data Pipeline For Generative AI: Where And How It Works - Audio Blog
Generative AI initiatives require new data pipeli…
Secrets of Data Analytics Leaders · Eckerson Group
September 13, 20237m 6s
Audio is streamed directly from the publisher (feeds.soundcloud.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
Generative AI initiatives require new data pipelines that prepare text files for querying by language models. Data engineers, scientists, and other stakeholders collaborate to design and implement these pipelines, which span text sources, tokens, vectors, vector databases, and LMs.
Published at:
https://www.eckerson.com/articles/the-new-data-pipeline-for-generative-ai-where-and-how-it-works