AI Chip Trends, RAG vs. Fine-Tuning, AI2 | The AI Moment, Episode 5
Futurum Tech Webcast · The Futurum Group
Audio is streamed directly from the publisher (traffic.libsyn.com) as published in their RSS feed. Play Podcasts does not host this file. Rights-holders can request removal through the copyright & takedown page.
Show Notes
On this episode of The AI Moment, we explore what's going on with AI chips, the pros and cons to RAG and fine-tuning to make LLMs better and how the Allen Institute for AI has dropped a tool which makes them an Adult in the AI Rumpus Room
The discussion covers:
-
Key Trends in Generative AI:
-
New chips, NVIDIA's GH200 Grace Hopper, Microsoft's Azure Maia AI Accelerator and Intel's Gaudi 2 are showing the potential for significant gains in performance and efficiency, which means lower AI compute costs.
-
Practices for making AI models better – RAG is the new rage, but fine-tuning gets a boost from SLoRA. Vectara's hallucination measuring tool, Hugging Face's LLMs as a Judge
-
Adults in the AI Rumpus Room: The Allen Institute for AI (AI2) recently published research that lays out the challenges of having bad data sets feed AI models. They have developed a framework to address it called What's In My Big Data? (WIMBD)
Watch the video below, and be sure to subscribe to our YouTube channel, so you never miss an episode.