Nerdcast Is All You Need
57 episodes — Page 1 of 2
Ep 1Era_of_Experience
Aug 27, 20256 min
Ep 2[Research] The Era of Experience
Apr 20, 202513 min
Ep 3[Product] Llama4-Natively Multimodal AI
Apr 6, 202518 min
Ep 4[Nature] Google DeepMind DreamerV3
Apr 3, 202525 min
Ep 5[Research] Meta MoCha
Apr 2, 202517 min
Ep 6[Product] GPT-4o Native Image Generation
Mar 28, 202526 min
Ep 7[Research] Gemini Robotics
Mar 14, 202522 min
Ep 8[Research] GSM-∞
Mar 11, 202518 min
Ep 9[Research] AI CUDA Engineer
Feb 22, 202511 min
Ep 10[Research] Mixture of Block Attention
Feb 22, 202516 min
Ep 11[Research] NSA
Natively Trainable Sparse Attention for Long Contexts
Feb 21, 202514 min
Ep 12[Research] LIMO: Less is More
Feb 14, 202513 min
Ep 13[Research] S1: Simple Test-Time Scaling
Feb 7, 202511 min
Ep 14[Blog] Reward Hacking
Feb 1, 202514 min
Ep 15[Research] Kimi K1.5
Kimi K1.5 - Scaling Reinforcement Learning with LLMs
Jan 23, 202521 min
Ep 16[Research] DeepSeek-R1
DeepSeek-R1: Reasoning via Reinforcement Learning
Jan 22, 202516 min
Ep 17[Ebooks] The Founders
Jan 11, 202512 min
Ep 18[Ebooks] Life After Google
Jan 6, 202513 min
Ep 19[Ebooks] Cryptonomicon
Jan 6, 202519 min
Ep 20[Ebooks]The Hard Thing About Hard Things
Jan 4, 202516 min
Ep 21[Ebooks] The Sovereign Individual
Peter Thiel's Book Recommendations
Jan 3, 202520 min
Ep 22[Ilya's reading list] Kolmogorov Complexity and Algorithmic Randomness
Oct 16, 202411 min
Ep 23[Ilya's reading list] A Tutorial Introduction to the MDL Principle
Oct 16, 202418 min
Ep 24[Ilya's reading list] Scaling Laws for Neural Language Models
Oct 16, 202411 min
Ep 25[Ilya's reading list] Deep Speech 2
Oct 16, 202412 min
Ep 26[Ilya's reading list] Neural Turing Machines
Oct 15, 202414 min
Ep 27[Ilya's reading list] The Coffee Automaton
Oct 15, 202412 min
Ep 28[Ilya's reading list] Relational recurrent neural networks
Oct 15, 20247 min
Ep 29[Ilya's reading list] VARIATIONAL LOSSY AUTOENCODER
Oct 15, 20249 min
Ep 30[Ilya's reading list] A simple neural network module for relational reasoning
Oct 15, 20249 min
Ep 31[Ilya's reading list] Identity Mappings in Deep Residual Networks
Oct 15, 20246 min
Ep 32[Ilya's reading list] NEURAL MACHINE TRANSLATION
Oct 15, 202410 min
Ep 33[Ilya's reading list] Neural Message Passing for Quantum Chemistry
Oct 15, 202410 min
Ep 34[Ilya's reading list] MULTI-SCALE CONTEXT AGGREGATION BY DILATED CONVOLUTIONS
Oct 15, 20249 min
Ep 35[Ilya's reading list](ResNet)Deep Residual Learning for Image Recognition
Oct 15, 202412 min
Ep 36[Ilya's reading list] GPipe
Oct 15, 202413 min
Ep 37[Ilya's reading list] Order matters: sequence to sequence for sets
Oct 13, 20245 min
Ep 38[Ilya's reading list] ImageNet Classification with Deep CNNs
Oct 13, 202410 min
Ep 39[Ilya's reading list] Pointer Networks
Oct 13, 202410 min
Ep 40[Ilya's reading list] Keeping NN Simple by MDL
Oct 13, 202413 min
Ep 41[Ilya's reading list] RNN Regularization
Oct 13, 20249 min
Ep 42[Ilya's reading list] Understanding LSTM Networks
Oct 12, 202411 min
Ep 43[Ilya's reading list] The Unreasonable Effectiveness of RNNs
Oct 12, 202415 min
Ep 44[Ilya's reading list] The First Law of Complexodynamics
Oct 12, 202415 min
Ep 45[Ilya's reading list] The Annotated Transformer
Ilya sutskever gave john carmack this reading list of approx 30 research papers and said, "If you really learn all of these, you’ll know 90% of what matters today."
Oct 12, 20249 min
Ep 46[MultiModal] MAE
Sep 28, 20248 min
Ep 47[MultiModal] CLIP
Sep 28, 202412 min
Ep 48[MultiModal] ViT
Sep 28, 202413 min
Ep 49GPT-o1
Sep 26, 20245 min
Ep 50GPT-4o
Sep 26, 202410 min