Introduction to Deep Double Descent
Lex Fridman introduces the topic of the Deep Double Descent paper and Ilya Sutskever explains the concept of double descent, which is a plot of performance versus model size. He explains that when the model is small, performance increases rapidly, but then decreases when the model achieves zero training error.In this clip
From this podcast

Lex Fridman Podcast
Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94
Related Questions