Introduction of AlexNet
Lex Fridman introduces Ilya Sutskever to the AlexNet paper, which is considered to be the catalyst for the deep learning revolution. Ilya Sutskever explains his intuition about neural networks and how it evolved over the next few years. He talks about the Hessian free optimizer and how it allowed for the training of large neural networks. He also talks about the theory that having more data than parameters would prevent overfitting.In this clip
From this podcast
Lex Fridman Podcast
Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94
Related Questions