Lex Fridman asked Ilya Sutskever to briefly describe the recent history of using neural networks in the domain of language and text. Sutskever mentioned the Elman network from the 80s and how data and compute have changed the trajectory of deep learning.
