Surprising Success of GPT-2

Lex Fridman asks Ilya Sutskever if he was surprised by the success of GPT-2. Ilya Sutskever admits that he was surprised and explains that the progress in Gans was amazing, but text hadn't really moved that much until GPT-2. He suggests that the next barrier is when the advances in AGI start to have a dramatic economic impact.