Language Models and Intelligence
Joscha discusses the limitations of current language models, likening them to "golams" that execute tasks without understanding context. He emphasizes the importance of grounding these models in a coherent world model, suggesting that intelligence might be better understood through concepts like data compression and predictive coding. The conversation highlights the complexities of biological intelligence compared to the simplicity of next token prediction in AI.In this clip
From this podcast
Lex Fridman Podcast
Joscha Bach: Life, Intelligence, Consciousness, AI & the Future of Humans | Lex Fridman Podcast #392
Related Questions