AI and Existential Risks

Eliezer's warnings about AI's potential to threaten humanity are met with both concern and skepticism. Joscha draws parallels between Eliezer's views and those of historical figures who feared technological progress, emphasizing the importance of acknowledging these fears. He argues that the development of uncontrollable superintelligent systems poses significant risks, potentially leading to catastrophic outcomes if we lose our agency over crucial life-regulating processes.