5 thinkers, books, and ideas connected to this field.
Swedish philosopher at Oxford — founder of the Future of Humanity Institute — author of Superintelligence — who created the intellectual framework for AI existential risk and the simulation argument — the most influential philosopher in AI safety discourse.
Nick Bostrom's 2014 philosophical analysis of artificial superintelligence — arguing that a superintelligent AI would be dangerous not through malice but through instrumental convergence (any goal tends to require self-preservation, resource acquisition, and goal-content integrity) — the founding document of mainstream AI safety concern.
Toby Ord's 2020 analysis of existential risks facing humanity — cataloguing threats (AI misalignment, engineered pandemics, nuclear weapons, climate change, asteroids) by probability and arguing that avoiding existential catastrophe is the highest moral priority.
British philosopher at Oxford — author of The Precipice — co-founder of Giving What We Can — who focuses on existential risk (threats that could permanently destroy civilization) and is a leading figure in the longtermism movement.
British Astronomer Royal and cosmologist — who has written extensively on existential risk, the future of humanity, and the structure of the universe.