Book excerpt: Should a self-driving car prioritize the lives of the passengers over the lives of pedestrians? Should we as a society develop autonomous weapon systems that are capable of identifying and attacking a target without human intervention? What happens when AIs become smarter and more capable than us? Could they have greater than human moral status? Can we prevent superintelligent AIs from harming us or causing our extinction? At a critical time in this fast-moving debate, thirty leading academics and researchers at the forefront of AI technology development come together to explore these existential questions, including Aaron James (UC Irvine), Allan Dafoe (Oxford), Andrea Loreggia (Padova), Andrew Critch (UC Berkeley), Azim Shariff (Univ. .