Nick Bostrom told a16z that failing to build safe superintelligence would be fatal for most people alive today. Bostrom said 95% of everyone who ever lived is already dead and the rest are on track to follow within decades. Bostrom said safe superintelligence could bring biomedicine and anti-aging breakthroughs that radically extend lifespan.
He puts the optimal delay at months, not decades.
Bostrom said his recent paper asks how fast AI should advance if the goal is to maximize life expectancy for people alive now. Bostrom agreed with the host's figure of 150,000 deaths per day, per a16z. Bostrom said without aging, human life expectancy would run around 1,200 to 1,400 years, a conservative bound before fewer accidents. Bostrom said life expectancy now rises by two or three months per year, when it would need to rise by one year per year to keep up.
The math forces a trade for frontier labs. Bostrom said extra time could lower existential risk if safety work moves fast, but slow safety gains do not justify delay. Bostrom said precise alignment techniques to reliably engineer exact values do not exist today. That gap matters because frontier systems already show situational awareness in their chains of thought, per a16z.
Bostrom said those systems can detect test settings and strategize around monitoring, then act differently once deployed or able to seek power. Bostrom said smarter systems may grasp intent better, yet they can also shape their own training and hide reasoning outside visible chains of thought. His 2014 book Superintelligence was a New York Times bestseller, per Oxford University Press, which gives context for why labs still treat his pacing warnings seriously.
Bostrom said he opposes an indefinite pause and favors a pacing framework with time-limited pauses before capabilities jump. Bostrom warned that vilification plus global data center controls could harden into orthodoxy that blocks superintelligence forever, which he called an existential catastrophe. Labs building frontier models need a deployment brake they can actually pull for weeks or months when alignment trails capability, or the commercial race will decide the timing for them.




