Home TechnologyEstimates of the expected utility gain of AI Safet...
Technology⭐ Featured

Estimates of the expected utility gain of AI Safety Research

When thinking about AI risk, I often wonder how materially impactful each hour of my time is, and I think that this may be useful for other people to know as well, so I spent a couple of hours making a couple of estimates. I basically expect that a tonne of people have put a bunch more time into this than me, but this is nice to have as a rough sketch to point people to. I'm going to make 3 estimates: an underestimate, my best-guess estimate and (what I think is) an overestimate. Starting facts [1] :  Currently 8.3 Billion people on planet earth Current median age: 31.1 years Current life expectancy: 73.8 years I am going to commit statistical murder and assume this means that everyone on the planet lives ~42.7 years from this point onwards.  Underestimate: 40 years of life left/person Median: 42.7 years + ~15 years' increase in life expectancy (20 years' growth in the past 60 years) = about 60 years of life left Overestimate: Everyone gets life extension and lives to heat death of universe: 10^100 years Since the population is growing, we should take that into account: Underestimate: We only care about the lives of people currently alive Median: We keep growing at current ~1% growth rate per year Overestimate: Population growth of 2% per year until the heat death of the universe Given these parameters, we can figure out the total expected years of life we care about for each scenario:  Under:

6 April 2026 at 02:01 pm
1 views
Estimates of the expected utility gain of AI Safety Research

When considering the impact of AI safety research, it's common to wonder how much each hour of time contributes to mitigating potential risks. To address this, an individual spent a few hours estimating the expected utility gain of such research, providing three scenarios: an underestimate, a best-guess estimate, and an overestimate. These estimates take into account the current population, life expectancy, and growth rates.

Starting with the current facts, there are 8.3 billion people on Earth, with a median age of 31.1 years and a life expectancy of 73.8 years. The author assumes that everyone will live approximately 42.7 years from now, based on these averages.

For the underestimate, the author considers 40 years of life left per person. This scenario assumes a static population, focusing only on the lives of people currently alive. The total expected years of life in this case would be 40 years multiplied by 8.3 billion, resulting in 332 billion years.

The median estimate factors in a growing population. It assumes a 1% annual growth rate, leading to an additional population that will also benefit from increased life expectancy. The total expected years of life in this scenario would be the product of the current population, the additional population, and the extended life span, which includes a linear approximation of increased life expectancy.

The overestimate takes an extreme approach, assuming that everyone achieves life extension and lives until the heat death of the universe, estimated at 10^100 years. However, this scenario quickly becomes intractable due to the exponential growth of the population. The author suggests skipping this overestimate, as it leads to calculations beyond practical limits.

In the underestimate, the research aims to achieve a 1% chance of a 1% decrease in the final risk for the entire field within 20 years. Assuming an imminent extinction event 30 years from now, the utility gain of this research would be significant.

These estimates serve as a rough framework to gauge the potential impact of AI safety research. While other experts may have conducted more in-depth analyses, these calculations provide a starting point for those interested in understanding the material impact of their efforts. The three scenarios offer a range of possibilities, from conservative to extreme, allowing individuals to assess the potential value of their contributions to the field.

Source: LessWrong
📰 Related News
Ekaya Banaras Founder Palak Shah’s ₹40 Lakh Billboard Mistake Became a Masterclass in Startup Marketing
Ekaya Banaras Founder Palak Shah’s ₹40 Lakh Billboard Mistake Became a Masterclass in Startup Marketing
Ekaya Banaras founder Palak Shah recently opened up about one of the most expensive mistakes she made while building her luxury textile brand. During the early years of the company, Shah rented a premium billboard near Delhi’s DLF Emporio to increase brand visibility. However, after forgetting to cancel the campaign, the hoarding reportedly continued running for months — resulting in losses of nearly ₹40 lakh. The incident has now become a viral example of how small operational oversights can turn into costly business lessons for startups and entrepreneurs.
28 May
Betting On AI: Jensen Huang And NVIDIA’s Rise To The Top
Betting On AI: Jensen Huang And NVIDIA’s Rise To The Top
Before AI was inevitable, it was a gamble—and Jensen Huang went all in.
14 Apr
Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1 bring confidential computing to bare metal and AI workloads
Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1 bring confidential computing to bare metal and AI workloads
Red Hat is excited to announce the release of Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1, marking a major leap forward in our confidential computing journey. These releases graduate confidential containers on bare metal from …
14 Apr
Large AI firms hoovering maximum funding, not enough for smaller startups: Y Combinator’s Ankit Gupta
Large AI firms hoovering maximum funding, not enough for smaller startups: Y Combinator’s Ankit Gupta
YC Startup School: India’s talent pool across colleges and universities are key for building next-gen startups, which is what YC is looking to tap into. It wants to target entrepreneurs building for global markets, focussed on fintech, consumer, B2B, and ecom…
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC-RESULTS/ (PREVIEW, PIX):PREVIEW-TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
Any profit result ‌above T$505.7 billion would mark the company's highest-ever quarterly net income ​and its ninth consecutive quarter of profit growth
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
On Thursday, ​TSMC is expected to report a net profit of $17.1 billion for the quarter, according to an LSEG SmartEstimate compiled from 19 analysts. The war in the Middle East threatens to disrupt the supply of production materials for semiconductors such as…
14 Apr
If we can’t kick the habit, how do we manage AI’s energy needs?
If we can’t kick the habit, how do we manage AI’s energy needs?
One can only hope that OpenAI’s Sam Altman was joking when he sought to justify the immense energy consumption of artificial intelligence
14 Apr
What caused Nvidia Blackwell GPU prices to spike? #tech
What caused Nvidia Blackwell GPU prices to spike? #tech
Blackwell GPU hourly “rent” surges on agentic AI demand A compute pricing index tracking hourly costs for Nvidia Blackwell GPUs shows a sharp climb: hourly rental hit $4.08 , up 48% from $2.75 just two months earlier. The reported driver is rising demand tied…
14 Apr
Anthropic Releases Claude Mythos Preview with Cybersecurity Capabilities but Withholds Public Access
Anthropic Releases Claude Mythos Preview with Cybersecurity Capabilities but Withholds Public Access
Anthropic has introduced Claude Mythos Preview, its most advanced AI model, improving significantly in reasoning, coding, and cybersecurity. Unlike previous releases, it will not be publicly available. Access is limited to a consortium of tech companies throu…
14 Apr