Home TechnologyEstimates of the expected utility gain of AI Safet...
Technology⭐ Featured

Estimates of the expected utility gain of AI Safety Research

When thinking about AI risk, I often wonder how materially impactful each hour of my time is, and I think that this may be useful for other people to know as well, so I spent a couple of hours making a couple of estimates. I basically expect that a tonne of people have put a bunch more time into this than me, but this is nice to have as a rough sketch to point people to. I'm going to make 3 estimates: an underestimate, my best-guess estimate and (what I think is) an overestimate. Starting facts [1] :  Currently 8.3 Billion people on planet earth Current median age: 31.1 years Current life expectancy: 73.8 years I am going to commit statistical murder and assume this means that everyone on the planet lives ~42.7 years from this point onwards.  Underestimate: 40 years of life left/person Median: 42.7 years + ~15 years' increase in life expectancy (20 years' growth in the past 60 years) = about 60 years of life left Overestimate: Everyone gets life extension and lives to heat death of universe: 10^100 years Since the population is growing, we should take that into account: Underestimate: We only care about the lives of people currently alive Median: We keep growing at current ~1% growth rate per year Overestimate: Population growth of 2% per year until the heat death of the universe Given these parameters, we can figure out the total expected years of life we care about for each scenario:  Under:

6 April 2026 at 02:07 pm
1 views
Estimates of the expected utility gain of AI Safety Research

When considering the impact of AI safety research, many people wonder how much each hour of their time contributes to mitigating potential risks. To address this, the author has created three estimates—an underestimate, a best-guess estimate, and an overestimate—to provide a rough framework for understanding the material impact of time spent on this critical field.

Starting with the current facts, there are 8.3 billion people on Earth, with a median age of 31.1 years and a life expectancy of 73.8 years. The author simplifies these figures by assuming that everyone on the planet will live approximately 42.7 years from the present point onwards. This simplification, known as "statistical murder," is a common practice in such calculations.

The three estimates are based on different assumptions about life expectancy and population growth. The underestimate assumes 40 years of life left per person, the median estimate accounts for a 15-year increase in life expectancy (based on historical growth rates), resulting in about 60 years of life left, and the overestimate considers life extension to the heat death of the universe, which is approximately 10^100 years.

Population growth is also factored into these estimates. The underestimate focuses only on the lives of people currently alive, the median estimate assumes a 1% annual growth rate, and the overestimate considers a 2% annual growth rate until the heat death of the universe.

Using these parameters, the total expected years of life for each scenario can be calculated. For the underestimate, this results in 40 years multiplied by 8.3 billion, equating to 332 billion years. The median estimate calculates the current population's life span as 60 years multiplied by 8.3 billion, with an additional population growth component. The overestimate, however, leads to an impractical calculation due to the exponential growth of population and years, making it best to skip this scenario.

For the underestimate, the author assumes 20 years of research to achieve a 1% chance of a 1% decrease in the final risk for the entire field. In this scenario, extinction is projected to occur 30 years from now. The best-guess estimate and the overestimate provide a range of possibilities, allowing individuals to gauge the potential impact of their efforts in the field of AI safety research.

These estimates serve as a rough framework for understanding the material impact of time spent on AI safety research. While the overestimate may seem extreme, it highlights the potential for significant benefits if AI risks are mitigated effectively. The underestimate and best-guess estimate offer more realistic scenarios, emphasizing the importance of continued research and collaboration in this critical area.

Source: LessWrong
📰 Related News
Ekaya Banaras Founder Palak Shah’s ₹40 Lakh Billboard Mistake Became a Masterclass in Startup Marketing
Ekaya Banaras Founder Palak Shah’s ₹40 Lakh Billboard Mistake Became a Masterclass in Startup Marketing
Ekaya Banaras founder Palak Shah recently opened up about one of the most expensive mistakes she made while building her luxury textile brand. During the early years of the company, Shah rented a premium billboard near Delhi’s DLF Emporio to increase brand visibility. However, after forgetting to cancel the campaign, the hoarding reportedly continued running for months — resulting in losses of nearly ₹40 lakh. The incident has now become a viral example of how small operational oversights can turn into costly business lessons for startups and entrepreneurs.
28 May
Betting On AI: Jensen Huang And NVIDIA’s Rise To The Top
Betting On AI: Jensen Huang And NVIDIA’s Rise To The Top
Before AI was inevitable, it was a gamble—and Jensen Huang went all in.
14 Apr
Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1 bring confidential computing to bare metal and AI workloads
Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1 bring confidential computing to bare metal and AI workloads
Red Hat is excited to announce the release of Red Hat OpenShift sandboxed containers 1.12 and Red Hat build of Trustee 1.1, marking a major leap forward in our confidential computing journey. These releases graduate confidential containers on bare metal from …
14 Apr
Large AI firms hoovering maximum funding, not enough for smaller startups: Y Combinator’s Ankit Gupta
Large AI firms hoovering maximum funding, not enough for smaller startups: Y Combinator’s Ankit Gupta
YC Startup School: India’s talent pool across colleges and universities are key for building next-gen startups, which is what YC is looking to tap into. It wants to target entrepreneurs building for global markets, focussed on fintech, consumer, B2B, and ecom…
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC-RESULTS/ (PREVIEW, PIX):PREVIEW-TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
Any profit result ‌above T$505.7 billion would mark the company's highest-ever quarterly net income ​and its ninth consecutive quarter of profit growth
14 Apr
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
TSMC likely to book fourth straight quarter of record profit on insatiable AI demand
On Thursday, ​TSMC is expected to report a net profit of $17.1 billion for the quarter, according to an LSEG SmartEstimate compiled from 19 analysts. The war in the Middle East threatens to disrupt the supply of production materials for semiconductors such as…
14 Apr
If we can’t kick the habit, how do we manage AI’s energy needs?
If we can’t kick the habit, how do we manage AI’s energy needs?
One can only hope that OpenAI’s Sam Altman was joking when he sought to justify the immense energy consumption of artificial intelligence
14 Apr
What caused Nvidia Blackwell GPU prices to spike? #tech
What caused Nvidia Blackwell GPU prices to spike? #tech
Blackwell GPU hourly “rent” surges on agentic AI demand A compute pricing index tracking hourly costs for Nvidia Blackwell GPUs shows a sharp climb: hourly rental hit $4.08 , up 48% from $2.75 just two months earlier. The reported driver is rising demand tied…
14 Apr
Anthropic Releases Claude Mythos Preview with Cybersecurity Capabilities but Withholds Public Access
Anthropic Releases Claude Mythos Preview with Cybersecurity Capabilities but Withholds Public Access
Anthropic has introduced Claude Mythos Preview, its most advanced AI model, improving significantly in reasoning, coding, and cybersecurity. Unlike previous releases, it will not be publicly available. Access is limited to a consortium of tech companies throu…
14 Apr