Questions raised about OpenAI leaders’ trustworthiness by the New Yorker
One excerpt stuck out for me – on Brockman’s idea to play China, Russia, and other world powers against each other: In 2017, Amodei hired Page Hedley, a former public-interest lawyer, to be OpenAI’s policy and ethics adviser. In an early PowerPoint presentation to executives, Hedley outlined how OpenAI might avert a “catastrophic” arms race—perhaps by building a coalition of A.I. labs that would eventually coördinate with an international body akin to NATO, to insure that the technology was deployed safely. As Hedley recalled it, Brockman didn’t understand how this would help the company beat its competitors. “No matter what I said,” Hedley told us, “Greg kept going back to ‘So how do we raise more money? How do we win?’ According to several interviews and contemporaneous records, Brockman offered a counterproposal: OpenAI could enrich itself by playing world powers—including China and Russia—against one another, perhaps by starting a bidding war among them. According to Hedley, the thinking seemed to be, It worked for nuclear weapons, why not for A.I.? He was aghast: “The premise, which they didn’t dispute, was ‘We’re talking about potentially the most destructive technology ever invented—what if we sold it to Putin?’” Brainstorming sessions often produce outlandish ideas. Hedley hoped that this one, which came to be known internally as the “countries plan,” would be dropped. Instead, according to several people involved and to contemporaneous documents, OpenAI executives seemed to grow only more excited about it. Brockman’s goal, according to Jack Clark, OpenAI’s policy director at
The New Yorker’s recent article has raised questions about the trustworthiness of OpenAI’s leadership, particularly in relation to their approach to managing the potential risks of artificial intelligence. The piece delves into a contentious idea proposed by Greg Brockman, one of the company’s founders, which involved exploiting geopolitical tensions to fuel growth.
In 2017, OpenAI’s CEO, Sam Altman, appointed Page Hedley, a former public-interest lawyer, as the company’s policy and ethics adviser. Hedley’s role was to ensure that the development and deployment of AI technology were done responsibly, aiming to prevent a catastrophic arms race. In an early PowerPoint presentation to executives, Hedley suggested building a coalition of AI labs that could coordinate with an international body similar to NATO, ensuring safe deployment of the technology.
However, Brockman, who was focused on the company’s competitive edge and fundraising, struggled to see how this approach would benefit OpenAI. Instead, he proposed an alternative plan: leveraging world powers like China and Russia in a bidding war to enrich the company. The idea was based on the premise that if it worked for nuclear weapons, why not for AI? Hedley was appalled, arguing that the technology in question could be the most destructive ever invented, and suggesting it be sold to Putin.
Despite Hedley’s concerns, the “countries plan” gained traction among OpenAI executives. According to Jack Clark, OpenAI’s policy director at the time, Brockman’s goal was to create a prisoner’s dilemma, where nations would need to fund OpenAI to avoid dangerous consequences. A junior researcher present during a company meeting described the plan as “completely fucking insane.”
The article highlights that executives even discussed this approach with potential donors, raising concerns about the company’s priorities. While Hedley’s initial ideas aimed to promote collaboration and safety, Brockman’s vision prioritized competition and profit. This stark contrast in values has led to questions about the leadership’s commitment to ethical AI development.
The New Yorker’s report underscores the challenges faced by AI organizations in balancing innovation with responsibility. It raises concerns about the potential for exploiting geopolitical tensions for financial gain, rather than focusing on the broader societal impact of AI. As the field of AI continues to evolve, the trustworthiness of its leaders will be crucial in shaping a future where the technology benefits all.
