Elon Emails

Altman sends Musk the draft OpenAI Charter

From:
Sam Altman
Date:
April 2, 2018
To:
Elon Musk; cc Shivon Zilis
Subject:
The OpenAI Charter
We are planning to release this next week--any thoughts? The OpenAI Charter OpenAI's mission is to ensure that artificial general intelligence (AGI) — by which we mean highly autonomous systems that outperform humans at most economically-valuable creative work — benefits all of humanity. We will attempt to directly build safe and beneficial AGI, but will also consider our mission fulfilled if our work aids others to achieve this outcome. To that end, we commit to the following principles: Broadly Distributed Benefits We commit to use any influence we obtain over AGI's deployment to ensure it is used for the benefit of all, and to avoid enabling uses of AI or AGI that harm humanity or unduly concentrate power. Our primary fiduciary duty is to humanity. We anticipate needing to marshal substantial resources to fulfill our mission, but will always assiduously act to minimize conflicts of interest among our employees and stakeholders that could compromise broad benefit. Long-Term Safety We are committed to doing the research required to make AGI safe, and to driving the broad adoption of such research across the AI community. We are concerned about late-stage AGI development becoming a competitive race without time for adequate safety precautions. Therefore, if a value-aligned, safety-conscious project comes close to building AGI before we do, we commit to stop competing with and start assisting this project. We will work out specifics in case by case agreements, but a typical triggering condition might be "a better-than-even chance of success in the next 2 years". Technical Leadership To be effective at addressing AGI's impact on society, OpenAI must be on the cutting edge of AI capabilities — policy and safety advocacy alone would be insufficient. We believe that AI will have broad societal impact before AGI, and we'll strive to lead in those areas that are directly aligned with our mission and expertise. Cooperative Orientation We will actively cooperate with other research and policy institutions; we seek to create a global community working together to address AGI's global challenges. We are committed to providing public goods that help society navigate the path to AGI. Today this includes publishing most of our AI research, but we expect that safety and security concerns will reduce our traditional publishing in the future, while increasing the importance of sharing safety, policy, and standards research.

About this email

Altman sends Musk the text of the OpenAI Charter a week before its release and asks for any thoughts.

Notes

Text taken from the LessWrong transcription (habryka, Nov 16 2024), which the compiler states was checked against the originals. Sent Apr 2, 2018 1:54 PM.

Where it came from

Court record; attribution confirmed.

OpenAI, executive & internal. Tags: charter, mission, safety, governance, musk-v-openai