Elon Emails

Sutskever: 'Open' means sharing benefits, not science

From:
Ilya Sutskever
Date:
January 2, 2016 (Sent 9:06 AM)
To:
Elon Musk, Sam Altman, Greg Brockman
Subject:
Fwd: congrats on the falcon 9
The article is concerned with a hard takeoff scenario: if a hard takeoff occurs, and a safe AI is harder to build than an unsafe one, then by opensorucing everything, we make it easy for someone unscrupulous with access to overwhelming amount of hardware to build an unsafe AI, which will experience a hard takeoff. As we get closer to building AI, it will make sense to start being less open. The Open in openAI means that everyone should benefit from the fruits of AI after its built, but it's totally OK to not share the science (even though sharing everything is definitely the right strategy in the short and possibly medium term for recruitment purposes).

About this email

Replying to Musk's forward, Sutskever says it will make sense to be less open as AI gets closer, and that the 'Open' in OpenAI means everyone benefits from AI's fruits, not that the science must be shared.

Notes

Typo 'opensorucing' is in the published text. Paragraphing follows the LessWrong transcription as retrieved (single block).

Where it came from

Published by recipient; attribution confirmed.

OpenAI, executive & internal. Tags: open-source, safety, hard-takeoff, recruiting