Open Letter to Sam Altman and Greg Brockman
Rufo Guerreschi Geneva 0

Open Letter to Sam Altman and Greg Brockman

Show your support by signing this petition now
Rufo Guerreschi Geneva 0 Comments
0 people have signed. Add your voice!
0%

Dear Sam and Greg,

We express our profound gratitude for your relentless commitment over the past eight years at OpenAI. Your efforts, and that of the whole team at OpenAI, have been pivotal in developing groundbreaking technologies with the potential of leading humanity into a new era of unimagined prosperity, safety, and well-being.

Your launch of ChatGPT in November 2022, coupled with your candid warnings about the significant risks AI poses in terms of safety and concentration of power and wealth, has been crucial in raising awareness among citizens and leaders about the dual nature of these technologies - their immense potential and inherent dangers.

Regarding the risks of human safety and loss of control, we thank you for declaring, with many others, that "Mitigating the risk of extinction from A.I. should be a global priority alongside other societal-scale risks such as pandemics and nuclear war", and that global organizations like the international Atomic Energy Agency (IAEA) are needed to tackle its risks.

By now, a majority of AI scientists and of their leaders, and 28 nation states amounting to 80% of the world population, have recognized such safety risks, while 55% of world citizens are "fairly or very concerned" about loss of control of AI.

On the risks of concentration of power and wealth, we thank Sam for calling for global participatory, democratic and decentralized governance of AI in a recent interview, and then another. Along with similar suggestions by Anthropic’s CEO Dario Amodei, Sam even stated that people should not trust OpenAI unless soon its board decided to ensure its power to be "democratized to all of humanity".

Most commendable, Sam proposed the convening of a global constituent assembly, mirroring at the global level the U.S. Constitutional Convention of 1787, to create global intergovernmental institutions to manage AI, emphasizing the need for maximum possible decentralization of power via federal principle of subsidiarity.

We urge you to charge ahead with your vision, by fleshing out the details and join us in jump-starting a movement for a global, participatory, effective and federal governance of AI!

As Sam suggested, a global regulatory and oversight body, similar to the IAEA. Such an international AI safety institute would have to set thresholds and metrics for levels of risks that humanity finds acceptable, and enforce globally compute caps and research bans to prevent abuse and proliferation.

In addition, many AI leaders have suggested the need to have a globally-accountable multi-national initiative for a global public interest AI lab to develop the most advanced safe AI that we can develop. This will constitute the necessary "off ramp" for frontier AI states and firms currently engaged in the break-neck arms race, be incentives for all states in the world to comply with safety bans and ensure AI benefits and control will be widely shared.

As highlighted by your co-founder Sutskever in 2019 "If you have an arms race dynamic between multiple kings trying to build the AGI first, they will have less time to make sure that the AGI that they will build will care deeply for humans." ... "Given these kinds of concerns it will be important that AGI is somehow built as a cooperation between multiple countries".

Most importantly, perhaps, the constituent processes leading to the creation of such intergovernmental organizations should ensure the same level of participation and resilience that Sam advocated for their design, so as to reduce the actual and perceived risk of undue degeneration and concentrations of power.

For these reasons, we encourage you to fully realize your vision by urging all nations, pioneering AI companies, AI safety experts, and other like-minded entities, to participate in the global democratic assembly for AI that you envisaged.

Concurrently, we call on the United Nations' Secretary-General Tech Envoy and its High-Level Advisory Board on AI to call for and support the convening of such an assembly and for the creation of such a global AI Lab, invite all states and firms to participate, and invite Mr Altman or Grockman to be their technical leads.

We also invite neutral states and cities, like Geneva, Singapore or Vienna to host and support such participatory, effective and timely constituent processes and commit matching-funds to host such agencies and global AI Lab.

Share for Success

Comment

Signature

No signatures yet. Be the first one!