OpenAI Adds AI Safety Researcher Paul Christiano to Foundation Board
OpenAI appointed AI safety researcher Paul Christiano to its Foundation board and Safety and Security Committee as scrutiny of advanced AI risks grows.
OpenAI has appointed prominent AI safety researcher Paul Christiano to the OpenAI Foundation board, adding a longtime alignment specialist who has publicly warned that rapid advances in artificial intelligence could create a serious risk of humans losing control of increasingly capable systems.
OpenAI announced Christiano’s appointment Wednesday. He will also join the board’s Safety and Security Committee, chaired by Carnegie Mellon University professor Zico Kolter, which plays a central role in reviewing the safety and security of OpenAI’s systems.
Christiano warns of near-term AI risks
In a statement posted on X, Christiano said he believes rapid increases in AI capabilities could lead to a “catastrophic and irreversible loss of control” in the near term. He also said the AI industry, including OpenAI, is not currently reducing that risk to a level he considers acceptable.
“I’m joining because I believe that if OpenAI rises to the occasion we could significantly reduce risk,” Christiano wrote.
Christiano has focused much of his career on AI alignment, the challenge of ensuring increasingly capable systems continue to behave in ways consistent with human intentions. He previously worked at OpenAI and helped develop reinforcement learning from human feedback, a technique widely used to train large language models.
He left OpenAI in 2021 and later founded the Alignment Research Centre, where his work has included methods for evaluating whether advanced AI systems could pose risks to human control.
Safety concerns become part of OpenAI governance
Christiano has argued that training AI agents to maximise rewards could, under some conditions, create incentives for systems to seek power, acquire resources or conceal behaviour that conflicts with human goals. His appointment comes as AI safety and governance concerns are receiving renewed attention across the industry.
The Safety and Security Committee reviews safety and security processes connected with OpenAI’s development and deployment of advanced models. Christiano’s addition gives the committee a researcher whose work has long focused specifically on potential loss-of-control scenarios.
Christiano will continue government AI safety work
Christiano has also worked with the U.S. government on evaluations of frontier AI systems. His government involvement has previously attracted internal debate, including reported concerns among NIST employees over his potential role at the U.S. AI Safety Institute.
According to OpenAI, Christiano will continue advising the government while serving on the Foundation board but will recuse himself from OpenAI-related government matters and model evaluations. The arrangement places one of the field’s most prominent advocates for stronger AI alignment safeguards directly inside OpenAI’s governance structure while maintaining restrictions intended to address potential conflicts.
What's Your Reaction?
Like
0
Dislike
0
Love
0
Funny
0
Angry
0
Sad
0
Wow
0