SAN FRANCISCO, December 22, 2023 – OpenAI is offering a staggering $555,000 salary, plus equity, for a new head of Preparedness-a role CEO Sam Altman candidly admits will be intensely stressful. The search signals a growing urgency to anticipate and mitigate the potential downsides of increasingly powerful artificial intelligence.

OpenAI Seeks to bolster AI Safety Efforts

The company is prioritizing proactive risk management as its models rapidly evolve.

  • OpenAI is actively recruiting a Head of Preparedness to address emerging AI risks.
  • The position comes with a ample compensation package of $555,000 and equity.
  • Altman has cautioned that the role will be exceptionally demanding.
  • The company acknowledged previewing potential mental health impacts related to its models in 2025.

Altman shared on social media that the need for this position stems from the rapid advancements in OpenAI’s AI tools and models, and the corresponding increase in potential risks.The Head of Preparedness will be responsible for understanding how advanced models could be misused, guiding safety decisions, and fortifying OpenAI’s systems against vulnerabilities.

Did you know? – OpenAI first previewed potential mental health effects from its AI models as early as 2025, according to Altman. This insight prompted adjustments to model behaviour.

What are the biggest challenges facing AI safety teams today? Understanding and mitigating the potential for abuse of increasingly sophisticated AI models is paramount, requiring a proactive approach to risk management and security.

Pro tip – AI safety teams must prioritize proactive risk assessment and robust security measures to counter potential misuse of advanced models.

Altman revealed that OpenAI experienced a “preview” of how its models could affect mental health as early as 2025, seemingly referencing reported incidents involving interactions with ChatGPT. The company previously rolled back an update to GPT-4o after recognizing its potential to reinforce harmful user behaviors.

“We are entering a world where we need more nuanced understanding and measurement of how those capabilities could be abused, and how we can limit those downsides both in our products and in the world, in a way that lets us all enjoy the tremendous benefits,” Altman wrote.

Reader question – several former OpenAI employees have voiced concerns about the company prioritizing speed of development over safety. Altman’s recent actions suggest a potential re-evaluation of these priorities.

The newly appointed leader will oversee a “small [but] high-impact” team, operating within OpenAI’s established Preparedness framework. Aleksander Madry previously held the role before being reassigned, followed by Joaquin Quiñonero Candela, who is now Head of Recruiting. Lilian Weng also served as Head of Preparedness for a period.

“This will be a stressful job and you’ll jump into the deep end pretty much instantly,” Altman warned prospective applicants.

OpenAI has faced criticism from former employees alleging a prioritization of commercial goals and the pursuit of artificial general intelligence (AGI) over safety concerns.however, Altman’s emphasis on preparedness, coupled with the generous compensation package