By his own admission, David Robinson is âÂÂsomething of a clichéâÂÂ: an employee at a leading AI company who issues a dire warning while resigning from their job.
In an essay published in The Atlantic, Robinson said he led the writing of safety reports that accompanied OpenAIâÂÂs major product launches. He also said that with three-and-a-half years at OpenAI, he is âÂÂamong the longest-tenured employees at the company.â Now heâÂÂs quitting, because in his view, the companyâÂÂs âÂÂculture is broken.âÂÂ
In some ways, RobinsonâÂÂs comments echo those of Jacob Coxon, who worked as a researcher at both OpenAI and Anthropic before quitting and declaring that these companies are âÂÂgambling with our lives.â CoxonâÂÂs comments led to a broader debate about AI safety, with Anthropic CEO Dario Amodei unveiling a plan for more cautious AI development; AI executives met with President Donald Trump this week and signed what appeared to be hastily written, non-bindingàpledge to implement more safety controls.
But in RobinsonâÂÂs view, the debate needs to go beyond âÂÂspecific rules or new laws,â addressing the overall culture at these companies. And while much of the reporting around OpenAI has focused on how the companyâÂÂs CEO Sam Altman lost the trust of former colleagues, RobinsonâÂÂs essay suggests that OpenAIâÂÂs culture issues are the same as those of Silicon Valley at large.
âÂÂOpenAI has thrived by trial and error (which it calls âÂÂiterative deploymentâÂÂ), looking for problems and improving its guardrails in response,â he wrote. âÂÂBut this approach, by its very nature, guarantees periodic failures â and the scale of those failures is growing as systems get more capable.âÂÂ
Pointing to the recent breach of Hugging Face systems by OpenAI agents, as well as continuing revelations of OpenAI discovering more rogue agents, Robinson argued, âÂÂAn environment where things like this can happen is no place to grow artificial minds that could be smarter than we are and that might not do what we want them to.âÂÂ
Given the increased risk, Robinson argued that frontier AI companies need to start operating âÂÂlike nuclear-power plants or busy airports, with layers of redundancy and careful, time-consuming planning, so that the occasional and inevitable human error does not open a door to disaster.âÂÂÃÂ
But Robinson said that in his time at OpenAI, he âÂÂnever encountered a colleague who had experience making airplanes fly safely or nuclear reactors run without melting down, or helping the financial system grow without collapsing.âÂÂ
In response to RobinsonâÂÂs essay, OpenAI spokesperson Drew Pusateri said the company continues to improve its safety measures.
âÂÂWeâÂÂre making sure our models donâÂÂt become more capable than we can safely manage and secure, and we pause training or hold back models when we need to slow down,â Pusateri said in a statement. âÂÂWeâÂÂre making significant changes to strengthen security in our research and testing environments, train models to not just complete tasks but do so responsibly, expand our work with third-party evaluators, and improve real-time monitoring so we can detect and respond to concerning behavior earlier in the training process.âÂÂ
Beyond calling for changes in OpenAIâÂÂs culture, Robinson also said itâÂÂs time to ask bigger questions about alignment â something that he admitted could sound âÂÂtouchy-feely,â but he said itâÂÂs critical as companiesâ current âÂÂmeasures of how wellâ AI systems âÂÂmatch human values are coarse.âÂÂ
âÂÂThe smarter the industry lets models grow while these problems remain unsolved, the more dangerous our situation becomes,â he said.
RobinsonâÂÂs departure was first reported by Business Insider. In his essay, he also acknowledged that heâÂÂs following an apparently a common step in the AI whistleblower playbook: HeâÂÂs hired a PR firm. But he insisted, âÂÂThe decision to speak out is mine alone.âÂÂÃÂ
âÂÂPerhaps I should have stayed and fought for fundamental shifts in our staffing and culture, but in practice, my colleagues and I were so busy sprinting that we seldom had the chance to consider big changes, much less to actually make them,â Robinson said. âÂÂThatâÂÂs why I concluded that stronger incentives for safety â coming from outside the company â are a big part of getting this right.âÂÂ
When you purchase through links in our articles, we may earn a small commission. This doesnâÂÂt affect our editorial independence.
