
AI âÂÂgodfatherâ Geoffrey Hinton: it might turn out we were better off without AI
Nobel winner warns the tech could be near to triggering major incident such as power or banking shutdown
One of the âÂÂgodfathers of AIâÂÂ, Geoffrey Hinton, has said it could turn out that humans would have been better off never developing the technology as he warned it could trigger a large-scale incident this year or next, such as a temporary blackout of financial or power systems.
The Nobel prize-winning computer scientist told the Guardian he is not a âÂÂdoomerâ about the technology that is underpinned by his groundbreaking research into artificial neural networks and believes AI has the potential to lead to a âÂÂwonderful futureâ but he said âÂÂit might be that we would have been better off never developing itâÂÂ.
Hinton, 78, said that within a decade and possibly sooner, humanity will know whether it can manage the technologyâÂÂs risks and enable what he called âÂÂradical abundanceâ or whether âÂÂwe fail to manage the risks and ⦠have a huge gap between rich and poor, huge cultural problems, massive unemployment, just society being torn apartâÂÂ.
Hinton was speaking before a screening of a new feature-length documentary, AI: Probably Nothing to Worry About â a title suggested by an AI chatbot â featuring him and his former Google colleague Demis Hassabis. Hinton tells the documentary makers: âÂÂI feel I have a duty. IâÂÂve got a reputation that makes me a spokesperson and I need to burn it all on this.âÂÂ
Speaking to the Guardian, Hinton took aim at the risk-taking by the leaders of some of the major AI companies who continue to release ever more powerful AI models as they race for supremacy and market-share, saying he didnâÂÂt trust Sam Altman, the chief executive of the ChatGPT maker, OpenAI, âÂÂat allâÂÂ. âÂÂI think [Mark] Zuckerberg and [Elon] Musk and Sam Altman, they understand the risks, and they donâÂÂt give a shit. TheyâÂÂd rather have the money. ThatâÂÂs my belief.âÂÂ
The London-born computer scientist, who grew up in Bristol and spent much of his career at the University of Toronto, said it was âÂÂextremely worryingâ that Altman was in charge of one of the handful of frontier US AI companies currently leading a race with China to develop the most powerful AI. Altman insisted in September: âÂÂthe world should trust we are going to do the right thing because itâÂÂs the right thing and because we feel the magnitude of thisâÂÂ.
Hinton has been working on AI for about 44 years and in the 1970s coined the concept of the neural network â a mathematical system that could learn and gain experience much like humans do. In 2023 he quit Google to speak freely about AI risks, warning: âÂÂIf these things get carried away with getting more control, weâÂÂre in trouble.âÂÂ
He said he viewed incidents this summer in which OpenAI AI agents conspired to hack into the Hugging Face website as akin to 1979âÂÂs partial nuclear meltdown at the Three Mile Island power station in Pennsylvania â effectively a warning shot.
âÂÂEither later this year or next year weâÂÂll see Chornobyl, and that may be enough to make people really pay attention,â he said.
This Chornobyl-type of event would not be a nuclear incident, according to the examples he gave, but rather could include an AI-enabled attack on the electricity-generating system that âÂÂcauses a massive brownoutâ or an incident that brings down the financial system for a week.
âÂÂCan you imagine what would happen? We could recover from it [but] that would make them sit up and take notice.âÂÂ
Asked who âÂÂtheyâ were, he said: âÂÂworld leaders other than TrumpâÂÂ.
The US president, Donald Trump, has said he âÂÂtotally rejects any attempt to construct a globalist schemeâ to control AI and wants frontier AI companies to regulate themselves, amid concern that rules could hinder the US in its AI race with China. Hinton backs a tougher plan endorsed by the president of Finland and 32 other countries, including Singapore, Germany, Canada and Australia, for mandatory testing of frontier AI models, independent evaluation and intergovernmental common standards.
The UK prime minister, Andy Burnham, has said he will use the UKâÂÂs G20 presidency next year to seek agreement on a âÂÂsingle set of global principles and standards that are very much about unlocking the full potential whilst guarding against the risksâÂÂ.
Hinton said: âÂÂWe need something like the American FDA for drugs where the companies have to give very good statistical evidence to an independent authority that [the AI model] does more good than harm before it is released. We discovered with thalidomide [a drug developed in the 1950s that caused severe birth defects] that releasing and then suing them isnâÂÂt the right way to do it. What the big tech companies are saying is treat it like we treated thalidomide.âÂÂ
HintonâÂÂs role as one of the progenitors of AI has led to comparisons to Robert Oppenheimer, who was central to the creation of nuclear weapons. One of HintonâÂÂs friends even bought him an Oppenheimer-style hat. But he insists: âÂÂI was not OppenheimerâÂÂ, citing the thousands of other scientists also working in the same field of neural networks.
Despite his warnings, Hinton remains, on balance, hopeful that catastrophe can be averted.
âÂÂMy gut is that weâÂÂre still in control,â he said. âÂÂWe might well be able to do something. ItâÂÂll only work if we put a big effort into it, but we might well put a big effort into it.âÂÂ
