
âÂÂExtremely disappointedâÂÂ: WA government seeks reimbursement from Deloitte over flawed university report
State paid consultancy firm $166,000 for feasibility study on merging the three tertiary institutions
-
Get our breaking news email, free app or daily news podcast
The Western Australian government has said it is âÂÂextremely disappointedâ and is seeking an âÂÂexpeditedâ cost recovery from Deloitte after errors were discovered in a report about a potential university merger, including AI-hallucinated references and hundreds of millions of dollars in cost discrepancies.
The government paid Deloitte $166,000 for a feasibility study on merging the University of Western Australia, Curtin University and Murdoch University.
Deloitte considered three merger options between the three universities, with âÂÂlowâÂÂ, âÂÂmidâ and âÂÂhighâ cost scenarios, and broke down the calculations of those costs in the reportâÂÂs appendix.
Under the âÂÂhighâ cost scenario of a merger between Curtin and UWA, the report calculates the âÂÂtotal costs to day 1â as $514m, and âÂÂpost day 1â over five years at $145m. The total cost of those two payments is $659m but the report wrote $399m â a $260m discrepancy.
Prof Stephen Bartos, an expert in public sector governance at the University of Canberra, said the errors discredited the report. âÂÂIn my view, theyâÂÂre so extensive that you probably need a new report, or at the very least someone to go through that material from the ground up and rework it manually without the use of AI,â he said.
âÂÂAny errors in a report like this, especially on something controversial like a university merger, discredits the report, and Deloitte shouldnâÂÂt have had these errors.âÂÂ
Under a âÂÂlowâ cost merger scenario between Curtin, UWA and Murdoch, the total costs to day one are $396m and total post day one over five years are $116m. That total would be $512m but the report calculates the two numbers to $823m â a $311m discrepancy.
Deloitte is already under pressure after it was revealed in the media this month that the same report contained hallucinated AI references, leading the state opposition to label it âÂÂAI slopâÂÂ.
The consultancy firm admits in its report it used generative AI to âÂÂsupport the collation of research, synthesis of information and editorial proofingâ and had earlier dismissed the errors as âÂÂminorâÂÂ.
A spokesperson for the WA government told Guardian Australia that the Department of Energy and Economic Diversification had written to Deloitte to expedite the cost recovery process for the report.
âÂÂWe are extremely disappointed these errors are being found now,â the spokesperson said. âÂÂWe are advised they do not affect the modelling in the report or its findings, but any errors will be corrected as part of a review by Deloitte which will re-issue the report.
âÂÂAll available data, along with new information, will be interrogated by the university reform business case.âÂÂ
The WA tertiary education minister, Tony Buti, described them as âÂÂtyposâÂÂ, though a day later said he was angry and disappointed with Deloitte.
Guardian Australia has found that one of the references to a World Health Organization report has a ChatGPT metadata tag on the URL, indicating that the link was directly sourced from the chatbot.
In the report, Curtin University is referred to repeatedly as the Curtin University of Technology â a name the institution has not used since 2010, and that was changed under an act of state parliament in 2017.
Bartos said the numbers diverging so significantly was cause for concern. âÂÂUnless the numbers add up, a government might not want to do it,â he said.
Prof Christian Downie, from the Australian National UniversityâÂÂs school of regulation and global governance, who has previously examined submissions to government that contained AI hallucinations, said human errors happened and mistakes in reports could be expected and, although Deloitte outlined broadly its use of AI in the report, there was a lack of transparency.
âÂÂI think we need much more detail about how [AI is] being used and for what parts of the report writing process,â he said. âÂÂIf theyâÂÂre going to use it for data collection and if thereâÂÂs concerns about the data, then that needs to be detailed in the report.âÂÂ
Downie said without transparency it was hard to have confidence in the report. He said broadly as AI use increases, governments need to reassess their contracts with consultancy firms.
âÂÂI think all levels of government, both state and federal, need to be recalibrating their contractual relationship arrangements when they outsource work to consulting firms to ensure that the proper incentives and penalties are in place in those contracts,â he said.
The WA government has that argued the merger is a âÂÂonce-in-a-generationâ opportunity. Buti told the ABC on Tuesday: âÂÂI want to commit to it if the business case stacks up, and then itâÂÂs a government decision.âÂÂ
It was not supported by Murdoch University, whose vice-chancellor, Prof Andrew Deeks, criticised the report and penned an op-ed on the universityâÂÂs website arguing that âÂÂall that a university merger will do for WA is cost a lot of time, money and energy, while reducing choices for students and alienating alumni.
âÂÂThat the Western Australian Government continues to be taken in by this nonsense is extraordinary,â he wrote. âÂÂAnother fail for Deloitte.âÂÂ
Deloitte did not respond to questions from Guardian Australia.
