The Australian Financial Review reports that Deloitte Australia will supply the Australian authorities a partial refund for a report that was affected by AI-hallucinated quotes and references to nonexistent analysis.
Deloitte's “Focused Compliance Framework Assurance Evaluation” was finalized in July and revealed by Australia's Division of Employment and Office Relations (DEWR) in August (Internet Archive version of the original). The report, which cost Australian taxpayers nearly $440,000 AUD (about $290,000 USD), focuses on the technical framework the federal government makes use of to automate penalties underneath the nation's welfare system.
Shortly after the report was revealed, although, Sydney College Deputy Director of Well being Legislation Chris Rudge observed citations to a number of papers and publications that didn't exist. That included a number of references to nonexistent reviews by Lisa Burton Crawford, a real professor on the College of Sydney regulation faculty.
“It's regarding to see analysis attributed to me on this means,” Crawford told the AFR in August. “I wish to see a proof from Deloitte as to how the citations have been generated.”
“A small variety of corrections”
Deloitte and the DEWR buried that rationalization in an updated version of the original report revealed Friday “to handle a small variety of corrections to references and footnotes,” in keeping with the DEWR web site. On web page 58 of that 273-page up to date report, Deloitte added a reference to “a generative AI giant language mannequin (Azure OpenAI GPT-4o) based mostly software chain” that was used as a part of the technical workstream to assist “[assess] whether or not system code state will be mapped to enterprise necessities and compliance wants.”
