Same with Volkswagen tbh.
Boards and management need to go, fast.
Johnny
@johnnyfreitag.bsky.social
215 followers 357 following 331 posts
Product, Design, Dev / Born @ 350ppm / SolarPunk🍃 / Degrowth advocate / Eco-populist
Product, Design, Dev / Born @ 350ppm / SolarPunk🍃 / Degrowth advocate / Eco-populist
![In a story that’s a little on the nose, The Financial Times reported last week (covering a study by GPTZero) that a KPMG report (that’s now been taken down) about the benefits of AI had exaggerated the scale of its adoption through multiple AI hallucinations:
The October report, “Redefining excellence in the age of agentic AI”, made numerous false claims about the use of AI by organisations including the Swiss bank UBS, the UK’s National Health Service and the public transit groups Swiss Federal Railways and Transport for London.
The inaccuracies were identified as AI hallucinations by the research group GPTZero and verified by the FT. After being alerted to the issue, UBS said it would ask KPMG to remove the false claims, and the Big Four firm on Thursday pulled the report from some of its websites.
The KPMG report claimed global wealth manager UBS “integrates AI agents across investment advisory, risk management and compliance monitoring”. A spokesperson for [UBS] told the FT the assertions were “factually incorrect”.
The report also included hallucinations about AI agent use by Swiss Federal Railways, Transport for London and NHS Greater Manchester, fabricating entire integrations and product lines in a report that was likely used to justify billions of dollars of spend.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:qc6xzgctorfsm35w6i3vdebx/bafkreif7npmgt2xkejhx75fh4g5amn3raeeekwbkn6xywqudyce4e5vry4)
![Per GPTZero, 40 out of 45 of the report’s citations are either fake, make critical mistakes about the contents, or lack enough detail to be used as proof. They also believe that whoever wrote the report let the AI do most of the work:
Our team suspects that the authors of Total Experience used an AI-powered referencing tool to generate the report’s citations because the errors are both mistakes typical of Large Language Models (LLMs) and consistent throughout the reference list. A human would not consistently paraphrase titles, mistake topics for authors (e.g., citation 9), or repeat information across multiple components (e.g., citation 2).
GPTZero also notes that the report is being cited by LLMs as evidence to prove the success of AI agents, poisoning the already-hallucinatory well of information that these models draw upon.
KPMG has annual revenues of over $39 billion, and sells something called KPMG Workbench which promises to “supercharge your business with [its] multi-agent AI platform, combining advanced, trusted AI agents with insights and deep industry expertise of KPMG professionals.” I assume these are the same professionals that greenlit the report.
It’s likely that this was a mixture of laziness and ignorance, but I also think it might be a situation where the person (or people) writing the report simply couldn’t find any real citations to prove their point, choosing instead to let an LLM crap out some thought-slop in the hopes that nobody would notice.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:qc6xzgctorfsm35w6i3vdebx/bafkreig6wdjbbgvudzkszqzrtikqwajbrbvfnktcvb6rladoxhnjrznl6m)
