A cleaned-up and expanded version of this thesis, in case you need to convince some AI-pilled manager that you can't just take these things at face value.
If you wanted to refer to this rant in a professional context, a cleaned up version is now up!
The design of LLM chatbots doesn't only make hallucination inevitable - it makes the user less likely to spot errors and react to them. The path of least resistance is drawn thru thoughtless copy-pasting.
nngroup.com
AI Chatbots Discourage Error Checking
AI hallucinations threaten the usefulness of LLM-generated text in professional environments, but today’s LLMs encourage users to take outputs at face value.