Isn't the more serious problem the lack of affordable healthcare performed by actual humans?
nytimes.com
ChatGPT Led to a Man’s Near-Fatal Health Crisis, Lawsuit Claims
The case appears to be the first to argue that a chatbot’s advice harmed someone seeking guidance about a medical condition.