The unseen threat of AI: Why you shouldn't ask ChatGPT for health advice

New Delhi: In a rare and alarming case in the United States, a man developed life-threatening bromide poisoning after following diet advice given by the AI language model ChatGPT. According to a report by Gizmodo, this could be the first known instance of bromide poisoning linked to AI guidance. The case was detailed by doctors at the University of Washington in the journal Annals of Internal Medicine: Clinical Cases.

The man consumed sodium bromide for three months, believing it was a safe substitute for chloride in his diet, based on ChatGPT’s advice, which did not warn him of the dangers. Bromide compounds were previously used in medicines for anxiety and insomnia, but were banned decades ago due to severe health risks. Today, bromide is primarily found in veterinary drugs and some industrial products, and human cases of bromide poisoning, or bromism, remain extremely rare.

Initially, the man sought emergency care, fearing his neighbour was poisoning him. Despite stable vital signs, he showed paranoia, refused to drink water despite thirst, and experienced hallucinations. His condition rapidly deteriorated to a psychotic episode, necessitating an involuntary psychiatric hold. Treatment with intravenous fluids and antipsychotic medication led to gradual improvement.

Upon stabilisation, the man revealed that he had asked ChatGPT for alternatives to table salt and was advised to use bromide, unaware of its harmful effects. Although the original chat records were unavailable, doctors later asked ChatGPT the same question and found it again suggested bromide without warnings about its toxicity to humans.

Medical experts underscore that this case highlights AI’s ability to provide scientific information without proper context or understanding of health risks. The man fully recovered after three weeks in the hospital and was well during follow-up.

Doctors have cautioned that while AI can increase access to scientific knowledge, it should never be a substitute for professional medical advice.

With inputs from IANS