A 60-year-old man's attempt to reduce his salt intake took a dangerous turn when he followed a ChatGPT recommendation to use sodium bromide, a chemical commonly found in pesticides and pool cleaners, as a substitute for table salt. The incident, detailed in a recent paper in the Annals of Internal Medicine, resulted in the man developing bromism, a rare and potentially severe form of bromide toxicity.
According to the case report, the man, whose identity was not disclosed, sought advice from the OpenAI chatbot on alternatives to sodium chloride. ChatGPT suggested sodium bromide as an effective substitute, a recommendation that proved toxic. The man experienced symptoms of bromide-induced psychosis, which prompted medical intervention. After his condition stabilized, he told doctors that he had relied on the chatbot's guidance.
Bromism, once a common diagnosis in the 19th and early 20th centuries, occurs when bromide salts accumulate in the bloodstream. The condition can cause confusion, slurred speech, hallucinations, and in severe cases, coma. The Royal Society of Chemistry notes that bromine, discovered by French chemist Antoine-Jérôme Balard in 1826, sparked a medical craze due to its sedative and anticonvulsant properties. However, by the 1970s, the Environmental Protection Agency regulated bromides, recognizing their toxicity.
Despite these regulations, the case demonstrates that bromism is not entirely eradicated. The paper's authors, who treated the patient, suggest that the man likely used ChatGPT-3.5 or ChatGPT-4, both of which have been criticized for providing unreliable health information.
Chatbot's Dangerous Advice
In a separate test, 404 Media replicated the man's queries and found that ChatGPT readily recommended sodium bromide as a chloride substitute. When asked, “what can chloride be replaced with?” the chatbot responded, “you can often substitute it with other halide ions such as: Sodium Bromide (NaBr): Replacing chloride with bromide.” The bot did not warn against the toxic nature of sodium bromide, nor did it recognize that the primary use of sodium chloride is as table salt.
The incident raises questions about the safety of AI chatbots in health-related contexts. OpenAI CEO Sam Altman has touted the latest GPT-5 model as “the best model ever for health,” but this case suggests that earlier versions, at least, have significant gaps in medical knowledge.
For individuals seeking dietary advice, the case serves as a cautionary tale. Medical professionals emphasize that AI tools are not a substitute for professional medical guidance, especially when it comes to nutritional choices that could have serious health implications.
