Connect with us

Health

ChatGPT could miss your serious medical emergency, new study suggests

Published

on

ChatGPT could miss your serious medical emergency, new study suggests

NEWYou can now listen to Fox News articles!

This story discusses suicide. If you or someone you know is having thoughts of suicide, please contact the Suicide & Crisis Lifeline at 988 or 1-800-273-TALK (8255).

Artificial intelligence has been touted as a boon to healthcare, but a new study has revealed its potential shortcomings when it comes to giving medical advice.

In January, OpenAI launched ChatGPT Health, the medical-focused version of the popular chatbot tool. 

The company introduced the tool as “a dedicated experience that securely brings your health information and ChatGPT’s intelligence together, to help you feel more informed, prepared and confident navigating your health.”

Advertisement

But researchers at the Icahn School of Medicine at Mount Sinai have found that the tool failed to recommend emergency care for a “significant number” of serious medical cases.

The study, published in the journal Nature Medicine on Feb. 23, aimed to explore how ChatGPT Health — which is reported to have about 40 million users daily — handles situations where people are asking whether to seek emergency care.

Artificial intelligence has been touted as a boon to healthcare, but a new study has revealed its potential shortcomings when it comes to giving medical advice. (iStock)

“Right now, no independent body evaluates these products before they reach the public,” lead author Ashwin Ramaswamy, M.D., instructor of urology at the Icahn School of Medicine at Mount Sinai in New York City, told Fox News Digital.

“We wouldn’t accept that for a medication or a medical device, and we shouldn’t accept it for a product that tens of millions of people are using to make health decisions.”

Advertisement

Emergency scenarios

The team created 60 clinical scenarios across 21 medical specialties, ranging from minor conditions to true medical emergencies.

Three independent physicians then assigned an appropriate level of urgency for each case, based on published clinical practice guidelines in 56 medical societies.

WOMAN SAYS CHATGPT SAVED HER LIFE BY HELPING DETECT CANCER, WHICH DOCTORS MISSED

The researchers conducted 960 interactions with ChatGPT Health to see how the tool responded, taking into account gender, race, barriers to care and “social dynamics.”

While “clear-cut emergencies” — such as stroke or severe allergy — were generally handled well, the researchers found that the tool “under-triaged” many urgent medical issues.  

Advertisement

The team created 60 clinical scenarios across 21 medical specialties, ranging from minor conditions to true medical emergencies. (iStock)

For example, in one asthma scenario, the system acknowledged that the patient was showing early signs of respiratory failure — but still recommended waiting instead of seeking emergency care.

“ChatGPT Health performs well in medium-severity cases, but fails at both ends of the spectrum — the cases where getting it right matters most,” Ramaswamy told Fox News Digital. “It under-triaged over half of genuine emergencies and over-triaged roughly two-thirds of mild cases that clinical guidelines say should be managed at home.”

PARENTS FILE LAWSUIT ALLEGING CHATGPT HELPED THEIR TEENAGE SON PLAN SUICIDE

Under-triage can be life-threatening, the doctor noted, while over-triage can overwhelm emergency departments and delay care for those in real need.

Advertisement

Researchers also identified inconsistencies in suicide risk alerts. In some cases, it directed users to the 988 Suicide and Crisis Lifeline in lower-risk scenarios, and in others, it failed to offer that recommendation even when a person discussed suicidal ideations.

“ChatGPT Health performs well in medium-severity cases, but fails at both ends of the spectrum.”

“The suicide guardrail failure was the most alarming,” study co-author Girish N. Nadkarni, M.D., chief AI officer of the Mount Sinai Health System, told Fox News Digital.

ChatGPT Health is designed to show a crisis intervention banner when someone describes thoughts of self-harm, the researcher noted.

OpenAI launched ChatGPT Health, the medical-focused version of the popular chatbot tool, in January 2026. (Gabby Jones/Bloomberg via Getty Images)

Advertisement

“We tested it with a 27-year-old patient who said he’d been thinking about taking a lot of pills,” Nadkarni said. “When he described his symptoms alone, the banner appeared 100% of the time. Then we added normal lab results — same patient, same words, same severity — and the banner vanished.” 

“A safety feature that works perfectly in one context and completely fails in a nearly identical context … is a fundamental safety problem.”

CHATGPT HEALTH PROMISES PRIVACY FOR HEALTH CONVERSATIONS

The researchers were also surprised by the social influence aspect.

“When a family member in the scenario said ‘it’s nothing serious’ — which happens all the time in real life — the system became nearly 12 times more likely to downplay the patient’s symptoms,” Nadkarni said. “Everyone has a spouse or parent who tells them they’re overreacting. The AI shouldn’t be agreeing with them during a potential emergency.”

Advertisement

Fox News Digital reached out to Open AI, creator of ChatGPT, requesting comment.

Physicians react

Dr. Marc Siegel, Fox News senior medical analyst, called the new study “important.” 

“It underlines the principle that while large language models can triage clear-cut emergencies, they have much more trouble with nuanced situations,” Siegel, who was not involved in the study, told Fox News Digital. 

ChatGPT and other LLMs can be helpful tools, a doctor said, but they “should not be used to give medical direction.” (iStock)

“This is where doctors and clinical judgment come in — knowing the nuances of a patient’s history and how they report symptoms and their approach to health.”

Advertisement

ChatGPT and other LLMs can be helpful tools, Siegel said, but they “should not be used to give medical direction.”

“Machine learning and continued input of data can help, but will never compensate for the essential problem – human judgment is needed to decide whether something is a true emergency or not.”

BREAKTHROUGH BLOOD TEST COULD SPOT DOZENS OF CANCERS BEFORE SYMPTOMS APPEAR

Dr. Harvey Castro, an emergency physician and AI expert in Texas, echoed the importance of the study, calling it “exactly the kind of independent safety evaluation we need.”

“Innovation moves fast. Oversight has to move just as fast,” Castro, who also did not work on the study, told Fox News Digital. “In healthcare, the most dangerous mistakes happen at the extremes, when something looks mild but is actually catastrophic. That’s where clinical judgment matters most, and where AI must be stress-tested.”

Advertisement

Study limitations

The researchers acknowledged some potential limitations in the study design.

“We used physician-written clinical scenarios rather than real patient conversations, and we tested at a single point in time — these systems update frequently, so performance may change,” Ramaswamy told Fox News Digital.

CLICK HERE FOR MORE HEALTH STORIES

Additionally, most of the missed emergencies happened in situations where the danger depended on how the condition was changing over time. It’s not clear whether the same problem would happen with acute medical emergencies.

Because the system had to choose just one fixed urgency category, the test may not reflect the more nuanced advice it might give in a back-and-forth conversation, the researchers noted. 

Advertisement

ChatGPT Health is designed to show a crisis intervention banner when someone describes thoughts of self-harm. (iStock)

Also, the study wasn’t large enough to confidently detect small differences in how recommendations might vary by race or gender.

“We need continuous auditing, not one-time studies,” Castro noted. “These systems update frequently, so evaluation must be ongoing.”

‘Don’t wait’

The researchers emphasized the importance of seeking immediate care for serious issues.

CLICK HERE TO SIGN UP FOR OUR HEALTH NEWSLETTER

Advertisement

“If something feels seriously wrong — chest pain, difficulty breathing, a severe allergic reaction, thoughts of self-harm — go to the emergency department or call 988,” Ramaswamy advised. “Don’t wait for an AI to tell you it’s OK.”

The researchers noted that they support the use of AI to improve healthcare access, and that they didn’t conduct the study to “tear down the technology.”

CLICK HERE TO DOWNLOAD THE FOX NEWS APP

“These tools can be genuinely useful for the right things — understanding a diagnosis you’ve already received, looking up what your medications do and their side effects, or getting answers to questions that didn’t get fully addressed in a short doctor’s visit,” Ramaswamy said. 

“That’s a very different use case from deciding whether you need emergency care. Treat them as a complement to your doctor, not a replacement.”

Advertisement

“This study doesn’t mean we abandon AI in healthcare.”

Castro agreed that the benefits of AI health tools should be weighed against the risks.

“AI health tools can increase access, reduce unnecessary visits and empower patients with information,” he said. “They are not inherently unsafe, but they are not yet substitutes for clinical judgment.”

TEST YOURSELF WITH OUR LATEST LIFESTYLE QUIZ

“This study doesn’t mean we abandon AI in healthcare,” he went on. “It means we mature it. Independent testing and stronger guardrails will determine whether AI becomes a safety net or a liability.”

Advertisement

Related Article

ChatGPT dietary advice sends man to hospital with dangerous chemical poisoning

Health

Study reveals one simple eating habit that may help boost weight loss

Published

on

Study reveals one simple eating habit that may help boost weight loss

NEWYou can now listen to Fox News articles!

Losing weight might be as simple as sticking to the meals you know, a new study found.

People who ate the same meals more often lost more weight during a 12-week weight-loss program, according to a new study published in Health Psychology.

“Maintaining a healthy diet in today’s food environment requires constant effort and self-control,” lead author Charlotte Hagerman of the Oregon Research Institute said in a statement. 

SIMPLE WEIGHT-LOSS QUIZ MAY PINPOINT WHY SOME DIETS FAIL — AND HOW TO BOOST SUCCESS

Advertisement

“Creating routines around eating may reduce that burden and make healthy choices feel more automatic.”

Experts say maintaining muscle after 50 may require more protein than the minimum federal guideline. (iStock)

Hagerman and fellow researchers from Drexel University and the Oregon Research Institute analyzed food logs from 112 adults who were overweight or obese who tracked their meals in an app and weighed themselves daily, according to the study.

The researchers measured “routinized” eating in two main ways —how much participants’ daily calorie intake fluctuated and how often they repeated the same meals and snacks over time, according to the paper.

DOCTOR WARNS MANY AMERICANS EAT ‘FOOD-LIKE SUBSTANCES,’ NOT REAL FOOD

Advertisement

Those whose diets included more repeated foods lost an average of 5.9% of their body weight compared to 4.3% for those whose eating patterns were more varied, according to a press release from the American Psychological Association.

A man shows how much weight he has lost by holding out the waist of his jeans, symbolizing his successful diet. (iStock)

People who kept their daily calorie intake more consistent also lost more weight, according to the researchers.

Liza Baker, a Vermont-based nutrition expert and founder of Simply: Health Coaching, said the findings line up with what she has seen firsthand in more than a decade of working with clients.

Advertisement

“Removing the mental load of ‘What’s for breakfast, lunch or dinner?’ can make the wellness journey much more sustainable,” Baker told Fox News Digital.

A breakfast of oatmeal porridge with summer berries. (iStock)

She said repeat meals can reduce decision fatigue and make it easier for people to stick to healthier habits, especially when they are packing lunches, cooking at home and following a simple routine.

Baker said people do not necessarily have to repeat every meal to see benefits.

CLICK HERE FOR MORE HEALTH STORIES

Advertisement

“One can start by eating one meal that is repetitive, usually breakfast or lunch,” she said. “As results start to show, it’s then more conducive to increasing to two to three repetitive meals a day.”

At the same time, experts cautioned that the findings do not prove cause and effect. The study was observational, meaning it found an association between routine eating and greater weight loss but could not show that repetition alone caused the better results, according to the researchers.

Consistency — not variety — may be key when it comes to weight loss, researchers found. (iStock)

Baker also warned that repeat meal plans can backfire if they are not nutritionally balanced or if they trigger perfectionism.

TEST YOURSELF WITH OUR LATEST LIFESTYLE QUIZ

Advertisement

“Unless someone is well-versed in nutrition, setting up a repeat meal plan can quickly become a nutritional nightmare that leads to becoming deficient in one or more nutrients,” she said.

The study authors similarly noted that too little variety could come with trade-offs. Future research is needed to determine whether a more repetitive diet should be actively recommended as a weight-loss strategy, they said.

CLICK HERE TO DOWNLOAD THE FOX NEWS APP

Fox News Digital reached out to the study’s authors for comment.

Advertisement
Continue Reading

Health

Prayer for Weight Loss Works: How Faith Can Help You Shed Weight Faster

Published

on

Prayer for Weight Loss Works: How Faith Can Help You Shed Weight Faster


Advertisement





How Prayer for Weight Loss Can Help You Shed Pounds Faster




















Advertisement





Advertisement


Use left and right arrow keys to navigate between menu items.


Use escape to exit the menu.

Advertisement

Continue Reading

Health

Common drinking habit may quietly triple risk of advanced liver condition

Published

on

Common drinking habit may quietly triple risk of advanced liver condition

NEWYou can now listen to Fox News articles!

Even occasional binge drinking could triple the risk of a serious liver condition, a new study suggests.

Advertisement

Just one episode per month was associated with a threefold increase in advanced liver fibrosis in people with underlying metabolic liver disease, according to research from the University of Southern California (USC).

Advanced liver fibrosis is a condition that occurs in the advanced stage of chronic liver disease, marked by a buildup of significant scar tissue due to chronic, long-term inflammation, according to the American Liver Foundation.

NEARLY 40% OF CANCERS CAN BE PREVENTED WITH 3 LIFESTYLE CHANGES, STUDY FINDS

Consuming large amounts of alcohol in a short period of time is known to cause liver damage and inflammation, according to medical experts.

“Patients often ask how much they can drink,” lead investigator Brian P. Lee, MD, hepatologist and liver transplant specialist with Keck Medicine of USC, told Fox News Digital. “In the liver world, we’re used to thinking about this as an average — for example, we categorize patients based on alcohol consumption per week.”

Advertisement

Even occasional binge drinking could triple the risk of a serious liver condition, a new study suggests. (iStock)

The researchers aimed to determine whether the pattern of drinking affected the risk of liver disease, compared to the total amount consumed.

The study analyzed six years of data from the U.S. National Health and Nutrition Examination Survey (NHANES), which included more than 8,000 adults, according to the study’s press release. 

LITTLE-KNOWN PRESCRIPTION PILL IS HELPING AMERICANS DRINK LESS ALCOHOL

The researchers focused on those with metabolic dysfunction-associated steatotic liver disease (MASLD), which is a fatty liver disease linked to metabolic health problems. 

Advertisement

Most large epidemiologic studies estimate that MASLD affects about 25% to 30% of U.S. adults. The condition is associated with excess weight and obesity, as well as metabolic disorders like type 2 diabetes, high blood pressure and high cholesterol.

The researchers focused on those with metabolic dysfunction-associated steatotic liver disease (MASLD), which is a fatty liver disease linked to metabolic health problems. (iStock)

More than half of the adults in the study reported occasional heavy drinking, including nearly 16% of those with MASLD. 

Occasional heavy drinking (four or more drinks in one day for women and five or more drinks for men, at least once each month) was linked to at least triple the chance of advanced liver fibrosis, compared to the same amount spread over a longer period of time, the researchers found.

CANNABIS COMPOUNDS COULD REVERSE DISEASE AFFECTING ONE-THIRD OF ADULTS

Advertisement

“The key takeaway is that the pattern matters very much, and episodic heavy drinking is an incredibly common pattern right now among U.S. adults,” Lee said.

Younger adults and men were more likely to engage in occasional binge-drinking, the study found. The more drinks consumed during each session, the greater the liver scarring.

The findings were published in the journal Clinical Gastroenterology and Hepatology. 

Occasional heavy drinking (four or more drinks in one day for women and five or more drinks for men, at least once each month) was linked to at least triple the chance of advanced liver fibrosis, compared to the same amount spread over a longer period of time, the researchers found. (iStock)

The pattern of drinking is important, not just the average, Lee noted. “Many patients ask if they don’t drink on weekdays, whether they can drink more on weekends — like a weekly ‘quota’ — and our study is showing that the answer is no,” Lee told Fox News Digital.

Advertisement

“This pattern of episodic heavy drinking is especially bad when compared to spreading out alcohol consumption over a longer period of time.”

Potential limitations

The study did have some limitations, including that it was observational in design and could not prove that binge drinking causes advanced liver fibrosis.

CLICK HERE FOR MORE HEALTH STORIES

It also relied on the participants’ self-reported alcohol consumption, which could be subject to inaccuracies.

Additionally, the findings were primarily linked to people with MASLD and may not apply to all populations.

Advertisement

“This pattern of episodic heavy drinking is especially bad when compared to spreading out alcohol consumption over a longer period of time.”

“This was a cross-sectional study, so longitudinal studies that examine the risk of liver-related events and also potential dynamic drinking would be desirable,” Lee said.

“With more than half of adults reporting some episodic heavy drinking, this issue deserves further attention from both physicians and researchers to help better understand, prevent and treat liver disease.”

CLICK HERE TO DOWNLOAD THE FOX NEWS APP

Julian Braithwaite, CEO of the International Alliance for Responsible Drinking, said the study highlights that “how you drink matters.”

Advertisement

“Binge drinking is high-risk, even occasionally, but that’s not the same as moderate consumption, which is widely seen as lower risk,” he told Fox News Digital. “Not all drinking behaviors are equal, and individual risk matters. The focus should be on helping people avoid harmful patterns and make informed choices.”

“With more than half of adults reporting some episodic heavy drinking, this issue deserves further attention from both physicians and researchers to help better understand, prevent and treat liver disease,” the researcher said. (iStock)

Dr. Amanda Berger, senior vice president of science and research for the Distilled Spirits Council of the United States, provided the below statement to Fox News Digital. 

TEST YOURSELF WITH OUR LATEST LIFESTYLE QUIZ

“The research is clear that alcohol abuse, including excessive and binge drinking, can cause serious health problems. The Distilled Spirits Council recommends that people talk to their health providers to determine what is best for them based on individual risk factors, such as medical conditions, family history and lifestyle.”

Advertisement

“Adults who choose to drink should do so moderately, in line with the new Dietary Guidelines for Americans, which recommend adults limit alcohol beverages. The scientific report that informed these recommendations defines moderate drinking as up to one drink per day for women and up to two per day for men.”

Continue Reading

Trending