Skip to main content

Chatbot Responses to Top Cancer Questions Accurate but Have Limitations

Medically reviewed by Drugs.com.

By Lori Solomon HealthDay Reporter

MONDAY, Aug. 28, 2023 -- Artificial intelligence (AI) chatbots generally produce accurate information for the top cancer-related web searches, according to a report published online Aug. 24 in JAMA Oncology.

Alexander Pan, from State University of New York Downstate Health Sciences University in Brooklyn, and colleagues assessed the quality of information and presence of misinformation about cancers generated by four AI chatbots. The analysis included 100 text responses to the five most commonly searched queries (Google Trends) related to the five most common cancers (skin, lung, breast, colorectal, and prostate).

The researchers found that the quality of text responses generated by the four AI chatbots was good (median DISCERN score of 5), and no misinformation was identified. Understandability was rated as moderate using the Patient Education Materials Assessment Tool (median understandability score, 66.7 percent), while actionability was poor (median actionability score, 20.0 percent). Based on the Flesch-Kincaid Grade Level score, the responses were written at the college level.

"These limitations suggest that AI chatbots should be used supplementarily and not as a primary source for medical information," the authors write.

Abstract/Full Text (subscription or payment may be required)

Disclaimer: Statistical data in medical articles provide general trends and do not pertain to individuals. Individual factors can vary greatly. Always seek personalized medical advice for individual healthcare decisions.

© 2024 HealthDay. All rights reserved.

Posted August 2023

Read this next

BMI Cutoff of 30 for Obesity May Be Too High for Middle-Aged, Older Adults

FRIDAY, May 31, 2024 -- The optimal body mass index (BMI) cutoff point appears to be 27 kg/m2 for detecting obesity in middle-aged and older adults, according to a study presented...

Emergency Inguinal Hernia Surgery Rates Increased With Lower Country Income

FRIDAY, May 31, 2024 -- For patients undergoing inguinal hernia surgery, emergency surgery rates increase from high- to low-income countries, according to a study published online...

Maternal Serum Alpha-Fetoprotein Levels Higher in Black Than White Women

FRIDAY, May 31, 2024 -- Maternal serum alpha-fetoprotein (AFP) levels are higher in Black than White pregnant women, supporting the use of accounting for these differences in...

More news resources

Subscribe to our newsletter

Whatever your topic of interest, subscribe to our newsletters to get the best of Drugs.com in your inbox.