“[As] urologists and physicians, we should all appreciate AI's potential, but also understand its current limitations,” says Roei Golan.
In this video, Roei Golan discusses future research and take-home messages based on the study, “ChatGPT’s Ability to Assess Quality and Readability of Online Medical Information: Evidence from a Cross-Sectional Study,” for which he served as the lead author. Golan is a 4th year medical student at Florida State University College of Medicine in Tallahassee, Florida.
Determining quality and readability of online medical information [has been] done. There are hundreds of papers on this. There are papers on readability in cardiology, plastic surgery, orthopedic surgery, etc. However, we were the first to determine quality and readability using AI. Anyone can rerun their studies using ChatGPT. We expect that many more publications will be published based on ChatGPT or AI's capability of determining the readability of online medical information.
It also gives way for more future studies on how we can improve artificial intelligence. The fact that it can't determine quality of online text is a little surprising, but I wouldn't fear because as I said, I think it's going to change. But that's something that should change as soon as possible, because we all know about Dr. Google and how patients go to Google for their information. Now, early studies are showing that many patients are going to ChatGPT to ask health information. So, this was the finding that physicians and urologist should be aware of, that ChatGPT may be biased in determining online health information.
We published earlier in a study in Nature Reviews Urology that AI is here, and AI is here to stay. And yes, there's negativity about it. But [as] urologists and physicians, we should all appreciate AI's potential, but also understand its current limitations. AI outputs should currently be used complementarily with human expertise, but I think it would benefit people to use it. It's powerful, it saves time and efficiency, and it's only going to get better over time. Unfortunately, people who aren't using AI will be less efficient than those who do in the future.
This transcription has been edited for clarity.