ChatGPT's early medical tests fall short

While ChatGPT, an AI tool, has shown impressive knowledge in medicine, experts at Stanford University found that it struggled to provide relevant information when asked real-life medical questions. The model was only tested on textbook knowledge, not its ability to help doctors make faster, better decisions in real-life situations. Data scientists and clinicians are urging caution in the rollout of such tools and calling for more independent testing of their ability to reliably perform specific tasks in medicine. Most experimental uses being pursued by health systems and private companies are focused on automating documentation tasks, such as filling out medical records or summarizing instructions provided to patients when they are discharged from the hospital.