New York, Feb 11: Microsoft’s AI chatbot ChatGPT can score at or around the approximately 60 per cent passing threshold for the United States Medical Licensing Exam (USMLE), with responses that make coherent, internal sense and contain frequent insights, according to a study.
ChatGPT is designed to generate human-like writing by predicting upcoming word sequences. Unlike most chatbots, ChatGPT cannot search the internet. Instead, it generates text using word relationships predicted by its internal processes.
In the study, published in the open-access journal PLOS Digital Health, Tiffany Kung, Victor Tseng, and colleagues at AnsibleHealth tested ChatGPT’s performance on the USMLE.
Taken by medical students and physicians-in-training, the USMLE assesses knowledge spanning most medical disciplines, ranging from biochemistry, to diagnostic reasoning, to bioethics.