The AI doctor will see you now: ChatGPT passes gold-standard US medical exam trends now
ChatGPT has passed the gold-standard exam required to practice medicine in the US - amid rising concerns A.I. could put white-collar workers out of jobs.
The artificial intelligence program scored between 52.4 and 75 percent across the three-part Medical Licensing Exam (USMLE). Each year's passing threshold is around 60 percent.
Researchers from tech company AnsibleHealth who did the study said: 'Reaching the passing score for this notoriously difficult expert exam, and doing so without any human reinforcement, marks a notable milestone in clinical AI maturation.'
It comes after DailyMail.com revealed the five professions at most risk from the AI revolution, according to experts.
ChatGPT, a new artificial intelligence (AI) system, scored at or close to the passing threshold on the United States Medical Licensing Exam (USMLE) required to practice medicine in the US
The full findings, which were made available as a preprint a few weeks ago, have now been peer-reviewed and published in the journal PLOS Digital Health.
Developed by OpenAI, ChatGPT (short for 'Chat Generative Pre-trained Transformer') is a language-based bot that can generate human-like responses.
The technology has already been put to the test and passed exams at business (University of Pennsylvania's Wharton School of Business) and law (University of Minnesota) schools.
In the latest study, researchers tested the software on 350 questions from the June 2022 USMLE.
The test assesses med students' and physicians-in-training's knowledge of most medical disciplines and has been used since 1992.
The exam includes open-ended and multiple questions. Two doctors evaluated the results and discrepancies were reviewed by a third expert.
ChatGPT also produced 'at least one significant insight' that was 'new, non-obvious, and clinically valid' for 88.9 percent of its responses.
The results exceeded the performance of PubMedGPT, a counterpart model trained exclusively on biomedical domain literature, which scored 50.8 percent on an older dataset of USMLE-style questions.
The
