ChatGBT Passed The Medical Specialty Exam: Are Doctors With Artificial Intelligence Coming?

ChatGBT passed the medical specialty exam: Are doctors with artificial intelligence coming?

ChatGPT passed the rigorous exam to practice medicine in the USA. The researchers evaluated this success of the artificial intelligence chatbot as a milestone in medical science.

Chatbot ChatGBT passed between 52.4 percent and 75 percent in various departments in the three-part Medical Licensing Examination (USMLE) in the USA. An average of 60 percent is required to pass the exam.

TURNING POINT

Researchers from the technology company AnsibleHealth, which conducted the research, said in a statement on the subject, “Reaching the score of passing this notoriously difficult specialization exam and doing it without any human supplementation marks a remarkable milestone in the development of clinical artificial intelligence.” used expressions.

ChatGBT Passed The Medical Specialty Exam: Are Doctors With Artificial Intelligence Coming?

PASSED BUSINESS AND LEGAL EXAMS BEFORE

The results of the research were published in PLOS Digital Health, a peer-reviewed scientific journal. However, ChatGBT has been previously tested and approved in business (University of Pennsylvania’s Wharton School of Business) and law (University of Minnesota).

In the latest study, the researchers tested the software on 350 questions from the June 2022 USMLE.
Two doctors evaluated the results, and discrepancies were reviewed by a third specialist.
The exam evaluates the medical knowledge of medical students and doctors in training and has been used since 1992.

Medical students in the USA usually take the first step of the USMLE at the end of their second year of medical school, their second step in their fourth year, and their third step in their first year of residency after graduating from medical school. More than a hundred thousand students and graduates take the exam every year.

On the other hand, the researchers stressed that ChatGPT generated at least one important insight that was “new and clinically valid” for 88.9 percent of the responses.

The results also outperformed PubMedGPT, a unique artificial intelligence robot specially trained in the biomedical literature, passing 50.8 percent on an exam of USMLE-style questions.

The study’s authors noted that the research findings show that ChatGPT could become a valuable tool in medical education. “The AI ​​bot has a partial ability to teach medicine by revealing new and unclear concepts that students may not be aware of. Artificial intelligence technology is now positioned to be ubiquitous in clinical practice soon, with a variety of applications across all healthcare industries.”

ChatGBT Passed The Medical Specialty Exam: Are Doctors With Artificial Intelligence Coming?

WHAT IS CHATGBT?

Recently acquired by Microsoft, ChatGPT is a major language model that uses a variation of the GPT (Generative Pre-training Transformer) architecture to generate human-like text. The chatbot is trained on a variety of internet texts and can generate important responses to a wide variety of commands. The model can be fine-tuned for various tasks such as language translation, question answering and speaking. Created by OpenAI’s research team in the USA, ChatGBT continues to be updated according to new research and developments.

WHAT ARE THE FEATURES OF CHATGPT?

• Question answer
• Writing texts (basic academic articles, literary texts, movie script, etc.)
• solving math equations
• Debugging and fixing (for example, detecting and fixing bugs in any code block)
• interlingual translation
• Summarizing text and detecting keywords in text
• make suggestions
• classification
• Explaining what anything does (for example, explaining what a block of code does)