HomeWinBuzzer NewsGoogle AI Outperforms Physicians in Simulated Medical Diagnostics Test

Google AI Outperforms Physicians in Simulated Medical Diagnostics Test

Google's AI doctor AMIE outperforms real doctors in diagnosis and empathy in text-based tests, research shows.


A research team has developed an AI chatbot named Articulate Medical Intelligence Explorer (AMIE) which has surpassed human primary care physicians in a test of diagnosing medical conditions and empathetic communication. In a controlled experiment shown in an accompanying paper, 20 mock patients preferred the interactions with AMIE over professional doctors across numerous case scenarios.

The Trial and Its Findings

During the experimental trials involving 20 mock patients and 20 professional primary care physicians, the participants interacted with AMIE through text-based conversations. They were unaware if they were speaking to an AI or a human. After the interactions, the participants consistently rated AMIE as more empathetic, clear, and professional. Moreover, AMIE displayed a higher accuracy rate in diagnosing medical issues. The patients' preference suggests that AI systems can be fine-tuned to provide consistently empathetic responses.

The Role of AI in Supporting Healthcare Accessibility

Google insists that despite the promising results, the intention is not to replace human doctors but to enhance the available resources, particularly for individuals who lack adequate healthcare access. Utilizing AMIE's design based on large language models capable of complex clinical dialogues, Google envisions AI as playing a pivotal role in the next-generation learning health systems, scaling world-class healthcare globally.

Articulate Medical Intelligence Explorer is an advanced large language model that engages in clinical conversations and evaluations. It operates by parsing symptoms described by the user, following up with questions, and making diagnostic predictions. However, Google has acknowledged several limitations of the research. For instance, the text-chat interface used in the trials does not truly represent the multifaceted nature of clinical practice, where in-person interactions and additional types of information play a crucial role in diagnosis and patient care.

With the ongoing development, Google stipulates that significant research is needed to ensure the safety, reliability, and privacy of such technologies before they can be confidently deployed in real-world settings. The overarching goal is to complement the healthcare system, not to replace the essential and personalized care that a human physician provides.

Growing Interest in AI within the Healthcare Industry

Last month,  announced the expansion of its healthcare AI services with the private preview of Azure AI Health Bot , aiming to transform healthcare tasks with enhanced AI capabilities.

The Azure AI Health Bot Copilot, incorporating various  such as Azure OpenAI, Azure AI Search, and Bing Custom Search, is designed to help healthcare organizations develop their custom Copilots based on Microsoft's extensive data. The aim is to optimize processes and reduce the load of repetitive tasks for medical practitioners.

Luke Jones
Luke Jones
Luke has been writing about all things tech for more than five years. He is following Microsoft closely to bring you the latest news about Windows, Office, Azure, Skype, HoloLens and all the rest of their products.

Recent News