The editor of Downcodes learned that a recent study has sounded the alarm on the application of AI in the medical field. Researchers tested Microsoft's Bing Copilot and found serious problems with its ability to answer medical questions. The test evaluated Copilot's answers to the 10 most common medical questions and 50 popular drugs in the U.S., and the results were concerning.
A recent study sounds like an alarm, reminding us that we should not be complacent when it comes to medical advice given by AI. Researchers in Germany and Belgium have conducted a comprehensive test of Microsoft's Bing C0pilot, an engine that claims to be able to answer the 10 most common medical questions and 50 popular drug-related questions in the United States. However, 24% of the 500 answers generated were completely inconsistent with existing medical knowledge, and 3% of the answers were even more outrageous.
Picture source note: The picture is generated by AI, and the picture is authorized by the service provider Midjourney
The problem isn’t just about errors, a surprising 42% of the answers were likely to cause moderate or mild harm to the patient, and a full 22% were even likely to result in death or serious injury! Looking at this data, AI The suggestion seems to be a "high-risk" dish. Who dares to try it easily?
What's worse is that the average completeness score of these AI answers is only 77%. The worst answers are only 23% complete. In terms of accuracy, 26% of the answers are inconsistent with the reference data, and more than 3% of the answers are directly contrary to the facts. . Only 54% of the answers were consistent with scientific consensus, and 39% of the answers were contrary to scientific opinion.
The results of this study have been published in the journal "BMJ Quality & Safety". The researchers have repeatedly emphasized that despite the rise of AI technology, in the medical field, we should still rely on professional medical personnel to obtain accurate and safe drug information. After all, no one wants to be the person “fooled by AI”, right?
The research results clearly show that AI technology still needs to be further improved when it comes to medical consultation, and AI should not be relied upon for self-diagnosis or treatment. When obtaining medical advice, always seek the help of a professional physician to ensure your health and safety. The editor of Downcodes reminds you: health is no small matter!