AI LLMs notably improve diagnostic accuracy for less experienced brain MRI readers, with diminishing benefits for experts.
Key Details
- 1Study involved 12 readers (4 neuroradiologists, 4 radiology residents, 4 neurology/neurosurgery residents) analyzing 40 confirmed brain MRI cases.
- 2Readers provided initial diagnoses, then revised after receiving AI suggestions from GPT-4.1, Gemini 2.5 Pro, and DeepSeek-R1, based on their written inputs.
- 3AI assistance increased top-3 diagnostic accuracy by 19.4 percentage points for neurology/neurosurgery residents and 14.7 points for radiology residents (both statistically significant, p < 0.001).
- 4Board-certified neuroradiologists improved by only 4.4 percentage points (not statistically significant, p = 0.086).
- 5LLM model accuracy paralleled the detail and correctness of reader inputs; more experienced readers provided higher quality inputs.
Why It Matters
These results highlight that LLM-based AI tools may be especially valuable for augmenting less experienced clinicians, potentially narrowing accuracy gaps in diagnostic radiology. Targeted implementation could improve clinical support, though value for expert radiologists in routine cases remains limited.
Source
AuntMinnie
Related News
•Radiology Business
Real-World Study: Radiology AI Best in Emergency and Inpatient Settings
A commercial AI tool for intracranial aneurysm detection outperformed in inpatient and emergency settings but yielded limited benefits for outpatients in a major health system study.
•Radiology Business
New Rubric Enhances Safety of AI-Generated Radiology Summaries
Researchers developed a five-factor rubric to assess the safety and quality of AI-generated, patient-friendly radiology report summaries.
•Radiology Business
AI Model Surpasses Radiologists in Detecting Subtle Hip Fractures
A new AI model outperformed radiologists in identifying difficult-to-detect femoral neck fractures on radiographs.