Radiologists' expertise and LLM model confidence independently affect diagnostic collaboration when using AI for chest imaging.
Key Details
- 1Study involved 10 readers evaluating 100 chest imaging cases (x-ray, CT, MRI, PET) with LLM support.
- 2High-accuracy LLM (text input, GPT-5) achieved 76% accuracy; low-accuracy LLM (vision input, GPT-4o) achieved 27% accuracy.
- 3Model confidence (OR 3.82, p=0.003) and reader expertise (OR 2.06, p<0.001) significantly improved reader-LLM interaction.
- 4High-quality LLM rationales lowered rejection of correct advice (OR 0.79, p=0.005) but raised acceptance of incorrect advice (OR 1.71, p<0.001).
- 5Expertise reduced susceptibility to incorrect suggestions (OR 0.54, p<0.001).
Why It Matters
Understanding the interplay between model confidence, rationale quality, and user expertise is crucial for optimizing LLM-assisted diagnostics in radiology. The study highlights the double-edged nature of LLM 'explanations' and the continuing importance of radiologist training to mitigate overreliance on AI.
Source
AuntMinnie
Related News
•Radiology Business
FDA Clears AIRS Medical AI for Rapid MRI Body Composition Analysis
AIRS Medical's SwiftSight Body Composition AI software receives FDA 510(k) clearance for automated MRI-based body composition reporting.
•Radiology Business
Multi-Vendor AI Adoption Delivers Efficiency Gains in Private Radiology
A large-scale European study shows that adopting multiple AI tools in private radiology practices leads to significant efficiency improvements.
•AuntMinnie
Integrating AI Seamlessly Into Radiology Workflows for Clinical Impact
Kelly Londy of GE HealthCare highlights the importance of integrating AI seamlessly in radiology workflows to unlock its full clinical value.