Computer vision models (CVMs) surpass large language models (LLMs) in accurately labeling incidental breast abnormalities on chest CT scans.
Key Details
- 1Study presented at 2024 SIIM, led by University of Wisconsin researchers.
- 2Compared Covera Health’s CVM to Qwen2 7B LLM on 17,752 chest CTs in women aged 40-72 (2015–2017).
- 3Incidental breast abnormalities present in 1–7% of chest CTs; 30% of these cases are malignant.
- 4CVM had 97.5% accuracy and 81.9% sensitivity vs. LLM’s 95.7% accuracy and 39.8% sensitivity.
- 5CVM showed higher F1 score (0.81) vs. LLM (0.54); LLM had marginally higher PPV (82% vs. 79.7%).
- 6Researchers suggest continued 'AI vs AI' testing with human adjudication could aid in real-world validation.
Why It Matters
Automated detection of incidental breast findings on chest CT could reduce missed malignancies and streamline workflow. The superior sensitivity of CVMs—validated on a large real-world dataset—underscores their potential for clinical integration in radiology AI workflows.
Source
AuntMinnie
Related News
•Radiology Business
Real-World Study: Radiology AI Best in Emergency and Inpatient Settings
A commercial AI tool for intracranial aneurysm detection outperformed in inpatient and emergency settings but yielded limited benefits for outpatients in a major health system study.
•Radiology Business
New Rubric Enhances Safety of AI-Generated Radiology Summaries
Researchers developed a five-factor rubric to assess the safety and quality of AI-generated, patient-friendly radiology report summaries.
•Radiology Business
Healthcare Leader Warns AI Will Dominate Diagnostic Radiology
A leading oncologist urges future radiologists to specialize in interventional procedures due to AI advances in image interpretation.