Computer vision models (CVMs) surpass large language models (LLMs) in accurately labeling incidental breast abnormalities on chest CT scans.
Key Details
- 1Study presented at 2024 SIIM, led by University of Wisconsin researchers.
- 2Compared Covera Health’s CVM to Qwen2 7B LLM on 17,752 chest CTs in women aged 40-72 (2015–2017).
- 3Incidental breast abnormalities present in 1–7% of chest CTs; 30% of these cases are malignant.
- 4CVM had 97.5% accuracy and 81.9% sensitivity vs. LLM’s 95.7% accuracy and 39.8% sensitivity.
- 5CVM showed higher F1 score (0.81) vs. LLM (0.54); LLM had marginally higher PPV (82% vs. 79.7%).
- 6Researchers suggest continued 'AI vs AI' testing with human adjudication could aid in real-world validation.
Why It Matters
Automated detection of incidental breast findings on chest CT could reduce missed malignancies and streamline workflow. The superior sensitivity of CVMs—validated on a large real-world dataset—underscores their potential for clinical integration in radiology AI workflows.
Source
AuntMinnie
Related News
•Radiology Business
AI-Powered Tool Streamlines CT Scan Prioritization in Emergency Departments
An AI-based CT queue system significantly reduces wait times for ED patients by prioritizing scans likely to reveal critical findings.
•Radiology Business
AI Workflow Enables General Radiologists to Match Breast Specialists in Screening
AI-powered workflow helps generalist radiologists detect breast cancer at rates comparable to specialists.
•Radiology Business
LLMs Automate Radiology Report Quality Control, Study Finds
LLM-based systems can rapidly automate radiology report quality control, saving significant manual review time.