ChatGPT-4 demonstrates near-perfect accuracy in classifying pancreatic cysts on MRI and CT, matching radiologist performance.
Key Details
- 1Study from Memorial Sloan Kettering used ChatGPT-4 to evaluate 3,198 MRI and CT scans of 991 adults under surveillance for pancreatic cysts.
- 2ChatGPT-4 was assessed on its ability to identify nine variables crucial for monitoring cyst progression.
- 3LLM accuracy for categorical variables ranged from 97% (solid component lesions) to 99% (calcific lesions).
- 4Accuracy for continuous variables ranged from 92% (cyst size) to 97% (main pancreatic duct size).
- 5ChatGPT-4's performance was found to be equivalent to manual radiologist chart review, which is the clinical gold standard.
- 6Authors note limitation: only one AI model was tested; further research is needed.
Why It Matters

Source
AuntMinnie
Related News

Real-World Study: Radiology AI Best in Emergency and Inpatient Settings
A commercial AI tool for intracranial aneurysm detection outperformed in inpatient and emergency settings but yielded limited benefits for outpatients in a major health system study.

New Rubric Enhances Safety of AI-Generated Radiology Summaries
Researchers developed a five-factor rubric to assess the safety and quality of AI-generated, patient-friendly radiology report summaries.

Healthcare Leader Warns AI Will Dominate Diagnostic Radiology
A leading oncologist urges future radiologists to specialize in interventional procedures due to AI advances in image interpretation.