Artificial Intelligence-Assisted Pulmonary Nodule Diagnosis by Thoracic Surgeons: A Comparative Study on Clinical Effectiveness.
Authors
Affiliations (6)
Affiliations (6)
- Department of Thoracic and Cardiovascular Surgery, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
- Vuno Inc., Seoul, Republic of Korea.
- Department of Applied Bioengineering, Graduate School of Convergence Science and Technology, Seoul National University, Seoul, Republic of Korea.
- Department of Radiology, Brigham & Women's Hospital, Boston, Massachusetts, USA.
- Department of Computer Science, Yale School of Engineering and Applied Science, Yale University, New Haven, Connecticut, USA.
- College of Medicine, Inha University, Incheon, Republic of Korea.
Abstract
Clinician experience variability affects lung cancer detection using computed tomography. AI-based computer-aided diagnosis (CAD) systems can improve diagnostic accuracy, but their influence on thoracic surgeons with varying experience is unclear. This study aimed to evaluate the impact of CAD system on thoracic surgeons' assessment of pulmonary nodule malignancy. A multireader, crossover study included 20 thoracic surgeons (8 junior, 12 senior). Each reader interpreted 100 anonymized pulmonary nodules twice-once with CAD and once without-following a washout period. Nodules were assessed using a 10-point likelihood of malignancy (LOM) scale and a binary (benign/malignant) assessment. The CAD system demonstrated high malignancy prediction (AUROC = 0.929). CAD assistance significantly improved diagnostic accuracy across all readers (AUROC: 0.770-0.804, p = 0.0014 [BINARY]; 0.833-0.879, p < 0.001 [LOM]). Junior readers showed greater improvement (BINARY: 0.780-0.848, p < 0.001; LOM: 0.838-0.904, p < 0.001) compared with senior readers (BINARY: 0.763-0.775, p = 0.344; LOM: 0.831-0.862, p = 0.026). Specificity significantly increased with CAD (p = 0.008 overall, p < 0.001 junior readers), while sensitivity remained unchanged. Reading time slightly increased with CAD for benign cases (p < 0.05), but remained stable for malignant cases. The CAD system improved thoracic surgeons' diagnostic performance, especially junior readers, by enhancing specificity and overall accuracy. AI-based CAD systems are beneficial for reducing diagnostic variability and supporting lung nodule malignancy assessment by inexperienced thoracic surgeons.