Validation of an artificial intelligence-based automated PRAGMA and mucus plugging algorithm in pediatric cystic fibrosis.
Authors
Affiliations (8)
Affiliations (8)
- Department of Pediatric Pulmonology and Allergology, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Department of Radiology and Nuclear Medicine, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands. Electronic address: [email protected].
- Department of Pediatric Pulmonology and Allergology, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Department of Radiology and Nuclear Medicine, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands.
- Department of Pediatric Pulmonology and Allergology, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands.
- Department of Biostatistics, Erasmus MC, Rotterdam, The Netherlands; Department of Epidemiology, Erasmus MC, Rotterdam, The Netherlands.
- Department of Pediatric Pulmonology and Allergology, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Department of Radiology and Nuclear Medicine, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Department of Radiology, University of Cagliari, Italy.
- Thirona B.V., Nijmegen, Netherlands.
- Child Health Research Centre, University of Queensland, South Brisbane, Queensland, Australia.
- Department of Pediatric Pulmonology and Allergology, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Department of Radiology and Nuclear Medicine, Erasmus MC -Sophia Children's Hospital, Rotterdam, The Netherlands; Thirona B.V., Nijmegen, Netherlands.
Abstract
PRAGMA-CF is a clinically validated visual chest CT scoring method, quantifying relevant components of structural airway damage in CF. We aimed to validate a newly developed AI-based automated PRAGMA-AI and Mucus Plugging algorithm using the visual PRAGMA-CF as reference. The study included 363 retrospective chest CT's of 178 CF patients (100 New-Zealand and Australian, 78 Dutch) with at least one inspiratory CT matching the image selection criteria. Eligible CT scans were analyzed using visual PRAGMA-CF, automated PRAGMA-AI and Mucus Plugging algorithm. Outcomes were compared using descriptive statistics, correlation, intra- and interclass correlation and Bland-Altman plots. Sensitivity analyses evaluated the impact of disease severity, study cohort, number of slices and convolution kernel (soft vs. hard). The algorithm successfully analyzed 353 (97 %) CT scans. A strong correlation between the methods was found for %bronchiectasis ( %BE) and %disease ( %DIS), but weak for %Airway wall thickening ( %AWT). The automated Mucus plugging outcomes showed strong correlation with visual %mucus plugging ( %MP). ICC's between visual and automated sub-scores witnessed average agreement for %BE and %DIS, except for %AWT which was weak. Sensitivity analyses revealed that convolution kernel did not affect the correlation between visual and automated outcomes, but harder kernels yielded lower disease scores, especially for %BE and %AWT. Our results show that AI-derived outcomes are not identical to visual PRAGMA-CF scores in size, but strongly correlated on measures of bronchiectasis, bronchial-disease and mucus plugging. They could therefore be a promising alternative for time-consuming visual scoring, especially in larger studies.