Back to all papers

Automated readings of imaging reports by natural language processing (NLP) supplemented by clinical data predict disease course in children and adults with Crohn's disease: report from the epi-IIRN.

July 30, 2026pubmed logopapers

Authors

Atia O,Kurtser G,Focht G,Sinai E,Ben-Tov A,Zacay G,Matz E,Zekaria S,Bar-Yoseph H,Badash Z,Gavrielov N,Dotan I,Hagopian T,Cytter-Kuint R,Freiman M,Turner D

Affiliations (11)

  • Shaare Zedek Medical Center, Jerusalem, Israel.
  • Faculty of Medical and Health Sciences, Tel Aviv University, Tel Aviv, Israel.
  • Schneider- Children's Medical Center.
  • Maccabi Research an Innovation Center Maccabi Healthcare Services.
  • Meuhedet Health Services.
  • Leumit Health Services, Tel Aviv, Israel.
  • Clalit Health Services, Clalit Research Institute Tel Aviv, Israel.
  • Department of Gastroenterology, Rambam Health Care Campus & Bruce Rappaport School of Medicine.
  • Technion Israel Institute of Technology, Haifa, Israel.
  • Division of Gastroenterology, Rabin Medical Center, Petah Tikva, Israel.
  • The Hebrew University of Jerusalem, Israel.

Abstract

The implementation of imaging features in administrative databases and electronic health records is limited by non-standardized free-text radiology reports. We developed a natural language processing (NLP) tool to automatically extract imaging-based variables from radiological reports and integrate them with clinical data to predict disease course in children and adults with Crohn's disease (CD). Free-text reports from Magnetic-Resonance Enterography and Computed-Tomography Enterography of patients with newly diagnosed CD were linked to clinical data from the nationwide epi-IIRN cohort and processed using Hierarchical Structured Matching Prediction BERT (HSMP-BERT), an NLP model. The primary outcome was difficult-to-treat course, defined by steroid-dependency, the need for ≥2 classes of biologics or surgery. Predictors were identified using Cox proportional hazards and Gradient Boosting Survival Analysis (GBSA) machine learning models. Among 780 newly diagnosed patients, 160 (20%) developed difficult-to-treat course. Imaging-based predictors, including stricturing/penetrating disease, disease location, disease extent and the MaRIAs score, demonstrated modest discrimination for difficult-to-treat course (0.59 [95%CI 0.53-0.65]). Clinical predictors (laboratory values, induction treatment, age, sex and perianal involvement), showed better discrimination (AUC of 0.68 [95%CI 0.64-0.73]), while combining imaging and clinical variables resulted in only marginal improvement (AUC of 0.69 [95%CI 0.64-0.74]). In GBSA, the AUC was 0.57 (0.52-0.65) for radiologic model, 0.65 (0.62-0.72) to clinical model and 0.67 (0.61-0.72) to the integration model. For surgery, the improvement was more pronounced, in both, Cox regression and GBSA. Across models, the most influential predictors were induction treatment with systemic steroids, and stricturing or penetrating disease. Automated NLP-based extraction of imaging reports linked to clinical and laboratory data enables scalable and standardized phenotyping of CD in large datasets and populations.

Topics

Journal Article

Ready to Sharpen Your Edge?

Subscribe to join 11k+ peers who rely on RadAI Slice. Get the essential weekly briefing that empowers you to navigate the future of radiology.

We respect your privacy. Unsubscribe at any time.