Cross-modal interactive fusion framework for preoperative histological grading of hepatocellular carcinoma.
Authors
Affiliations (10)
Affiliations (10)
- School of Automation, Guangxi University of Science and Technology, Liuzhou, Guangxi, China, Liuzhou, Guangxi, 545006, China.
- Guilin University of Aerospace Technology, No. 2, Jinji Road, Guilin, 541004, China.
- Guilin University of Aerospace Technology, Guilin, Guangxi, China, Guilin, 541004, China.
- Department of Radiology, Jiangmen Central Hospital, Jiangmen, Guangdong, China, Jiangmen, 529030, China.
- Fifth Affiliated Hospital of Sun Yat-sen University, Zhuhai, Guangdong, China, Zhuhai, 528400, China.
- Shenzhen University First Affiliated Hospital, Shenzhen, Guangdong, China, Shenzhen, Guangdong, 518000, China.
- Zhuhai People's Hospital Medical Group High-Tech Zone, Zhuhai, Guangdong, China, Zhuhai, Guangdong, 519085, China.
- Jiangmen Central Hospital, Jiangmen, Guangdong, China, Jiangmen, Guangdong, 529030, China.
- Department of Radiology, Jiangmen Central Hospital, Jiangmen,guangdong, Jiangmen, 529030, China.
- Guangxi University of Science and Technology, 2 Wenchang Road, Liuzhou, Liuzhou, Guangxi, 545006, China.
Abstract
Purpose ： Deep learning has shown great promise in medical image analysis, yet challenges remain in histological grading of hepatocellular carcinoma (HCC), particularly in effectively integrating multimodal features and enhancing model generalizability. This study aimed to develop a Cross-Modal Interactive Fusion 2 (CMIF) framework to leverage complementary information from CT and MRI for improved noninvasive HCC grading. Methods ： We proposed CMIF, which utilizes the self-supervised representational capacity of DINOv2 to combine the high-resolution anatomical details from CT with the functional and physiological features of MRI. We retrospectively enrolled 270 HCC patients with concurrent CT and MRI from four centers, and allocated them into training, internal validation, and two independent external validation cohorts. Performance of CMIF was compared against unimodal models and existing fusion approaches. Results：CMIF consistently outperformed baseline methods. In the internal validation cohort, CMIF achieved an AUC of 0.760, surpassing comparison methods (0.556-0.751). In external validation cohorts, CMIF obtained AUCs of 0.754 and 0.790, while competing methods ranged from 0.53 to 0.745. These results highlight the superior discriminative capability and robust generalizability of the proposed framework across multicenter datasets.Conclusion：The CMIF framework demonstrates significant potential for improving HCC histological grading by effectively integrating CT and MRI features. Its robust performance across independent cohorts suggests that CMIF may assist radiologists in accurate tumor differentiation and provide valuable support for individualized preoperative treatment planning.