Development and Validation of a Convolutional Neural Network Framework Based on Ultrasound Imaging for Multi-Classification of Superficial Soft Tissue Masses.
Authors
Affiliations (11)
Affiliations (11)
- Department of Medical Ultrasound, The First Affiliated Hospital with Nanjing Medical University, Nanjing, Jiangsu, PR China (M.W., A.L.).
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, School of Medicine, Tongji University, Shanghai, China (Y.W., L.G.).
- MedAI Technology (Wuxi) Co., Ltd, Wuxi, Jiangsu, PR China (C.L.).
- Department of Ultrasound, Nanjing Drum Tower Hospital, Affiliated Hospital of Medical School, Nanjing University, Nanjing, Jiangsu, PR China (S.W.).
- Technical University of Munich, Munich, Bavaria, Germany (X.Z.).
- Department of Pathology, The First Affiliated Hospital with Nanjing Medical University, Nanjing, Jiangsu, PR China (H.H.).
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai 200032, China (Y.Z., H.X.).
- Department of Radiology, The First Affiliated Hospital with Nanjing Medical University, Nanjing, Jiangsu, PR China (X.Y.).
- Wuhan University of Technology, Wuhan, Hubei, PR China (R.O.).
- Department of Pathology, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China (H.F.).
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai 200032, China (Y.Z., H.X.). Electronic address: [email protected].
Abstract
Superficial soft tissue masses (STMs) represent a diagnostic dilemma in clinical practice, with ultrasound (US) being the front-line imaging modality available globally. However, the high complexity of STMs in imaging makes subjective evaluation highly dependent on experience, frequently causing inconsistent malignancy assessments. This inconsistency triggers unnecessary benign biopsies and delays treatment for malignant STMs. We developed ST-USNet, a multitask convolutional neural network framework to classify superficial STMs based on manually drawn regions of interest. This retrospective study included US images of 3168 patients (median age, 58 years; IQR, 46-68 years) with STMs from four institutions between March 2015 and October 2024. The ST-USNet was developed and validated on multi-center data. Its performance was then evaluated on a separate, independent test cohort. The diagnostic performance of ST-USNet was compared with that of radiologists using McNemar tests. The ST-USNet was composed of four sub-models (SM-1, SM-2, SM-a, and SM-b). In the validation cohort, SM-1 was trained to distinguish malignant from benign STMs (AUC: 0.984); SM-2 was to classify the malignant STM subtypes including sarcoma, lymphoma, and metastatic carcinoma (AUC: 0.932, 0.909, 0.922); SM-a was to discriminate between aggressive and indolent lymphoma (AUC: 0.951). SM-b was designed to explore the identification of metastatic carcinoma origin (thyroid, breast, respiratory, digestive, and reproductive systems) as a preliminary analysis; however, due to limited sample sizes, these results should be interpreted as exploratory. ST-USNet achieved high AUCs on the validation cohort and remained effective, albeit with slightly lower performance, on an independent test cohort. In a preliminary reader study (4 radiologists, 85 cases), ST-USNet either significantly outperformed senior radiologists (p = 0.012) or performed comparably to them (p = 0.267, 0.092, 0.332) in all classification tasks and effectively enhanced diagnostic accuracy for both junior and senior radiologists when used as an assistive tool. ST-USNet serves as an effective and practical decision support system for superficial STMs classification in clinical oncology, though multi-center prospective validation and continuous model updating are required before clinical deployment.