A novel hybrid transformer-based framework (H-ConvNeXt-Swin) to classify brain tumors using MRI.
Authors
Affiliations (4)
Affiliations (4)
- Faculty of Computer Science and Engineering, Alamein International University, New Alamein City, Matrouh, Egypt, 51718. [email protected].
- Computers and Systems Department, Electronics Research Institute, Joseph Tito St, El Nozha, P.O. Box: 12622, Cairo, Cairo Governorate, Egypt. [email protected].
- Department of Computer Science and Engineering, Faculty of Computer Science and Engineering, New Mansoura University, New Mansoura, Egypt.
- Department of Electronic and Electrical Communication Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf, Egypt.
Abstract
This paper introduces a hybrid deep learning model combining ConvNeXt and Swin Transformer for classifying brain tumors from MRI scans. The ConvNeXt backbone is employed to obtain detailed local spatial features, whereas the Swin Transformer identifies hierarchical long-range dependencies, facilitating complementary feature representation. The proposed model is evaluated on a combined public MRI dataset of 7,023 images distributed across four categories: glioma, meningioma, pituitary, and no tumor. Experimental results demonstrate that the proposed hybrid architecture outperforms several state-of-the-art convolutional and transformer-based models, achieving an accuracy of 95.37% with competitive precision and F-score. Additionally, qualitative explainability assessment using attention-based visualization techniques offers insight into the model's decision-making by highlighting diagnostically significant regions. Furthermore, we evaluate the proposed H-ConvNeXt-Swin model on the unified dataset and also report source-stratified performance on each of the three constituent datasets: Figshare, SARTAJ, and Br35H. Future work will focus on validating the proposed framework on multi-center clinical datasets and extending it to more complex tasks such as tumor localization and segmentation.