An Explainable Deep Learning Framework for Brain Tumor Detection Using MRI Images
DOI:
https://doi.org/10.21015/vtse.v14i1.2335Abstract
Brain tumor detection using Magnetic Resonance Imaging (MRI) is a critical diagnostic procedure that demands high interpretability, accuracy, and efficiency. This paper presents a system of brain tumor classification that is based on interpretable deep learning model. The Convolutional Neural Network (CNN) used is a customized one trained on two publicly obtained Br35H dataset along with a four-class brain tumor MRI dataset. There are four-class brain tumor, glioma, meningioma, pituitary and no tumor. Image denoising, data augmentation, and normalization are applied using the methodology to enhance robustness and generalizability in models. Gradient-weighted Class Activation Mapping (Grad-CAM) and Local Interpretable Model-agnostic Explanations (LIME) are combined to help tackle the problem of deep learning model opacities. These devices visualise class-discriminating areas and important local superpixels enhancing clinical transparency. The proposed CNN has been experimentally demonstrated to achieve about 94% and 98% accuracy on the Br35H dataset and the multiclass brain tumor MRI dataset respectively. The accuracy, recognition, and the F1-scores are comparable across classes. The results indicate that the framework is capable of capturing the features, type of tumor, and generates interpretable visual data to be relevant to the clinical world. The paper presents a full and interpretable deep learning model in the diagnosis of brain tumors acquired through MRI. It helps close the high diagnostic accuracy/reliable model explainability gap.
References
R. L. Siegel, T. B. Kratzer, A. N. Giaquinto, H. Sung, and A. Jemal, “Cancer statistics, 2025,” CA: A Cancer Journal for Clinicians, vol. 75, no. 1, p. 10, 2025.
Q. T. Ostrom, M. Price, C. Neff, G. Cioffi, K. A. Waite, C. Kruchko, and J. S. Barnholtz-Sloan, “CBTRUS statistical report: primary brain and other central nervous system tumors diagnosed in the United States in 2015–2019,” Neuro-Oncology, vol. 24, no. Suppl. 5, pp. v1–v95, 2022.
D. N. Louis, A. Perry, P. Wesseling, D. J. Brat, I. A. Cree, D. Figarella-Branger, C. Hawkins, H. K. Ng, S. M. Pfister, G. Reifenberger, et al., “The 2021 WHO classification of tumors of the central nervous system: A summary,” Neuro-Oncology, vol. 23, no. 8, pp. 1231–1251, 2021.
M. Weller, M. van den Bent, K. Hopkins, et al., “EANO guidelines on the diagnosis and treatment of adult astrocytic and oligodendroglial gliomas,” Lancet Oncology, vol. 22, no. 10, pp. e391–e406, 2021.
A. Chattopadhyay and M. Maitra, “MRI-based brain tumour image detection using CNN based deep learning method,” Neuroscience Informatics, vol. 2, no. 4, p. 100060, 2022.
D. Lamrani, B. Cherradi, O. El Gannour, M. A. Bouqentar, and L. Bahatti, “Brain tumor detection using MRI images and convolutional neural network,” International Journal of Advanced Computer Science and Applications, vol. 13, no. 7, 2022.
K. S. A. Kumar, A. Y. Prasad, and J. Metan, “A hybrid deep CNN-Cov-19-Res-Net transfer learning architecture for an enhanced brain tumor detection and classification scheme in medical image processing,” Biomedical Signal Processing and Control, vol. 76, p. 103631, 2022.
T. L. Prasanthi and N. Neelima, “Improvement of brain tumor categorization using deep learning: A comprehensive investigation and comparative analysis,” Procedia Computer Science, vol. 233, pp. 703–712, 2024.
S. Guluwadi, et al., “Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with ResNet 50,” BMC Medical Imaging, vol. 24, no. 1, pp. 1–19, 2024.
Y. H. Chel and L. L. Poh, “Brain tumor classification in MRI: Insights from LIME and Grad-CAM explainable AI techniques,” IEEE Access, 2025.
Y. Tian, “Trade-off analysis of classical machine learning and deep learning models for robust brain tumor detection: Benchmark study,” JMIR AI, vol. 4, p. e76344, 2025.
T. Berghout, “The neural frontier of future medical imaging: A review of deep learning for brain tumor detection,” Journal of Imaging, vol. 11, no. 1, p. 2, 2024.
M. Abou Ali, J. Charafeddine, F. Dornaika, and I. Arganda-Carreras, “Enhancing generalization and mitigating overfitting in deep learning for brain cancer diagnosis from MRI,” Applied Magnetic Resonance, vol. 56, no. 3, pp. 359–394, 2025.
V. Barra, “Convergence of man and machine artificial intelligence in human life,” Journal of Inclusive Methodology and Technology in Learning and Teaching, vol. 3, no. 4, 2023.
J. van der Laak, G. Litjens, and F. Ciompi, “Deep learning in histopathology: The path to the clinic,” Nature Medicine, vol. 27, no. 5, pp. 775–784, 2021.
J. Seah, Z. Brady, K. Ewert, and M. Law, “Artificial intelligence in medical imaging: Implications for patient radiation safety,” The British Journal of Radiology, vol. 94, no. 1126, p. 20210406, 2021.
R. Najjar, “Digital frontiers in healthcare: Integrating mHealth, AI, and radiology for future medical,” in A Comprehensive Overview of Telemedicine, vol. 307, 2024.
A. S. Lundervold and A. Lundervold, “An overview of deep learning in medical imaging focusing on MRI,” Zeitschrift fuer Medizinische Physik, vol. 29, no. 2, pp. 102–127, 2019.
C. Mello-Thoms and C. A. B. Mello, “Clinical applications of artificial intelligence in radiology,” The British Journal of Radiology, vol. 96, no. 1150, p. 20221031, 2023.
R. A. El Arab, M. S. Abu-Mahfouz, F. H. Abuadas, H. Alzghoul, M. Almari, A. Ghannam, and M. M. Seweid, “Bridging the gap: From AI success in clinical trials to real-world healthcare implementation—A narrative review,” Healthcare, vol. 13, no. 7, p. 701, 2025.
A. S. Tejani, Y. S. Ng, Y. Xi, and J. C. Rayan, “Understanding and mitigating bias in imaging artificial intelligence,” Radiographics, vol. 44, no. 5, p. e230067, 2024.
S. N. Saw, Y. Y. Yan, and K. H. Ng, “Current status and future directions of explainable artificial intelligence in medical imaging,” European Journal of Radiology, vol. 183, p. 111884, 2025.
E. Neri, G. Aghakhanyan, M. Zerunian, N. Gandolfo, R. Grassi, V. Miele, A. Giovagnoni, A. Laghi, and SIRM Expert Group on Artificial Intelligence, “Explainable AI in radiology: A white paper of the Italian Society of Medical and Interventional Radiology,” La Radiologia Medica, vol. 128, no. 6, pp. 755–764, 2023.
C. Sáez, P. Ferri, and J. M. García-Gómez, “Resilient artificial intelligence in health: Synthesis and research agenda toward next-generation trustworthy clinical decision support,” Journal of Medical Internet Research, vol. 26, p. e50295, 2024.
A. Rahman, M. S. Hossain, G. Muhammad, D. Kundu, T. Debnath, M. Rahman, M. S. I. Khan, P. Tiwari, and S. S. Band, “Federated learning-based AI approaches in smart healthcare: Concepts, taxonomies, challenges and open issues,” Cluster Computing, vol. 26, no. 4, pp. 2271–2311, 2023.
Y. Zhou, Y. Wu, Y. Su, J. Li, J. Cai, Y. You, J. Zhou, D. Guo, and X. Qu, “Cloud-magnetic resonance imaging system: In the era of 6G and artificial intelligence,” Magnetic Resonance Letters, vol. 5, no. 1, p. 200138, 2025.
G. Nadeem and M. I. Anis, “Ethical and regulatory consideration in AI-based medical imaging,” in AI for Medical Image Analysis: Reconciling Innovation and Ethical Considerations, pp. 265–290, 2025.
M. Y. Shakor and M. I. Khaleel, “Recent advances in big medical image data analysis through deep learning and cloud computing,” Electronics, vol. 13, no. 24, p. 4860, 2024.
M. Badawy, N. Ramadan, and H. A. Hefny, “Big data analytics in healthcare: Data sources, tools, challenges, and opportunities,” Journal of Electrical Systems and Information Technology, vol. 11, no. 1, p. 63, 2024.
N. McCarthy, A. Dahlan, T. S. Cook, N. O’Hare, M.-L. Ryan, B. St John, A. Lawlor, and K. M. Curran, “Enterprise imaging and big data: A review from a medical physics perspective,” Physica Medica, vol. 83, pp. 206–220, 2021.
T. Geroski, D. Jakovljević, and N. Filipović, “Big data in multiscale modelling: From medical image processing to personalized models,” Journal of Big Data, vol. 10, no. 1, p. 72, 2023.
R. Egala and M. V. S. Sairam, “A review on medical image analysis using deep learning,” Engineering Proceedings, vol. 66, no. 1, p. 7, 2024.
K. Memon, N. Yahya, M. Z. Yusoff, R. Remli, A.-W. M. Mustapha, H. Hashim, S. S. A. Ali, and S. Siddiqui, “Edge computing for AI-based brain MRI applications: A critical evaluation of real-time classification and segmentation,” Sensors, vol. 24, no. 21, p. 7091, 2024.
F. Mohsen, H. Ali, N. El Hajj, and Z. Shah, “Artificial intelligence-based methods for fusion of electronic health records and imaging data,” Scientific Reports, vol. 12, no. 1, p. 17981, 2022.
N. Abiwinanda, M. Hanif, S. T. Hesaputra, A. Handayani, and T. R. Mengko, “Brain tumor classification using convolutional neural network,” in World Congress on Medical Physics and Biomedical Engineering 2018, pp. 183–189, 2018.
J. Seetha and S. S. Raja, “Brain tumor classification using convolutional neural networks,” Biomedical & Pharmacology Journal, vol. 11, no. 3, p. 1457, 2018.
M. M. Zahoor, S. H. Khan, T. J. Alahmadi, T. Alsahfi, A. S. A. Mazroa, H. A. Sakr, S. Alqahtani, A. Albanyan, and B. K. Alshemaimri, “Brain tumor MRI classification using a novel deep residual and regional CNN,” Biomedicines, vol. 12, no. 7, p. 1395, 2024.
B. V. Babu, S. Srinivasan, S. K. Mathivanan, Mahalakshmi, P. Jayagopal, and G. T. Dalu, “Detection and classification of brain tumor using hybrid deep learning models,” Scientific Reports, vol. 13, no. 1, p. 23029, 2023.
M. S. Pinto, R. Paolella, T. Billiet, P. Van Dyck, P.-J. Guns, B. Jeurissen, A. Ribbens, A. J. den Dekker, and J. Sijbers, “Harmonization of brain diffusion MRI: Concepts and methods,” Frontiers in Neuroscience, vol. 14, p. 396, 2020.
M. Bento, I. Fantini, J. Park, L. Rittner, and R. Frayne, “Deep learning in large and multi-site structural brain MR imaging datasets,” Frontiers in Neuroinformatics, vol. 15, p. 805669, 2022.
S. Krishnapriya and Y. Karuna, “A survey of deep learning for MRI brain tumor segmentation methods: Trends, challenges, and future directions,” Health and Technology, vol. 13, no. 2, pp. 181–201, 2023.
A. Al Noman and A. S. M. Arif, “Brain tumor recognition from MRI using deep learning with data balancing methods and its explainability with AI,” in International Conference on Image Processing and Capsule Networks, pp. 523–538, 2023.
S. Iftikhar, N. Anjum, A. B. Siddiqui, M. U. Rehman, and N. Ramzan, “Explainable CNN for brain tumor detection and classification through XAI based key features identification,” Brain Informatics, vol. 12, no. 1, p. 10, 2025.
Asmita and P. Mittal, “From black box AI to XAI in neuro-oncology: A survey on MRI-based tumor detection,” Discover Artificial Intelligence, vol. 5, no. 1, p. 30, 2025.
S. Sarker, “Transfer learning and explainable AI for brain tumor classification: A study using MRI data from Bangladesh,” in 2024 6th International Conference on Sustainable Technologies for Industry 5.0 (STI), pp. 1–6, 2024.
Y. H. Chel and L. L. Poh, “Brain tumor classification in MRI: Insights from LIME and Grad-CAM explainable AI techniques,” IEEE Access, 2025.
T. Soewu, D. Singh, M. Rakhra, G. S. Chakraborty, and A. Singh, “Convolutional neural networks for MRI-based brain tumor classification,” in 2022 3rd International Conference on Computation, Automation and Knowledge Management (ICCAKM), pp. 1–7, 2022.
S. N. Saw, Y. Y. Yan, and K. H. Ng, “Current status and future directions of explainable artificial intelligence in medical imaging,” European Journal of Radiology, vol. 183, p. 111884, 2025.
S. Dhanalakshmi and S. Arulselvi, “Using ResNet architecture with MRI for classification of brain images,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 39, no. 1, pp. 148–158, 2025.
C. M. Kumar and J. S. Sankar, “Comparative analysis of convolutional neural networks for brain tumor detection: A study of VGG16, ResNet, Inception, and DenseNet models,” in 2024 3rd International Conference on Applied Artificial Intelligence and Computing (ICAAIC), pp. 41–46, 2024.
H. Mzoughi, I. Njeh, M. BenSlima, N. Farhat, and C. Mhiri, “Vision transformers (ViT) and deep convolutional neural network (D-CNN)-based models for MRI brain primary tumors images multi-classification supported by explainable artificial intelligence (XAI),” The Visual Computer, vol. 41, no. 4, pp. 2123–2142, 2025.
M. W. Nadeem, M. A. Al Ghamdi, M. Hussain, M. A. Khan, K. M. Khan, S. H. Almotiri, and S. A. Butt, “Brain tumor analysis empowered with deep learning: A review, taxonomy, and future challenges,” Brain Sciences, vol. 10, no. 2, p. 118, 2020.
M. Ennab and H. Mcheick, “Advancing AI interpretability in medical imaging: A comparative analysis of pixel-level interpretability and Grad-CAM models,” Machine Learning and Knowledge Extraction, vol. 7, no. 1, p. 12, 2025.
V. Hassija et al., “Interpreting black-box models: A review on explainable artificial intelligence,” Cognitive Computation, vol. 16, no. 1, pp. 45–74, 2024.
V. Chamola et al., “A review of trustworthy and explainable artificial intelligence (XAI),” IEEE Access, vol. 11, pp. 78994–79015, 2023.
S. Hossain et al., “Vision transformers, ensemble model, and transfer learning leveraging explainable AI for brain tumor detection and classification,” IEEE Journal of Biomedical and Health Informatics, vol. 28, no. 3, pp. 1261–1272, 2023.
R. Kumar, P. Singh, and A. Aggarwal, “Challenges and opportunities of deep learning in brain MRI analysis: An overview,” Artificial Intelligence in Medicine, vol. 144, p. 102679, 2023.
X. Zhou, Y. Zhang, and J. Chen, “Limitations of Grad-CAM in medical imaging and prospects for model interpretability,” Pattern Recognition Letters, vol. 178, pp. 50–62, 2025.
R. Amin et al., “Healthcare techniques through deep learning: Issues, challenges and opportunities,” IEEE Access, vol. 9, pp. 98523–98541, 2021.
S. S. Band et al., “Application of explainable artificial intelligence in medical health: A systematic review of interpretability methods,” Informatics in Medicine Unlocked, vol. 40, p. 101286, 2023.
J. Schmidt et al., “Mapping the regulatory landscape for artificial intelligence in health within the European Union,” NPJ Digital Medicine, vol. 7, no. 1, p. 229, 2024.
M. Aamir et al., “From CNNs to transformers: A review of evolving deep learning architectures for brain tumor classification,” IEEE Access, 2025.
M. Rana and M. Bhushan, “Machine learning and deep learning approach for medical image analysis: Diagnosis to detection,” Multimedia Tools and Applications, vol. 82, no. 17, pp. 26731–26769, 2023.
Y. Xu et al., “Advances in medical image segmentation: A comprehensive review of traditional, deep learning and hybrid approaches,” Bioengineering, vol. 11, no. 10, p. 1034, 2024.
A. Khalili Fakhrabadi, “A hybrid Inception-dilated-ResNet architecture for deep medical image analysis,” Scientific Reports, 2025. [Online]. Available: https://www.nature.com/articles/s41598-025-91322-3
M. M. Zahoor et al., “Brain tumor MRI classification using a novel deep residual and regional CNN,” Biomedicines, vol. 12, no. 7, p. 1395, 2024.
V. V. S. Sasank and S. Venkateswarlu, “Hybridized deep neural network using adaptive rain optimizer algorithm for multi-grade brain tumor classification of MRI images,” Digital Technologies Research and Applications, vol. 1, no. 1, pp. 13–30, 2022.
H. Zhang and K. Ogasawara, “Grad-CAM-based explainable artificial intelligence related to medical text processing,” Bioengineering, vol. 10, no. 9, p. 1070, 2023.
Edge Impulse, “AI explainability with Grad-CAM: Visualizing neural network decisions,” 2025. [Online]. Available: https://www.edgeimpulse.com/blog/ai-explainability-with-grad-cam-visualizing-neural-network-decisions
D. Minh et al., “Explainable artificial intelligence: A comprehensive review,” Artificial Intelligence Review, vol. 55, no. 5, pp. 3503–3568, 2022.
D. R. Johnson et al., “Explainable AI and deep learning for brain tumor classification: A comprehensive approach using Grad-CAM visualization,” in Proc. Int. Conf. Computer Vision and Image Processing, 2024, pp. 160–174.
I. D. Mienye, “A survey of explainable artificial intelligence in healthcare,” Artificial Intelligence in Medicine, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S2352914824001448
N. Subbarayudu et al., “Explainable MRI-based brain tumor detection using ResNet50 with Grad-CAM-driven visualization,” in Proc. 2nd Int. Conf. Intelligent Systems for Cybersecurity (ISCS), 2025, pp. 1–5.
A. Rath, “ResNet50-based deep learning model for accurate brain tumor segmentation and classification with Grad-CAM visualization,” Journal of Medical Imaging and Health Informatics, 2025.
Y. Zhang, “Challenges and opportunities in deploying deep learning models for medical imaging,” Frontiers in Materials, vol. 10, p. 1583615, 2025.
A. Khan, “Deep learning in medical imaging for disease diagnosis: Opportunities and challenges,” World Journal of Advanced Research and Reviews, vol. 25, pp. 2522–2526, 2025.
J. Wang, “Robustness and interpretability of AI models in medical imaging under domain shifts and data variability,” Radiology: Artificial Intelligence, 2025.
A. Y. Jaffar, “Combining local and global feature extraction for brain tumor classification: A vision transformer and iResNet hybrid model,” Engineering, Technology & Applied Science Research, 2024.
K. Suneetha, “Brain tumor detection using deep learning,” Journal of Theoretical and Applied Information Technology, vol. 103, no. 11, 2025.
J. Andreu-Perez, “Big data in multiscale modelling: From medical image processing to personalized models,” Journal of Big Data, vol. 10, no. 1, p. 77, 2023.
S. Hameed et al., “An explainable deep learning framework for automated classification of ocular diseases in a big data environment,” VFAST Transactions on Software Engineering, vol. 13, no. 3, pp. 258–278, 2025.
R. R. Selvaraju et al., “Grad-CAM: Visual explanations from deep networks via gradient-based localization,” in Proc. IEEE Int. Conf. Computer Vision (ICCV), 2017, pp. 618–626.
A. Chattopadhay et al., “Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks,” in Proc. IEEE Winter Conf. Applications of Computer Vision (WACV), 2018, pp. 839–847.
X. Zhou, Y. Zhang, and J. Chen, “Limitations of Grad-CAM in medical imaging and prospects for model interpretability,” Pattern Recognition Letters, vol. 178, pp. 50–62, 2025.
D. Tang et al., “Reviewing CAM-based deep explainable methods in healthcare,” Applied Sciences, vol. 14, no. 10, p. 4124, 2024.
M. T. Ribeiro, S. Singh, and C. Guestrin, “Why should I trust you? Explaining the predictions of any classifier,” in Proc. ACM SIGKDD, 2016, pp. 1135–1144.
S. Hameed et al., “Explainable AI-driven depression detection from social media using natural language processing,” Frontiers in Artificial Intelligence, vol. 8, p. 1627078, 2025.
L. A. Abraham et al., “Transparent brain tumor detection using DenseNet169 and LIME,” Scientific Reports, vol. 15, no. 1, p. 28185, 2025.
N. Ullah et al., “Enhancing explainability in brain tumor detection: A novel DeepEBTDNet model with LIME on MRI images,” International Journal of Imaging Systems and Technology, vol. 34, no. 1, 2024.
B. T. da Costa, “Explainable AI in medical applications,” Master’s thesis, Universidade de Aveiro, 2023.
B. Aldughayfiq et al., “Explainable AI for retinoblastoma diagnosis: Interpreting deep learning models with LIME and SHAP,” Diagnostics, vol. 13, no. 11, p. 1932, 2023.
A. Chakrabarty and S. Das, “Br35H brain tumor MRI dataset,” Kaggle, 2023. [Online]. Available: https://www.kaggle.com/datasets/ahmedhamada0/brain-tumor-detection
E. Afrihyiav et al., “Explainable AI in healthcare: Visualizing black-box models for better decision-making,” Unpublished manuscript, 2022.
M. W. Rahman et al., “Privacy-preserving deep learning for disease diagnosis in medical imaging: A systematic review,” IEEE Access, 2025.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC-By) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
This work is licensed under a Creative Commons Attribution License CC BY
