Brain Tumor Segmentation using Deep Learning

Authors

  • Muhammad Sajid Air University Islamabad, Multan Campus
  • Wajeeha Yaseen Air University Islamabad, Multan Campus
  • Aman Ullah Khan Multan University of Science and Technology Multan

DOI:

https://doi.org/10.21015/vtse.v11i2.1533

Abstract

In addition to helping doctors discover and measure tumors, it also helps them develop better recovery and treatment plans. Recent MRI brain tumor segmentation algorithms have focused on U-Net design to combine high-level and low-level features for improved accuracy. Fully convolutional networks, which are also used for this purpose, are unable to successfully reconstruct the image through the decoder path because of the insufficient and low-level information from the encoder path. More effort needs to be done to optimise the low-level information flow from the encoder path to the decoder path in order to improve image reconstruction. In this study, we suggested a transfer learning residual U-Net model that combines the U-Net and VGG-16 architectures. To improve image reconstruction, VGG-16 is combined with the encoder. Additionally, a residual path in skipping connection is included to highlight key feature details while muting noisy and unnecessary feature replies.  It is trained using The Cancer Imaging Achieve (TCIA) and Brats 2018 datasets, and It makes it easier to segment small brain tumors. When compared to previous brain tumor segmentation techniques, the suggested model performs competitively.

References

M. W. Nadeem et al., “Brain tumor analysis empowered with Deep Learning: A review, taxonomy, and future challenges,” Brain Sciences, vol. 10, no. 2, p. 118, 2020. doi:10.3390/brainsci10020118

F. G. Davis et al., “Issues of diagnostic review in Brain tumor studies: From the Brain Tumor Epidemiology Consortium,” Cancer Epidemiology, Biomarkers & Prevention, vol. 17, no. 3, pp. 484–489, 2008. doi:10.1158/1055-9965.epi-07-0725 DOI: https://doi.org/10.1158/1055-9965.EPI-07-0725

L. M. DeAngelis, “Brain tumors,” New England Journal of Medicine, vol. 344, no. 2, pp. 114–123, 2001. doi:10.1056/nejm200101113440207 DOI: https://doi.org/10.1056/NEJM200101113440207

M. Havaei et al., “Brain tumor segmentation with deep neural networks,” Medical Image Analysis, vol. 35, pp. 18–31, 2017. doi:10.1016/j.media.2016.05.004 DOI: https://doi.org/10.1016/j.media.2016.05.004

Y. Wang, C. Li, T. Zhu, and J. Zhang, “Multimodal Brain Tumor Image segmentation using WRN-PPNet,” Computerized Medical Imaging and Graphics, vol. 75, pp. 56–65, 2019. doi:10.1016/j.compmedimag.2019.04.001

H. Liu, X. Shen, F. Shang, F. Ge, and F. Wang, “Cu-Net: Cascaded U-net with loss weighted sampling for Brain Tumor segmentation,” Multimodal Brain Image Analysis and Mathematical Foundations of Computational Anatomy, pp. 102–111, 2019. doi:10.1007/978-3-030-33226-6_12 DOI: https://doi.org/10.1007/978-3-030-33226-6_12

M. Zhang, G. Liu, J. Tina, and Y. Liu, “Improved U-net with multi-scale cross connection and dilated convolution for Brain tumor segmentation,” 2019 International Conference on Medical Imaging Physics and Engineering (ICMIPE), 2019. doi:10.1109/icmipe47306.2019.9098234

Y. Hu, X. Liu, X. Wen, C. Niu, and Y. Xia, “Brain tumor segmentation on multimodal MR imaging using Multi-level upsampling in Decoder,” Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, pp. 168–177, 2019. doi:10.1007/978-3-030-11726-9_15

Y. Ding, C. Li, Q. Yang, Z. Qin, and Z. Qin, “How to improve the deep residual network to segment multi-modal Brain tumor images,” IEEE Access, vol. 7, pp. 152821–152831, 2019. doi:10.1109/access.2019.2948120

L. Wang et al., “Nested dilation networks for brain tumor segmentation based on magnetic resonance imaging,” Frontiers in Neuroscience, vol. 13, 2019. doi:10.3389/fnins.2019.00285

H. Li, A. Li, and M. Wang, “A novel end-to-end brain tumor segmentation method using improved fully convolutional networks,” Computers in Biology and Medicine, vol. 108, pp. 150–160, 2019. doi:10.1016/j.compbiomed.2019.03.014

J. Zhang, Z. Jiang, J. Dong, Y. Hou, and B. Liu, “Attention gate RESU-net for automatic MRI brain tumor segmentation,” IEEE Access, vol. 8, pp. 58533–58545, 2020. doi:10.1109/access.2020.2983075

N. M. Aboelenein, P. Songhao, A. Koubaa, A. Noor, and A. Afifi, “HTTU-net: Hybrid two track U-Net for Automatic Brain Tumor Segmentation,” IEEE Access, vol. 8, pp. 101406–101415, 2020. doi:10.1109/access.2020.2998601

D. Wu, Y. Ding, M. Zhang, Q. Yang, and Z. Qin, “Multi-features refinement and aggregation for medical brain segmentation,” IEEE Access, vol. 8, pp. 57483–57496, 2020. doi:10.1109/access.2020.2981380

P. Liu, Q. Dou, Q. Wang, and P.-A. Heng, “An encoder-decoder neural network with 3D squeeze-and-excitation and deep supervision for Brain Tumor Segmentation,” IEEE Access, vol. 8, pp. 34029–34037, 2020. doi:10.1109/access.2020.2973707

C. Zhou, C. Ding, X. Wang, Z. Lu, and D. Tao, “One-pass multi-task networks with cross-task guided attention for Brain Tumor segmentation,” IEEE Transactions on Image Processing, vol. 29, pp. 4516–4529, 2020. doi:10.1109/tip.2020.2973510

K. Chatfield, K. Simonyan, A. Vedaldi, and A. Zisserman, “Return of the devil in the details: Delving deep into convolutional nets,” Proceedings of the British Machine Vision Conference 2014, 2014. doi:10.5244/c.28.6 DOI: https://doi.org/10.5244/C.28.6

S. Cui, L. Mao, J. Jiang, C. Liu, and S. Xiong, “Automatic semantic segmentation of brain gliomas from MRI images using a deep cascaded neural network,” Journal of Healthcare Engineering, vol. 2018, pp. 1–14, 2018. doi:10.1155/2018/4940593 DOI: https://doi.org/10.1155/2018/4940593

V. Rajinikanth and S. C. Satapathy, “Segmentation of ischemic stroke lesion in brain MRI based on social group optimization and Fuzzy-Tsallis entropy,” Arabian Journal for Science and Engineering, vol. 43, no. 8, pp. 4365–4378, 2018. doi:10.1007/s13369-017-3053-6 DOI: https://doi.org/10.1007/s13369-017-3053-6

G. Tabatabai et al., “Molecular diagnostics of gliomas: The clinical perspective,” Acta Neuropathologica, vol. 120, no. 5, pp. 585–592, 2010. doi:10.1007/s00401-010-0750-6 DOI: https://doi.org/10.1007/s00401-010-0750-6

R. Dwivedi, “What are model parameters and evaluation metrics used in machine learning?,” Analytics Steps, https://www.analyticssteps.com/blogs/what-are-model-parameters-and-evaluation-metrics-used-machine-learning (accessed Jun. 22, 2023).

M. Buda, A. Saha, and M. A. Mazurowski, “Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm,” Computers in Biology and Medicine, vol. 109, pp. 218–225, 2019. doi:10.1016/j.compbiomed.2019.05.002

Understanding intersection-over-union, https://calebrob.com/ml/2018/09/11/understanding-iou.html (accessed Jun. 22, 2023).

“PubMed,” National Center for Biotechnology Information, https://pubmed.ncbi.nlm.nih.gov/ (accessed Jun. 22, 2023).

Koppula P;Lei G;Zhang Y;Yan Y;Mao C;Kondiparthi L;Shi J;Liu X;Horbath A;Das M;Li W;Poyurovsky MV;Olszewski K;Gan B;, “A targetable coq-FSP1 axis drives ferroptosis- and radiation-resistance in KEAP1 inactive lung cancers,” Nature communications, https://pubmed.ncbi.nlm.nih.gov/35459868/ (accessed Jun. 22, 2023).

M. A. Naser and M. J. Deen, “Brain tumor segmentation and grading of lower-grade glioma using deep learning in MRI images,” Computers in Biology and Medicine, vol. 121, p. 103758, 2020. doi:10.1016/j.compbiomed.2020.103758

S. Pereira, A. Pinto, V. Alves, and C. A. Silva, “Brain tumor segmentation using convolutional neural networks in MRI images,” IEEE Transactions on Medical Imaging, vol. 35, no. 5, pp. 1240–1251, 2016. doi:10.1109/tmi.2016.2538465 DOI: https://doi.org/10.1109/TMI.2016.2538465

A. A. Pravitasari et al., “UNET-VGG16 with transfer learning for MRI-based brain tumor segmentation,” TELKOMNIKA (Telecommunication Computing Electronics and Control), vol. 18, no. 3, p. 1310, 2020. doi:10.12928/telkomnika.v18i3.14753

C. C. Atabansi, T. Chen, R. Cao, and X. Xu, “Transfer learning technique with VGG-16 for near-infrared facial expression recognition,” Journal of Physics: Conference Series, vol. 1873, no. 1, p. 012033, 2021. doi:10.1088/1742-6596/1873/1/012033 DOI: https://doi.org/10.1088/1742-6596/1873/1/012033

Downloads

Published

2023-06-30

How to Cite

Sajid, M., Yaseen, W., & Khan, A. U. (2023). Brain Tumor Segmentation using Deep Learning. VFAST Transactions on Software Engineering, 11(2), 113–123. https://doi.org/10.21015/vtse.v11i2.1533

Issue

Vol. 11 No. 2 (2023): April-June

Section

Articles

License

Authors who publish with this journal agree to the following terms:

  1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC-By) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).

                                      

This work is licensed under a Creative Commons Attribution  License CC BY