TRANSFORMING BRAIN TUMOR DIAGNOSIS: VISION TRANSFORMERS COMBINED WITH ENSEMBLE TECHNIQUES

Main Article Content

Anees Tariq
Muhammad Munwar Iqbal
Sumayya Bibi
Muhammad Hassan Butt
Shabana Ramzan

Keywords

Brain Tumor (BT), MRI dataset, Computerized Tomography (CT), Machine Learning, Deep Learning, Vision Transformers

Abstract

Brain Tumor (BT) is widely recognized as one of the most prevalent illnesses worldwide, affecting approximately 24,810 people in the year 2023. Most people suffering from brain tumor disease belong to the Southeast Asian and Western Pacific regions. Medical diagnostics using artificial intelligence and deep learning models demonstrate efficacy in addressing critical health challenges in initial disease and detection of intervention of BT. In this paper, we proposed ViT along with ensemble learning models for multiclass brain tumor classification and detection. The proposed work aims to provide the novel best solution to the problem of brain tumor detection using a deep learning approach. Ensemble Learning obtained 96% accuracy and loss of 0.13 with an F1-score, precision, and recall of 0.96. The comparative result shows that Vision Transformer ViT obtained 90% accuracy and loss of 0.30 with an F1-score, precision, and recall of 0.89 on the brain tumor MRI dataset containing 7023 images, which is further divided into train and test. The promising results showcase the potential of this proposed system in early and accurate brain tumor detection. The proposed system can be used in the early detection of brain tumors.

Abstract 195 | Pdf Downloads 73

References

1. Taher, F., et al., Efficient framework for brain tumor detection using different deep learning techniques. Frontiers in Public Health, 2022. 10: p. 959667.
2. Hammami, M., S.K. Jarraya, and H. Ben-Abdallah, A comparative study of proposed moving object detection methods. Journal of Next Generation Information Technology. Volume, 2011. 2(2).
3. Haritha, D. "Comparative study on brain tumor detection techniques", in 2016 International Conference on Signal Processing, Communication, Power and Embedded System (SCOPES). 2016. IEEE.
4. Abdusalomov, A.B., M. Mukhiddinov, and T.K. Whangbo, Brain tumor detection based on deep learning approaches and magnetic resonance imaging. Cancers, 2023. 15(16): p. 4172.
5. Gore, D.V., and V. Deshpande. Comparative study of various techniques using deep Learning for brain tumor detection, in 2020 International Conference for Emerging Technology (INCET). 2020. IEEE.
6. Bhagat, P., P. Choudhary, and K.M. Singh, A comparative study for brain tumor detection in MRI images using texture features, in Sensors for health monitoring. 2019, Elsevier. p. 259-287.
7. Khaliki, M.Z. and M.S. Başarslan, Brain tumor detection from images and comparison with transfer learning methods and 3-layer CNN. Scientific Reports, 2024. 14(1): p. 2664.
8. Pooja, V., M.K. Kumar, and K. Kamalesh, Comparative analysis of segmentation techniques on MRI brain tumor images. Materials Today: Proceedings, 2021. 47: p. 109-114.
9. Akter, A., et al., Robust clinical applicable CNN and U-Net based algorithm for MRI classification and segmentation for brain tumor. Expert Systems with Applications, 2024. 238: p. 122347.
10. Thapa, A., A. Roy, and S. Chakraborty, A comparative study of various metamodeling approaches in tunnel reliability analysis. Probabilistic Engineering Mechanics, 2024. 75: p. 103553.
11. Habib, A.R.R., A comparative study of the machine learning-based energy management system for hydrogen fuel cell electric vehicles. Future Technology, 2024. 3(1): p. 13-24.
12. Meshram, P.A., S. Joshi, and D. Mahajan, Brain Tumor Detection using Swin Transformers. arXiv preprint arXiv:2305.06025, 2023.
13. Alzahrani, S.M., ConvAttenMixer: Brain tumor detection and type classification using convolutional mixer with external and self-attention mechanisms. Journal of King Saud University-Computer and Information Sciences, 2023. 35(10): p. 101810, 1319-1578.
14. Galić, I., et al., Machine Learning Empowering Personalized Medicine: A Comprehensive Review of Medical Image Analysis Methods. Electronics, 2023. 12(21): p. 4411.
15. Hussain, T. and H. Shouno, Explainable Deep Learning Approach for Multiclass Brain Magnetic Resonance Imaging Tumor Classification and Localization Using Gradient-Weighted Class Activation Mapping. Information, 2023. 14(12): p. 642.
16. Jun, E., et al., Medical transformer: Universal brain encoder for 3D MRI analysis. arXiv preprint arXiv:2104.13633, 2021.
17. Kumar, R.L., et al., Multiclass brain tumor classification using residual network and global average pooling. Multimedia Tools and Applications, 2021. 80(9): p. 13429-13438.
18. Luo, W., et al. Universal Medical Image Segmentation with Task-Specific Prompt-Guided Transformer Model. 2023. IEEE.
19. Ramakrishnan, A.B., et al., Optimizing brain tumor classification with hybrid CNN architecture: Balancing accuracy and efficiency through oneAPI optimization. Informatics in Medicine Unlocked, 2024. 44: p. 101436, 2352-9148.
20. Prathaban, K., et al., Detecting Tumor Infiltration in Diffuse Gliomas with Deep Learning. Advanced Intelligent Systems, 2023: p. 2300397.
21. Ramakrishnan, A.B., et al., Optimizing brain tumor classification with hybrid CNN architecture: Balancing accuracy and efficiency through oneAPI optimization. Informatics in Medicine Unlocked, 2023: p. 101436.
22. Tandel, G.S., et al., Multiclass magnetic resonance imaging brain tumor classification using artificial intelligence paradigm. Computers in Biology and Medicine, 2020. 122: p. 103804.
23. Zheng, Y., et al., UniVisNet: A Unified Visualization and Classification Network for accurate grading of gliomas from MRI. Computers in Biology and Medicine, 2023. 165: p. 107332.

Most read articles by the same author(s)