English

Fine-tuned Transformer Models for Breast Cancer Detection and Classification

Image and Video Processing 2026-01-26 v2

Abstract

Breast cancer is still the second top cause of cancer deaths worldwide and this emphasizes the importance of necessary steps for early detection. Traditional diagnostic methods, such as mammography, ultrasound, and thermography, which have limitations when it comes to catching subtle patterns and reducing false positives. New technologies like artificial intelligence (AI) and deep learning have brought about the revolution in medical imaging analysis. Nevertheless, typical architectures such as Convolutional Neural Networks (CNNs) often have problems with modeling long-range dependencies. It explores the application of visual transformer models (here: Swin Tiny, DeiT, BEiT, ViT, and YOLOv8) for breast cancer detection through a collection of mammographic image sets. The ViT model reached the highest accuracy of 99.32% which showed its superiority in detecting global patterns as well as subtle image features. Data augmenting approaches, such as resizing croppings, flippings, and normalization, were further applied to the model for achieving higher performance. Although there were interesting results, the issues of dataset diversity and model optimization which present new avenues of research are also still present. Through this study, the crystal potential of transformer-based AI models in changing the detecting process of breast cancer and, thus, to patients health, is suggested.

Keywords

Cite

@article{arxiv.2512.02091,
  title  = {Fine-tuned Transformer Models for Breast Cancer Detection and Classification},
  author = {Showkat Osman and Md. Tajwar Munim Turzo and Maher Ali Rusho and Md. Makid Haider and Sazzadul Islam Sajin and Ayatullah Hasnat Behesti and Ahmed Faizul Haque Dhrubo and Md. Khurshid Jahan and Mohammad Abdul Qayum},
  journal= {arXiv preprint arXiv:2512.02091},
  year   = {2026}
}

Comments

This paper contains 12 pages with 4 figures and 3 tables. This Paper is already accepted in IEEE Computational Intelligence Magazine (CIM)