English
Related papers

Related papers: A Fully Transformer Based Multimodal Framework for…

200 papers

Healthcare applications are inherently multimodal, benefiting greatly from the integration of diverse data sources. However, the modalities available in clinical settings can vary across different locations and patients. A key area that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mohammed Amer , Mohamed A. Suliman , Tu Bui , Nuria Garcia , Serban Georgescu

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Accurate and scalable cancer diagnosis remains a critical challenge in modern pathology, particularly for malignancies such as breast, prostate, bone, and cervical, which exhibit complex histological variability. In this study, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Faisal Ahmed

Breast cancer remains a critical global health challenge, necessitating early and accurate detection for effective treatment. This paper introduces a methodology that combines automated image augmentation selection (RandAugment) with search…

Image and Video Processing · Electrical Eng. & Systems 2023-11-21 Leon Hamnett , Mary Adewunmi , Modinat Abayomi , Kayode Raheem , Fahad Ahmed

While state-of-the-art models for breast cancer detection leverage multi-view mammograms for enhanced diagnostic accuracy, they often focus solely on visual mammography data. However, radiologists document valuable lesion descriptors that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Gil Ben-Artzi , Feras Daragma , Shahar Mahpod

Medical image segmentation is a cornerstone of computer-assisted diagnosis and treatment planning. While recent multimodal vision-language models have shown promise in enhancing semantic understanding through textual descriptions, their…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Saivan Talaei , Fatemeh Daneshfar , Abdulhady Abas Abdullah , Mustaqeem Khan

A precise assessment of the risk of breast lesions can greatly lower it and assist physicians in choosing the best course of action. To categorise breast lesions, the majority of current computer-aided systems only use characteristics from…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Muhaisin Tiyumba Nantogmah , Abdul-Barik Alhassan , Salamudeen Alhassan

Brain Tumor Segmentation (BraTS) plays a critical role in clinical diagnosis, treatment planning, and monitoring the progression of brain tumors. However, due to the variability in tumor appearance, size, and intensity across different MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Hongjun Zhu , Jiaohang Huang , Kuo Chen , Xuehui Ying , Ying Qian

Computed tomography (CT) and clinical numeric data are essential modalities for cancer evaluation, but building large-scale multimodal training datasets for developing medical foundation models remains challenging due to the structural…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Daeun Jung , Jaehyeok Jang , Sooyoung Jang , Yu Rang Park

In breast ultrasound images, precise lesion segmentation is essential for early diagnosis; however, low contrast, speckle noise, and unclear boundaries make this difficult. Even though deep learning models have demonstrated potential,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Prateek Singh , Moumita Dholey , P. K. Vinod

Breast cancer screening, primarily conducted through mammography, is often supplemented with ultrasound for women with dense breast tissue. However, existing deep learning models analyze each modality independently, missing opportunities to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-16 Yiqiu Shen , Jungkyu Park , Frank Yeung , Eliana Goldberg , Laura Heacock , Farah Shamout , Krzysztof J. Geras

Understanding the morphological structure of medical images and precisely segmenting the region of interest or abnormality is an important task that can assist in diagnosis. However, the unique properties of medical imaging make clear…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sungmin Kang , Jaeha Song , Jihie Kim

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning, where accurate boundary delineation is essential for precise lesion localization, organ identification, and quantitative assessment. In recent…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Peiting Tian , Xi Chen , Haixia Bi , Fan Li

Background: Precise breast ultrasound (BUS) segmentation supports reliable measurement, quantitative analysis, and downstream classification, yet remains difficult for small or low-contrast lesions with fuzzy margins and speckle noise. Text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Raja Mallina , Bryar Shareef

Over the past two decades, machine analysis of medical imaging has advanced rapidly, opening up significant potential for several important medical applications. As complicated diseases increase and the number of cases rises, the role of…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Fares Bougourzi , Fadi Dornaika , Cosimo Distante , Abdelmalik Taleb-Ahmed

In recent years, the integration of advanced imaging techniques and deep learning methods has significantly advanced computer-aided diagnosis (CAD) systems for breast cancer detection and classification. Transformers, which have shown great…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Mahtab Ranjbar , Mehdi Mohebbi , Mahdi Cherakhloo , Bijan Vosoughi. Vahdat

Manual segmentation of medical images (e.g., segmenting tumors in CT scans) is a high-effort task that can be accelerated with machine learning techniques. However, selecting the right segmentation approach depends on the evaluation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Seyed M. R. Modaresi , Aomar Osmani , Mohammadreza Razzazi , Abdelghani Chibani

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

We propose a novel transformer model, capable of segmenting medical images of varying modalities. Challenges posed by the fine grained nature of medical image analysis mean that the adaptation of the transformer for their analysis is still…

Image and Video Processing · Electrical Eng. & Systems 2023-01-31 Athanasios Tragakis , Chaitanya Kaul , Roderick Murray-Smith , Dirk Husmeier

Convolutional blocks have played a crucial role in advancing medical image segmentation by excelling in dense prediction tasks. However, their inability to effectively capture long-range dependencies has limited their performance.…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Siddhartha Mallick , Aayushman Ghosh , Jayanta Paul , Jaya Sil