English
Related papers

Related papers: TransMed: Transformers Advance Multi-modal Medical…

200 papers

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Salman Khan , Muzammal Naseer , Munawar Hayat , Syed Waqas Zamir , Fahad Shahbaz Khan , Mubarak Shah

Accurate nuclei segmentation is an essential foundation for various applications in computational pathology, including cancer diagnosis and treatment planning. Even slight variations in nuclei representations can significantly impact these…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Zunaira Rauf , Abdul Rehman Khan , Asifullah Khan

Medical image segmentation plays an essential role in developing computer-assisted diagnosis and therapy systems, yet still faces many challenges. In the past few years, the popular encoder-decoder architectures based on CNNs (e.g., U-Net)…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Guoping Xu , Xingrong Wu , Xuan Zhang , Xinwei He

Digital pathology has advanced substantially over the last decade however tumor localization continues to be a challenging problem due to highly complex patterns and textures in the underlying tissue bed. The use of convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Shazia Akbar , Mohammad Peikari , Sherine Salama , Sharon Nofech-Mozes , Anne Martel

In this paper, we propose TransMEF, a transformer-based multi-exposure image fusion framework that uses self-supervised multi-task learning. The framework is based on an encoder-decoder network, which can be trained on large natural image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Linhao Qu , Shaolei Liu , Manning Wang , Zhijian Song

Due to its widespread applications, human action recognition is one of the most widely studied research problems in Computer Vision. Recent studies have shown that addressing it using multimodal data leads to superior performance as…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Muhammad Bilal Shaikh , Syed Mohammed Shamsul Islam , Douglas Chai , Naveed Akhtar

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Convolutional neural networks (CNN) have proven to be state of the art methods for many image classification tasks and their use is rapidly increasing in remote sensing problems. One of their major strengths is that, when enough data is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Gonzalo Mateo-García , Luis Gómez-Chova , Gustau Camps-Valls

Medical ultrasound (US) imaging has become a prominent modality for breast cancer imaging due to its ease-of-use, low-cost and safety. In the past decade, convolutional neural networks (CNNs) have emerged as the method of choice in vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Behnaz Gheflati , Hassan Rivaz

Transformers are very powerful tools for a variety of tasks across domains, from text generation to image captioning. However, transformers require substantial amounts of training data, which is often a challenge in biomedical settings,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Andrew Kean Gao

Convolutional Neural Networks (CNNs) and Transformers have been the most popular architectures for biomedical image segmentation, but both of them have limited ability to handle long-range dependencies because of inherent locality or…

Image and Video Processing · Electrical Eng. & Systems 2024-01-10 Jun Ma , Feifei Li , Bo Wang

This study introduces an AI-driven skin lesion classification algorithm built on an enhanced Transformer architecture, addressing the challenges of accuracy and robustness in medical image analysis. By integrating a multi-scale feature…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Jiacheng Hu , Yanlin Xiang , Yang Lin , Junliang Du , Hanchao Zhang , Houze Liu

Longitudinal MRI analysis is crucial for predicting disease outcomes, particularly in chronic conditions like hepatocellular carcinoma (HCC), where early detection can significantly influence treatment strategies and patient prognosis. Yet,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Jakob Nolte , Maureen M. J. Guichelaar , Donald E. Bouman , Stephanie M. van den Berg , Maryam Amir Haeri

Convolutional Neural Networks (CNNs) have been recently employed to solve problems from both the computer vision and medical image analysis fields. Despite their popularity, most approaches are only able to process 2D images while most…

Computer Vision and Pattern Recognition · Computer Science 2016-06-16 Fausto Milletari , Nassir Navab , Seyed-Ahmad Ahmadi

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Given the prevalence of 3D medical imaging technologies such as MRI and CT that are widely used in diagnosing and treating diverse diseases, 3D segmentation is one of the fundamental tasks of medical image analysis. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-10 Yuhui Zhang , Shih-Cheng Huang , Zhengping Zhou , Matthew P. Lungren , Serena Yeung

Dense prediction is a fundamental requirement for many medical vision tasks such as medical image restoration, registration, and segmentation. The most popular vision model, Convolutional Neural Networks (CNNs), has reached bottlenecks due…

Image and Video Processing · Electrical Eng. & Systems 2023-11-29 Mingyuan Meng , Yuxin Xue , Dagan Feng , Lei Bi , Jinman Kim

Breast cancer detection through mammography interpretation remains difficult because of the minimal nature of abnormalities that experts need to identify alongside the variable interpretations between readers. The potential of CNNs for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-11 Ojonugwa Oluwafemi Ejiga Peter , Daniel Emakporuena , Bamidele Dayo Tunde , Maryam Abdulkarim , Abdullahi Bn Umar

Imaging techniques such as Chest X-rays, whole slide images, and optical coherence tomography serve as the initial screening and detection for a wide variety of medical pulmonary and ophthalmic conditions respectively. This paper…

Image and Video Processing · Electrical Eng. & Systems 2024-09-04 Jutika Borah , Kumaresh Sarmah , Hidam Kumarjit Singh

Several machine learning techniques for accurate detection of skin cancer from medical images have been reported. Many of these techniques are based on pre-trained convolutional neural networks (CNNs), which enable training the models based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Aqsa Saeed Qureshi , Teemu Roos