English
Related papers

Related papers: Hyper-Connected Transformer Network for Multi-Moda…

200 papers

Descriptive region features extracted by object detection networks have played an important role in the recent advancements of image captioning. However, they are still criticized for the lack of contextual information and fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Yunpeng Luo , Jiayi Ji , Xiaoshuai Sun , Liujuan Cao , Yongjian Wu , Feiyue Huang , Chia-Wen Lin , Rongrong Ji

Understanding the morphological structure of medical images and precisely segmenting the region of interest or abnormality is an important task that can assist in diagnosis. However, the unique properties of medical imaging make clear…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sungmin Kang , Jaeha Song , Jihie Kim

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segmentation, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Wentao Wang , Xi Xiao , Mingjie Liu , Qing Tian , Xuanyao Huang , Qizhen Lan , Swalpa Kumar Roy , Tianyang Wang

In oncology, Positron Emission Tomography-Computed Tomography (PET/CT) is widely used in cancer diagnosis, staging, and treatment monitoring, as it combines anatomical details from CT with functional metabolic activity and molecular marker…

Recently, deep learning methods have achieved state-of-the-art performance in many medical image segmentation tasks. Many of these are based on convolutional neural networks (CNNs). For such methods, the encoder is the key part for global…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Hao Li , Dewei Hu , Han Liu , Jiacheng Wang , Ipek Oguz

Multimodal medical imaging provides complementary information that is crucial for accurate delineation of pathology, but the development of deep learning models is limited by the scarcity of large datasets in which different modalities are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Arunkumar V , Firos V M , Senthilkumar S , Gangadharan G R

Recent advances in automated skin cancer diagnosis have yielded performance on par with board-certified dermatologists. However, these approaches formulated skin cancer diagnosis as a simple classification task, dismissing the potential…

Image and Video Processing · Electrical Eng. & Systems 2021-12-06 Jingye Chen , Jieneng Chen , Zongwei Zhou , Bin Li , Alan Yuille , Yongyi Lu

Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are often represented by…

Machine Learning · Computer Science 2022-06-29 Wanguang Yin , Youzhi Qu , Zhengming Ma , Quanying Liu

Precise segmentation of brain tumors, particularly contrast-enhancing regions visible in post-contrast MRI (areas highlighted by contrast agent injection), is crucial for accurate clinical diagnosis and treatment planning but remains…

Image and Video Processing · Electrical Eng. & Systems 2025-06-13 Minye Shao , Zeyu Wang , Haoran Duan , Yawen Huang , Bing Zhai , Shizheng Wang , Yang Long , Yefeng Zheng

For the task of change detection (CD) in remote sensing images, deep convolution neural networks (CNNs)-based methods have recently aggregated transformer modules to improve the capability of global feature extraction. However, they suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Weiming Li , Lihui Xue , Xueqian Wang , Gang Li

The multi-scale information among the whole slide images (WSIs) is essential for cancer diagnosis. Although the existing multi-scale vision Transformer has shown its effectiveness for learning multi-scale image representation, it still…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Saisai Ding , Juncheng Li , Jun Wang , Shihui Ying , Jun Shi

In the field of multimodal segmentation, the correlation between different modalities can be considered for improving the segmentation results. Considering the correlation between different MR modalities, in this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Tongxue Zhou , Su Ruan , Pierre Vera , Stéphane Canu

In many medical imaging tasks, convolutional neural networks (CNNs) efficiently extract local features hierarchically. More recently, vision transformers (ViTs) have gained popularity, using self-attention mechanisms to capture global…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Kerol Djoumessi , Samuel Ofosu Mensah , Philipp Berens

Medical image classification has developed rapidly under the impetus of the convolutional neural network (CNN). Due to the fixed size of the receptive field of the convolution kernel, it is difficult to capture the global features of…

Image and Video Processing · Electrical Eng. & Systems 2022-09-22 Xiangzuo Huo , Gang Sun , Shengwei Tian , Yan Wang , Long Yu , Jun Long , Wendong Zhang , Aolun Li

Medical images come in high resolutions. A high resolution is vital for finding malignant tissues at an early stage. Yet, this resolution presents a challenge in terms of modeling long range dependencies. Shallow transformers eliminate this…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Ahmed Taha , Yen Nhi Truong Vu , Brent Mombourquette , Thomas Paul Matthews , Jason Su , Sadanand Singh

Renal tumors, especially renal cell carcinoma (RCC), show significant heterogeneity, posing challenges for diagnosis using radiology images such as MRI, echocardiograms, and CT scans. U-Net based deep learning techniques are emerging as a…

Artificial Intelligence · Computer Science 2024-10-23 Fnu Neha , Arvind K. Bansal

Breast ultrasound imaging is a valuable tool for early breast cancer detection, but automated tumor segmentation is challenging due to inherent noise, variations in scale of lesions, and fuzzy boundaries. To address these challenges, we…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Muhammad Azeem Aslam , Asim Naveed , Nisar Ahmed

Background:Convolutional Neural Networks(CNN) and Vision Transformers(ViT) are the main techniques used in Medical image segmentation. However, CNN is limited to local contextual information, and ViT's quadratic complexity results in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Xuanyu Liu , Huiyun Yao , Jinggui Gao , Zhongyi Guo , Xue Zhang , Yulin Dong

Fluorodeoxyglucose Positron Emission Tomography (FDG-PET) combined with Computed Tomography (CT) scans are critical in oncology to the identification of solid tumours and the monitoring of their progression. However, precise and consistent…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Anissa Alloula , Daniel R McGowan , Bartłomiej W. Papież

Feature fusion plays a pivotal role in achieving high performance in vision models, yet existing attention-based fusion techniques often suffer from substantial computational overhead and implementation complexity, particularly in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Junyi Hu , Tian Bai , Fengyi Wu , Zhenming Peng , Yi Zhang