English
Related papers

Related papers: Multimodal Multi-Head Convolutional Attention with…

200 papers

In medical images, various types of lesions often manifest significant differences in their shape and texture. Accurate medical image segmentation demands deep learning models with robust capabilities in multi-scale and boundary feature…

Image and Video Processing · Electrical Eng. & Systems 2024-08-20 Zhenhuan Zhou , Along He , Yanlin Wu , Rui Yao , Xueshuo Xie , Tao Li

Brain disorders are a major challenge to global health, causing millions of deaths each year. Accurate diagnosis of these diseases relies heavily on advanced medical imaging techniques such as Magnetic Resonance Imaging (MRI) and Computed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Xuran Zhu

Multimodal learning has gained much success in recent years. However, current multimodal fusion methods adopt the attention mechanism of Transformers to implicitly learn the underlying correlation of multimodal features. As a result, the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Thanh-Dat Truong , Christophe Bobda , Nitin Agarwal , Khoa Luu

Image super-resolution reconstruction achieves better results than traditional methods with the help of the powerful nonlinear representation ability of convolution neural network. However, some existing algorithms also have some problems,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Yuxi Cai , Huicheng Lai

This work presents a novel module, namely multi-branch concat (MBC), to process the input tensor and obtain the multi-scale feature map. The proposed MBC module brings new degrees of freedom (DoF) for the design of attention networks by…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Keke Zu , Hu Zhang , Jian Lu , Lei Zhang , Chen Xu

Medical head CT-scan imaging has been successfully combined with deep learning for medical diagnostics of head diseases and lesions[1]. State of the art classification models and algorithms for this task usually are based on 3d convolution…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Luis Leal , Marvin Castillo , Fernando Juarez , Erick Ramirez , Mildred Aspuac , Diana Letona

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

Accurate medical image segmentation allows for the precise delineation of anatomical structures and pathological regions, which is essential for treatment planning, surgical navigation, and disease monitoring. Both CNN-based and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Libin Lan , Yanxin Li , Xiaojuan Liu , Juan Zhou , Jianxun Zhang , Nannan Huang , Yudong Zhang

Attention-based beamformers have recently been shown to be effective for multi-channel speech recognition. However, they are less capable at capturing local information. In this work, we propose a 2D Conv-Attention module which combines…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Bhargav Pulugundla , Yang Gao , Brian King , Gokce Keskin , Harish Mallidi , Minhua Wu , Jasha Droppo , Roland Maas

Automatic segmentation of multi-sequence (multi-modal) cardiac MR (CMR) images plays a significant role in diagnosis and management for a variety of cardiac diseases. However, the performance of relevant algorithms is significantly affected…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Haochuan Jiang , Chengjia Wang , Agisilaos Chartsias , Sotirios A. Tsaftaris

Acquiring high-quality Positron Emission Tomography (PET) images requires administering high-dose radiotracers, which increases radiation exposure risks. Generating standard-dose PET (SPET) from low-dose PET (LPET) has become a potential…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Xiaolong Niu , Zanting Ye , Xu Han , Yanchao Huang , Hao Sun , Hubing Wu , Lijun Lu

Attention is a fundamental component of the human visual recognition system. The inclusion of attention in a convolutional neural network amplifies relevant visual features and suppresses the less important ones. Integrating attention…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Anam Hashmi , Julia Dietlmeier , Kathleen M. Curran , Noel E. O'Connor

Optical coherence tomography (OCT) is one of the non-invasive and easy-to-acquire biomarkers (the thickness of the retinal layers, which is detectable within OCT scans) being investigated to diagnose Alzheimer's disease (AD). This work aims…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Paria Jeihouni , Omid Dehzangi , Annahita Amireskandari , Ali Dabouei , Ali Rezai , Nasser M. Nasrabadi

Recently, deep convolutional neural network (CNN) have been widely used in image restoration and obtained great success. However, most of existing methods are limited to local receptive field and equal treatment of different types of…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Yucheng Hang , Qingmin Liao , Wenming Yang , Yupeng Chen , Jie Zhou

We present a tool for resolution recovery in multimodal clinical magnetic resonance imaging (MRI). Such images exhibit great variability, both biological and instrumental. This variability makes automated processing with neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Mikael Brudfors , Yael Balbastre , Parashkev Nachev , John Ashburner

The integration of multimodal medical imaging can provide complementary and comprehensive information for the diagnosis of Alzheimer's disease (AD). However, in clinical practice, since positron emission tomography (PET) is often missing,…

Computational Engineering, Finance, and Science · Computer Science 2024-12-03 Fuyou Mao , Lixin Lin , Ming Jiang , Dong Dai , Chao Yang , Hao Zhang , Yan Tang

When dealing with seismic data, diffusion models often face challenges in adequately capturing local features and expressing spatial relationships. This limitation makes it difficult for diffusion models to remove noise from complex…

Geophysics · Physics 2024-08-14 Wang Mingwei , Li Yong , Liu Yingtian , Peng Junheng , Li Huating

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Huan Zhang , Xu Zhang , Nian Cai , Jianglei Di , Yun Zhang

Deformable image registration is a fundamental requirement for medical image analysis. Recently, transformers have been widely used in deep learning-based registration methods for their ability to capture long-range dependency via…

Image and Video Processing · Electrical Eng. & Systems 2024-12-25 Mingyuan Meng , Michael Fulham , Lei Bi , Jinman Kim