English
Related papers

Related papers: Learning Cross-Modal Deep Representations for Mult…

200 papers

Semantic segmentation of brain tumours is a fundamental task in medical image analysis that can help clinicians in diagnosing the patient and tracking the progression of any malignant entities. Accurate segmentation of brain lesions is…

Image and Video Processing · Electrical Eng. & Systems 2023-08-29 Aditya Kasliwal , Sankarshanaa Sagaram , Laven Srivastava , Pratinav Seth , Adil Khan

This paper introduces an innovative multi-modal fusion deep learning approach to overcome the drawbacks of traditional single-modal recognition techniques. These drawbacks include incomplete information and limited diagnostic accuracy.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Xiaoyi Liu , Hongjie Qiu , Muqing Li , Zhou Yu , Yutian Yang , Yafeng Yan

Multimodal fusion frameworks, which integrate diverse medical imaging modalities (e.g., MRI, CT), have shown great potential in applications such as skin cancer detection, dementia diagnosis, and brain tumor prediction. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 J. Dhar , M. K. Pandey , D. Chakladar , M. Haghighat , A. Alavi , S. Mistry , N. Zaidi

Recent advances in machine learning and prevalence of digital medical images have opened up an opportunity to address the challenging brain tumor segmentation (BTS) task by using deep convolutional neural networks. However, different from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-10 Dingwen Zhang , Guohai Huang , Qiang Zhang , Jungong Han , Junwei Han , Yizhou Yu

Multi-modal magnetic resonance (MR) imaging provides great potential for diagnosing and analyzing brain gliomas. In clinical scenarios, common MR sequences such as T1, T2 and FLAIR can be obtained simultaneously in a single scanning…

Image and Video Processing · Electrical Eng. & Systems 2022-03-10 Ziqi Huang , Li Lin , Pujin Cheng , Linkai Peng , Xiaoying Tang

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

Magnetic Resonance Imaging (MRI) is an essential diagnostic tool in clinical settings but its utility is often hindered by noise artifacts introduced during the imaging process. Effective denoising is critical for enhancing image quality…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Zeyun Deng , Joseph Campbell

Convolutional neural networks (CNNs) have demonstrated superior performance in super-resolution (SR). However, most CNN-based SR methods neglect the different importance among feature channels or fail to take full advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Yue Lu , Yun Zhou , Zhuqing Jiang , Xiaoqiang Guo , Zixuan Yang

Traditional and deep learning-based fusion methods generated the intermediate decision map to obtain the fusion image through a series of post-processing procedures. However, the fusion results generated by these methods are easy to lose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-21 Yongsheng Zang , Dongming Zhou , Changcheng Wang , Rencan Nie , Yanbu Guo

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Current Computer-Aided Diagnosis (CAD) methods mainly depend on medical images. The clinical information, which usually needs to be considered in practical clinical diagnosis, has not been fully employed in CAD. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-11 Songxiao Yang , Xiabi Liu , Zhongshu Zheng , Wei Wang , Xiaohong Ma

Multi-modal image fusion (MMIF) integrates valuable information from different modality images into a fused one. However, the fusion of multiple visible images with different focal regions and infrared images is a unprecedented challenge in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xilai Li , Xiaosong Li , Tao Ye , Xiaoqi Cheng , Wuyang Liu , Haishu Tan

This paper proposes a novel multimodal fusion approach, aiming to produce best possible decisions by integrating information coming from multiple media. While most of the past multimodal approaches either work by projecting the features of…

Artificial Intelligence · Computer Science 2018-08-23 Valentin Vielzeuf , Alexis Lechervy , Stéphane Pateux , Frédéric Jurie

Multi-modal approaches employ data from multiple input streams such as textual and visual domains. Deep neural networks have been successfully employed for these approaches. In this paper, we present a novel multi-modal approach that fuses…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Ignazio Gallo , Alessandro Calefati , Shah Nawaz , Muhammad Kamran Janjua

Fusion-based hyperspectral image super-resolution aims to fuse low-resolution hyperspectral images (LR-HSIs) and high-resolution multispectral images (HR-MSIs) to reconstruct high spatial and high spectral resolution images. Current methods…

Image and Video Processing · Electrical Eng. & Systems 2026-03-25 Songcheng Du , Yang Zou , Zixu Wang , Xingyuan Li , Ying Li , Changjing Shang , Qiang Shen

When diagnosing the brain tumor, doctors usually make a diagnosis by observing multimodal brain images from the axial view, the coronal view and the sagittal view, respectively. And then they make a comprehensive decision to confirm the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-22 Yi Ding , Wei Zheng , Guozheng Wu , Ji Geng , Mingsheng Cao , Zhiguang Qin

Magnetic resonance (MR) imaging produces detailed images of organs and tissues with better contrast, but it suffers from a long acquisition time, which makes the image quality vulnerable to say motion artifacts. Recently, many approaches…

Image and Video Processing · Electrical Eng. & Systems 2022-02-22 Chun-Mei Feng , Huazhu Fu , Tianfei Zhou , Yong Xu , Ling Shao , David Zhang

Multi-modality imaging is widely used in clinical practice and biomedical research to gain a comprehensive understanding of an imaging subject. Currently, multi-modality imaging is accomplished by post hoc fusion of independently…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Lingting Zhu , Yizheng Chen , Lianli Liu , Lei Xing , Lequan Yu

Deploying depth estimation networks in the real world requires high-level robustness against various adverse conditions to ensure safe and reliable autonomy. For this purpose, many autonomous vehicles employ multi-modal sensor systems,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ukcheol Shin , Kyunghyun Lee , Jean Oh

Deep learning for medical image classification faces three major challenges: 1) the number of annotated medical images for training are usually small; 2) regions of interest (ROIs) are relatively small with unclear boundaries in the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Shaohua Li , Yong Liu , Xiuchao Sui , Cheng Chen , Gabriel Tjio , Daniel Shu Wei Ting , Rick Siow Mong Goh