English
Related papers

Related papers: AMIF: Authorizable Medical Image Fusion Model with…

200 papers

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

Image fusion aims to synthesize a single high-quality image from a pair of inputs captured under challenging conditions, such as differing exposure levels or focal depths. A core challenge lies in effectively handling disparities in dynamic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Mingwei Tang , Jiahao Nie , Guang Yang , Ziqing Cui , Jie Li

In multi-view medical diagnosis, deep learning-based models often fuse information from different imaging perspectives to improve diagnostic performance. However, existing approaches are prone to overfitting and rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jingyu Guo , Christos Matsoukas , Fredrik Strand , Kevin Smith

Multimodal pathological images are usually in clinical diagnosis, but computer vision-based multimodal image-assisted diagnosis faces challenges with modality fusion, especially in the absence of expert-annotated data. To achieve the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Qinghua Lin , Guang-Hai Liu , Zuoyong Li , Yang Li , Yuting Jiang , Xiang Wu

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Multi-modal medical images provide complementary soft-tissue characteristics that aid in the screening and diagnosis of diseases. However, limited scanning time, image corruption and various imaging protocols often result in incomplete…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yue Zhang , Chengtao Peng , Qiuli Wang , Dan Song , Kaiyan Li , S. Kevin Zhou

Existing multi-modal approaches primarily focus on enhancing multi-label skin lesion classification performance through advanced fusion modules, often neglecting the associated rise in parameters. In clinical settings, both clinical and…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Peng Tang , Tobias Lasser

Multimodal clinical prediction is widely used to integrate heterogeneous data such as Electronic Health Records (EHR) and biosignals. However, existing methods tend to rely on static modality integration schemes and simple fusion…

Machine Learning · Computer Science 2026-01-16 Jongseok Kim , Seongae Kang , Jonghwan Shin , Yuhan Lee , Ohyun Jo

Autonomous Vehicles (AVs) increasingly depend on Multi-Sensor Fusion (MSF) to combine complementary modalities such as cameras and LiDAR for robust perception. While this redundancy is intended to safeguard against single-sensor failures,…

Cryptography and Security · Computer Science 2026-04-24 Shahriar Rahman Khan , Raiful Hasan

In remote sensing, each sensor can provide complementary or reinforcing information. It is valuable to fuse outputs from multiple sensors to boost overall performance. Previous supervised fusion methods often require accurate labels for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Xiaoxiao Du , Alina Zare

Multi-focus image fusion (MFIF) addresses the depth-of-field (DOF) limitations of optical lenses, where only objects within a specific range appear sharp. Although traditional and deep learning methods have advanced the field, challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Luca Piano , Peng Huanwen , Radu Ciprian Bilcu

As an influential information fusion and low-level vision technique, image fusion integrates complementary information from source images to yield an informative fused image. A few attempts have been made in recent years to jointly realize…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yuchan Jie , Yushen Xu , Xiaosong Li , Fuqiang Zhou , Jianming Lv , Huafeng Li

Biometric systems strive to balance security and usability. The use of multi-biometric systems combining multiple biometric modalities is usually recommended for high-security applications. However, the presentation of multiple biometric…

Cryptography and Security · Computer Science 2025-04-01 Florian Bayer , Christian Rathgeb

In clinical practice, tri-modal medical image fusion, compared to the existing dual-modal technique, can provide a more comprehensive view of the lesions, aiding physicians in evaluating the disease's shape, location, and biological…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yushen Xu , Xiaosong Li , Yuchan Jie , Haishu Tan

In clinical practice, full imaging is not always feasible, often due to complex acquisition protocols, stringent privacy regulations, or specific clinical needs. However, missing MR modalities pose significant challenges for tasks like…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Aghiles Kebaili , Jérôme Lapuyade-Lahorgue , Pierre Vera , Su Ruan

Image fusion aims to integrate comprehensive information from images acquired through multiple sources. However, images captured by diverse sensors often encounter various degradations that can negatively affect fusion quality. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xingxin Xu , Bing Cao , Dongdong Li , Qinghua Hu , Pengfei Zhu

Fusing multi-modal data can improve the performance of deep learning models. However, missing modalities are common for medical data due to patients' specificity, which is detrimental to the performance of multi-modal models in…

Image and Video Processing · Electrical Eng. & Systems 2023-09-28 Muyu Wang , Shiyu Fan , Yichen Li , Hui Chen

With the increasing maturity of the text-to-image and image-to-image generative models, AI-generated images (AGIs) have shown great application potential in advertisement, entertainment, education, social media, etc. Although remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Tianwei Zhou , Songbai Tan , Wei Zhou , Yu Luo , Yuan-Gen Wang , Guanghui Yue

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Multi-modal fusion approaches aim to integrate information from different data sources. Unlike natural datasets, such as in audio-visual applications, where samples consist of "paired" modalities, data in healthcare is often collected…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Nasir Hayat , Krzysztof J. Geras , Farah E. Shamout