English
Related papers

Related papers: Full Information Linked ICA: addressing missing da…

200 papers

Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yifei Chen , Shenghao Zhu , Zhaojie Fang , Chang Liu , Binfeng Zou , Yuhe Wang , Shuo Chang , Fan Jia , Feiwei Qin , Jin Fan , Yong Peng , Changmiao Wang

In Bag-of-Words (BoW) based image retrieval, the SIFT visual word has a low discriminative power, so false positive matches occur prevalently. Apart from the information loss during quantization, another cause is that the SIFT feature only…

Computer Vision and Pattern Recognition · Computer Science 2014-04-15 Liang Zheng , Shengjin Wang , Ziqiong Liu , Qi Tian

Multi-modality image fusion is a technique that combines information from different sensors or modalities, enabling the fused image to retain complementary features from each modality, such as functional highlights and texture details.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Zixiang Zhao , Haowen Bai , Jiangshe Zhang , Yulun Zhang , Kai Zhang , Shuang Xu , Dongdong Chen , Radu Timofte , Luc Van Gool

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Independent Component Analysis (ICA) is a technique for unsupervised exploration of multi-channel data widely used in observational sciences. In its classical form, ICA relies on modeling the data as a linear mixture of non-Gaussian…

Machine Learning · Statistics 2017-11-30 Pierre Ablin , Jean-François Cardoso , Alexandre Gramfort

We introduce physics-informed multimodal autoencoders (PIMA) - a variational inference framework for discovering shared information in multimodal scientific datasets representative of high-throughput testing. Individual modalities are…

Machine Learning · Computer Science 2022-02-08 Nathaniel Trask , Carianne Martinez , Kookjin Lee , Brad Boyce

Effectively leveraging multimodal data such as various images, laboratory tests and clinical information is gaining traction in a variety of AI-based medical diagnosis and prognosis tasks. Most existing multi-modal techniques only focus on…

Image and Video Processing · Electrical Eng. & Systems 2023-11-28 Yingying Fang , Shuang Wu , Sheng Zhang , Chaoyan Huang , Tieyong Zeng , Xiaodan Xing , Simon Walsh , Guang Yang

Effective feature fusion of multispectral images plays a crucial role in multi-spectral object detection. Previous studies have demonstrated the effectiveness of feature fusion using convolutional neural networks, but these methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jifeng Shen , Yifei Chen , Yue Liu , Xin Zuo , Heng Fan , Wankou Yang

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

Federated learning (FL) has been a promising approach in the field of medical imaging in recent years. A critical problem in FL, specifically in medical scenarios is to have a more accurate shared model which is robust to noisy and out-of…

Machine Learning · Computer Science 2020-08-19 Yousef Yeganeh , Azade Farshad , Nassir Navab , Shadi Albarqouni

Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingxue Huang , Xilai Li , Tianshu Tan , Xiaosong Li , Tao Ye

Independent component analysis is an unsupervised learning approach for computing the independent components (ICs) from the multivariate signals or data matrix. The ICs are evaluated based on the multiplication of the weight matrix with the…

This paper presents a tightly-coupled multi-sensor fusion algorithm termed LiDAR-inertial-camera fusion (LIC-Fusion), which efficiently fuses IMU measurements, sparse visual features, and extracted LiDAR points. In particular, the proposed…

Robotics · Computer Science 2019-11-04 Xingxing Zuo , Patrick Geneva , Woosik Lee , Yong Liu , Guoquan Huang

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

Artificial Intelligence · Computer Science 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

This study introduces a novel multimodal food recognition framework that effectively combines visual and textual modalities to enhance classification accuracy and robustness. The proposed approach employs a dynamic multimodal fusion…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Prateek Mittal , Puneet Goyal , Joohi Chauhan

Multiomics data fusion integrates diverse data modalities, ranging from transcriptomics to proteomics, to gain a comprehensive understanding of biological systems and enhance predictions on outcomes of interest related to disease phenotypes…

Quantitative Methods · Quantitative Biology 2023-08-04 Daisy Yi Ding , Xiaotao Shen , Michael Snyder , Robert Tibshirani

Mild Cognitive Impairment (MCI) serves as a prodromal stage of Alzheimer's Disease (AD), where early identification and intervention can effectively slow the progression to dementia. However, diagnosing AD remains a significant challenge in…

Artificial Intelligence · Computer Science 2025-11-07 Yutao Jin , Haowen Xiao , Junyong Zhai , Yuxiao Li , Jielei Chu , Fengmao Lv , Yuxiao Li

Multimodal Federated Learning (MFL) has emerged as a promising approach for collaboratively training multimodal models across distributed clients, particularly in healthcare domains. In the context of brain imaging analysis, modality…

Image and Video Processing · Electrical Eng. & Systems 2025-02-19 Xinpeng Wang , Rong Zhou , Han Xie , Xiaoying Tang , Lifang He , Carl Yang

Radiologists must utilize multiple modal images for tumor segmentation and diagnosis due to the limitations of medical imaging and the diversity of tumor signals. This leads to the development of multimodal learning in segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Chuyun Shen , Wenhao Li , Haoqing Chen , Xiaoling Wang , Fengping Zhu , Yuxin Li , Xiangfeng Wang , Bo Jin

Discovering materials with desirable properties in an efficient way remains a significant problem in materials science. Many studies have tackled this problem by using different sets of information available about the materials. Among them,…

Materials Science · Physics 2025-03-04 Onur Boyar , Indra Priyadarsini , Seiji Takeda , Lisa Hamada