English
Related papers

Related papers: Completed Feature Disentanglement Learning for Mul…

200 papers

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Recently, we have witnessed impressive achievements in cancer survival analysis by integrating multimodal data, e.g., pathology images and genomic profiles. However, the heterogeneity and high dimensionality of these modalities pose…

Image and Video Processing · Electrical Eng. & Systems 2024-12-30 Huajun Zhou , Fengtao Zhou , Hao Chen

Histopathology remains the gold standard for cancer diagnosis and prognosis. With the advent of transcriptome profiling, multi-modal learning combining transcriptomics with histology offers more comprehensive information. However, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Yupei Zhang , Xiaofei Wang , Anran Liu , Lequan Yu , Chao Li

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

In the past decades, feature-learning-based 3D shape retrieval approaches have been received widespread attention in the computer graphic community. These approaches usually explored the hand-crafted distance metric or conventional distance…

Computer Vision and Pattern Recognition · Computer Science 2019-01-11 Huibing Wang , Haohao Li , Xianping Fu

Centralized training methods have shown promising results in MR image reconstruction, but privacy concerns arise when gathering data from multiple institutions. Federated learning, a distributed collaborative training scheme, can utilize…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Ruoyou Wu , Cheng Li , Juan Zou , Shanshan Wang

Disentangling anatomical and contrast information from medical images has gained attention recently, demonstrating benefits for various image analysis tasks. Current methods learn disentangled representations using either paired multi-modal…

Image and Video Processing · Electrical Eng. & Systems 2022-05-11 Lianrui Zuo , Yihao Liu , Yuan Xue , Shuo Han , Murat Bilgel , Susan M. Resnick , Jerry L. Prince , Aaron Carass

The technology of dynamic map fusion among networked vehicles has been developed to enlarge sensing ranges and improve sensing accuracies for individual vehicles. This paper proposes a federated learning (FL) based dynamic map fusion…

Machine Learning · Computer Science 2022-09-23 Zijian Zhang , Shuai Wang , Yuncong Hong , Liangkai Zhou , Qi Hao

Federated learning (FL) has attracted considerable interest in the medical domain due to its capacity to facilitate collaborative model training while maintaining data privacy. However, conventional FL methods typically necessitate multiple…

Machine Learning · Computer Science 2025-01-08 Naibo Wang , Yuchen Deng , Shichen Fan , Jianwei Yin , See-Kiong Ng

Multimodal learning typically relies on the assumption that all modalities are fully available during both the training and inference phases. However, in real-world scenarios, consistently acquiring complete multimodal data presents…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Donggeun Kim , Taesup Kim

Multimodal federated learning (FL) aims to enrich model training in FL settings where devices are collecting measurements across multiple modalities (e.g., sensors measuring pressure, motion, and other types of data). However, key…

Machine Learning · Computer Science 2024-08-21 Liangqi Yuan , Dong-Jun Han , Vishnu Pandi Chellapandi , Stanislaw H. Żak , Christopher G. Brinton

Facial Landmark Detection (FLD) in thermal imagery is critical for applications in challenging lighting conditions, but it is hampered by the lack of rich visual cues. Conventional cross-modal solutions, like feature fusion or image…

Machine Learning · Computer Science 2025-10-27 Qiyi Tong , Olivia Nocentini , Marta Lagomarsino , Kuanqi Cai , Marta Lorenzini , Arash Ajoudani

Medical foundation models (MFMs) aim to learn universal representations from multimodal medical images that can generalize effectively to diverse downstream clinical tasks. However, most existing MFMs suffer from information ambiguity that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yihang Liu , Longzhen Yang , Jiaxiong Yang , Ying Wen , Lianghua He , Heng Tao Shen

Due to the rapid advancements of sensory and computing technology, multi-modal data sources that represent the same pattern or phenomenon have attracted growing attention. As a result, finding means to explore useful information from these…

Machine Learning · Computer Science 2021-03-10 Lei Gao , Ling Guan

Accurately detecting Alzheimer's disease (AD) and predicting mini-mental state examination (MMSE) score are important tasks in elderly health by magnetic resonance imaging (MRI). Most of the previous methods on these two tasks are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-07-10 Xu Tian , Jin Liu , Hulin Kuang , Yu Sheng , Jianxin Wang , The Alzheimer's Disease Neuroimaging Initiative

Early and accurate diagnosis of parkinsonian syndromes is critical to provide appropriate care to patients and for inclusion in therapeutic trials. The red nucleus is a structure of the midbrain that plays an important role in these…

Multi-contrast MRI images provide complementary contrast information about the characteristics of anatomical structures and are commonly used in clinical practice. Recently, a multi-flip-angle (FA) and multi-echo GRE method (MULTIPLEX MRI)…

Image and Video Processing · Electrical Eng. & Systems 2021-05-19 Eric Z. Chen , Yongquan Ye , Xiao Chen , Jingyuan Lyu , Zhongqi Zhang , Yichen Hu , Terrence Chen , Jian Xu , Shanhui Sun

Federated Learning (FL) is a machine learning approach that allows multiple clients to collaboratively learn a shared model without sharing raw data. However, current FL systems provide an all-in-one solution, which can hinder the wide…

Databases · Computer Science 2023-03-16 Muhammad Jahanzeb Khan , Rui Hu , Mohammad Sadoghi , Dongfang Zhao

Brain network analysis is a useful approach to studying human brain disorders because it can distinguish patients from healthy people by detecting abnormal connections. Due to the complementary information from multiple modal neuroimages,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-22 Qiankun Zuo , Yanfei Zhu , Libin Lu , Zhi Yang , Yuhui Li , Ning Zhang