English
Related papers

Related papers: Federated Pseudo Modality Generation for Incomplet…

200 papers

Federated learning has emerged as a promising approach for training machine learning models on decentralized data sources while preserving data privacy. However, challenges such as communication bottlenecks, heterogeneity of client devices,…

Machine Learning · Computer Science 2023-12-27 Anna Vettoruzzo , Mohamed-Rafik Bouguelia , Thorsteinn Rögnvaldsson

Semi-supervised learning (SSL) has become a promising direction for medical image segmentation, enabling models to learn from limited labeled data alongside abundant unlabeled samples. However, existing SSL approaches for multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Tien-Dat Chung , Ba-Thinh Lam , Thanh-Huy Nguyen , Thien Nguyen , Nguyen Lan Vi Vu , Hoang-Loc Cao , Phat Kim Huynh , Min Xu

Leveraging multimodal information from Magnetic Resonance Imaging (MRI) plays a vital role in lesion segmentation, especially for brain tumors. However, in clinical practice, multimodal MRI data are often incomplete, making it challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yulong Zou , Bo Liu , Cun-Jing Zheng , Yuan-ming Geng , Siyue Li , Qiankun Zuo , Shuihua Wang , Yudong Zhang , Jin Hong

Learning modality-fused representations and processing unaligned multimodal sequences are meaningful and challenging in multimodal emotion recognition. Existing approaches use directional pairwise attention or a message hub to fuse…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ziwang Fu , Feng Liu , Hanyang Wang , Siyuan Shen , Jiahao Zhang , Jiayin Qi , Xiangling Fu , Aimin Zhou

Deep learning-based fault diagnosis (FD) approaches require a large amount of training data, which are difficult to obtain since they are located across different entities. Federated learning (FL) enables multiple clients to collaboratively…

Machine Learning · Computer Science 2023-10-16 Jixuan Cui , Jun Li , Zhen Mei , Kang Wei , Sha Wei , Ming Ding , Wen Chen , Song Guo

We propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality.…

Optimization and Control · Mathematics 2025-01-13 Geunyeong Byeon , Minseok Ryu , Zichao Wendy Di , Kibaek Kim

In the era of big data, data mining has become indispensable for uncovering hidden patterns and insights from vast and complex datasets. The integration of multimodal data sources further enhances its potential. Multimodal Federated…

Machine Learning · Computer Science 2025-08-22 Lishan Yang , Wei Emma Zhang , Quan Z. Sheng , Lina Yao , Weitong Chen , Ali Shakeri

As a promising privacy-preserving machine learning method, Federated Learning (FL) enables global model training across clients without compromising their confidential local data. However, existing FL methods suffer from the problem of low…

Machine Learning · Computer Science 2022-08-23 Ming Hu , Zhihao Yue , Zhiwei Ling , Xian Wei , Mingsong Chen

With the increasing amount of multimedia data on modern mobile systems and IoT infrastructures, harnessing these rich multimodal data without breaching user privacy becomes a critical issue. Federated learning (FL) serves as a…

Machine Learning · Computer Science 2023-05-09 Qiying Yu , Yang Liu , Yimu Wang , Ke Xu , Jingjing Liu

Federated graph learning (FGL) enables multiple clients to collaboratively train powerful graph neural networks without sharing their private, decentralized graph data. Inherited from generic federated learning, FGL is critically challenged…

Machine Learning · Computer Science 2025-08-15 Xinrui Li , Qilin Fan , Tianfu Wang , Kaiwen Wei , Ke Yu , Xu Zhang

Personalization methods in federated learning aim to balance the benefits of federated and local training for data availability, communication cost, and robustness to client heterogeneity. Approaches that require clients to communicate all…

Machine Learning · Computer Science 2022-04-28 Karan Singhal , Hakim Sidahmed , Zachary Garrett , Shanshan Wu , Keith Rush , Sushant Prakash

In Federated Learning, we aim to train models across multiple computing units (users), while users can only communicate with a common central server, without exchanging their data samples. This mechanism exploits the computational power of…

Machine Learning · Computer Science 2020-10-26 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Federated learning (FL) enables the collaborative training of deep neural networks across decentralized data archives (i.e., clients) without sharing the local data of the clients. Most of the existing FL methods assume that the data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Barış Büyüktaş , Gencer Sumbul , Begüm Demir

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

Machine Learning · Computer Science 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

As a vital aspect of affective computing, Multimodal Emotion Recognition has been an active research area in the multimedia community. Despite recent progress, this field still confronts two major challenges in real-world applications: 1)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Chengxin Chen , Pengyuan Zhang

Multimodal data plays a critical role in web-based recommendation systems, where information from diverse modalities such as vision and text enhances representation learning. However, real-world multimodal datasets often suffer from…

Information Retrieval · Computer Science 2026-05-04 Yuan Li , Jun Hu , Jiaxin Jiang , Bryan Hooi , Bingsheng He

Zero-shot MRI reconstruction relies on generative priors, but single-modality unconditional priors produce hallucinations under severe ill-posedness. In many clinical workflows, complementary MRI acquisitions (e.g. high-quality structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Seunghoi Kim , Chen Jin , Henry F. J. Tregidgo , Matteo Figini , Daniel C. Alexander

Personalized Federated Learning (PFL) which collaboratively trains a federated model while considering local clients under privacy constraints has attracted much attention. Despite its popularity, it has been observed that existing PFL…

Machine Learning · Computer Science 2022-12-05 Tianchun Wang , Wei Cheng , Dongsheng Luo , Wenchao Yu , Jingchao Ni , Liang Tong , Haifeng Chen , Xiang Zhang

Multimodal physiological signals, such as EEG, ECG, EOG, and EMG, are crucial for healthcare and brain-computer interfaces. While existing methods rely on specialized architectures and dataset-specific fusion strategies, they struggle to…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Wei-Bang Jiang , Xi Fu , Yi Ding , Cuntai Guan

One underlying assumption of recent federated learning (FL) paradigms is that all local models usually share the same network architecture and size, which becomes impractical for devices with different hardware resources. A scalable…

Machine Learning · Computer Science 2022-05-27 Dezhong Yao , Wanning Pan , Michael J O'Neill , Yutong Dai , Yao Wan , Hai Jin , Lichao Sun