English
Related papers

Related papers: Improving Generalization in Heterogeneous Federate…

200 papers

Asynchronous federated learning aims to solve the straggler problem in heterogeneous environments, i.e., clients have small computational capacities that could cause aggregation delay. The principle of asynchronous federated learning is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-05 Xiang Ma , Qun Wang , Haijian Sun , Rose Qingyang Hu , Yi Qian

Federated- and Continual Learning have been established as approaches to enable privacy-aware learning on continuously changing data, as required for deploying AI systems in histopathology images. However, data shifts can occur in a dynamic…

Machine Learning · Computer Science 2025-01-09 Niklas Babendererde , Haozhe Zhu , Moritz Fuchs , Jonathan Stieber , Anirban Mukhopadhyay

Distribution shift (e.g., task or domain shift) in continual learning (CL) usually results in catastrophic forgetting of neural networks. Although it can be alleviated by repeatedly replaying buffered data, the every-step replay is…

Machine Learning · Computer Science 2023-04-11 Haiyan Zhao , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

Federated learning (FL) enables collaborative training of a global model in the centralized server with data from multiple parties while preserving privacy. However, data heterogeneity can significantly degrade the performance of the global…

Machine Learning · Computer Science 2025-11-11 Yong Zhang , Feng Liang , Guanghu Yuan , Min Yang , Chengming Li , Xiping Hu

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

In this work, we introduce Adapt & Align, a method for continual learning of neural networks by aligning latent representations in generative models. Neural Networks suffer from abrupt loss in performance when retrained with additional…

Machine Learning · Computer Science 2023-12-22 Kamil Deja , Bartosz Cywiński , Jan Rybarczyk , Tomasz Trzciński

Recent advances of generative learning models are accompanied by the growing interest in federated learning (FL) based on generative adversarial network (GAN) models. In the context of FL, GAN can capture the underlying client data…

Machine Learning · Computer Science 2023-08-25 Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Despite significant advances, continual learning models still suffer from catastrophic forgetting when exposed to incrementally available data from non-stationary distributions. Rehearsal approaches alleviate the problem by maintaining and…

Machine Learning · Statistics 2021-03-02 Binh Tang , David S. Matteson

Mobile devices, including smartphones and laptops, generate decentralized and heterogeneous data, presenting significant challenges for traditional centralized machine learning models due to substantial communication costs and privacy…

Machine Learning · Computer Science 2024-11-12 Mayank Kumar Kundalwal , Anurag Saraswat , Ishan Mishra , Deepak Mishra

Traditional Federated Learning (FL) methods encounter significant challenges when dealing with heterogeneous data and providing personalized solutions for non-IID scenarios. Personalized Federated Learning (PFL) approaches aim to address…

Machine Learning · Computer Science 2025-11-11 Yasaman Saadati , Mohammad Rostami , M. Hadi Amini

Deep learning models for radiology interpretation increasingly rely on multi-institutional data, yet privacy regulations and distribution shift across hospitals limit central data pooling. Federated learning (FL) allows hospitals to…

Machine Learning · Computer Science 2026-01-13 Anay Sinhal , Arpana Sinhal , Amit Sinhal

Federated Learning is a powerful machine learning paradigm to cooperatively train a global model with highly distributed data. A major bottleneck on the performance of distributed Stochastic Gradient Descent (SGD) algorithm for large-scale…

Machine Learning · Computer Science 2020-01-24 Haozhao Wang , Zhihao Qu , Song Guo , Xin Gao , Ruixuan Li , Baoliu Ye

Nowadays, real-world data, including graph-structure data, often arrives in a streaming manner, which means that learning systems need to continuously acquire new knowledge without forgetting previously learned information. Although…

Machine Learning · Computer Science 2025-09-29 Ziyang Cheng , Zhixun Li , Yuhan Li , Yixin Song , Kangyi Zhao , Dawei Cheng , Jia Li , Hong Cheng , Jeffrey Xu Yu

In federated graph learning (FGL), a complete graph is divided into multiple subgraphs stored in each client due to privacy concerns, and all clients jointly train a global graph model by only transmitting model parameters. A pain point of…

Machine Learning · Computer Science 2025-03-26 Bo Yan , Zhongjian Zhang , Huabin Sun , Mengmei Zhang , Yang Cao , Chuan Shi

The proliferation of end devices has led to a distributed computing paradigm, wherein on-device machine learning models continuously process diverse data generated by these devices. The dynamic nature of this data, characterized by…

Machine Learning · Computer Science 2025-05-02 Zhengyi Zhong , Weidong Bao , Ji Wang , Jianguo Chen , Lingjuan Lyu , Wei Yang Bryan Lim

As Federated Learning (FL) expands to larger and more distributed environments, consistency in training is challenged by network-induced delays, clock unsynchronicity, and variability in client updates. This combination of factors may…

Machine Learning · Computer Science 2025-06-12 Baran Can Gül , Stefanos Tziampazis , Nasser Jazdi , Michael Weyrich

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

Machine Learning · Computer Science 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Continual Learning (CL) aims to learn new data while remembering previously acquired knowledge. In contrast to CL for image classification, CL for Object Detection faces additional challenges such as the missing annotations problem. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Riccardo De Monte , Davide Dalle Pezze , Marina Ceccon , Francesco Pasti , Francesco Paissan , Elisabetta Farella , Gian Antonio Susto , Nicola Bellotto

Federated Learning (FL) allows training machine learning models in privacy-constrained scenarios by enabling the cooperation of edge devices without requiring local data sharing. This approach raises several challenges due to the different…

Machine Learning · Computer Science 2022-12-02 Riccardo Zaccone , Andrea Rizzardi , Debora Caldarola , Marco Ciccone , Barbara Caputo