English
Related papers

Related papers: Jointly Exploring Client Drift and Catastrophic Fo…

200 papers

Asynchronous federated learning mitigates the inefficiency of conventional synchronous aggregation by integrating updates as they arrive and adjusting their influence based on staleness. Due to asynchrony and data heterogeneity, learning…

Machine Learning · Computer Science 2025-02-27 Jiayun Zhang , Shuheng Li , Haiyu Huang , Xiaofan Yu , Rajesh K. Gupta , Jingbo Shang

Major data protection regulations all mention the "right to be forgotten," and that's what pushed federated unlearning (FU) techniques forward. But one stubborn issue remains: catastrophic forgetting--you erase the target knowledge, yet…

Machine Learning · Computer Science 2026-05-27 Hangyi Shen , Yizhi Pan , Tiansuo Li , Weiqi Jiang , Guanqun Sun

Existing federated learning paradigms usually extensively exchange distributed models at a central solver to achieve a more powerful model. However, this would incur severe communication burden between a server and multiple clients…

Machine Learning · Computer Science 2022-09-30 Ping Liu , Xin Yu , Joey Tianyi Zhou

Developing autonomous vehicles (AVs) helps improve the road safety and traffic efficiency of intelligent transportation systems (ITS). Accurately predicting the trajectories of traffic participants is essential to the decision-making and…

Robotics · Computer Science 2022-12-22 Yunlong Lin , Zirui Li , Cheng Gong , Chao Lu , Xinwei Wang , Jianwei Gong

Federated Learning is a distributed machine learning approach which enables model training without data sharing. In this paper, we propose a new federated learning algorithm, Federated Averaging with Client-level Momentum (FedCM), to tackle…

Machine Learning · Computer Science 2021-06-22 Jing Xu , Sen Wang , Liwei Wang , Andrew Chi-Chih Yao

Federated learning (FL) is emerging as a promising technique for collaborative learning without local data leaving their devices. However, clients' data originating from diverse domains may degrade model performance due to domain shifts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zheng Wang , Zihui Wang , Zheng Wang , Xiaoliang Fan , Cheng Wang

There has been a surge of interest in continual learning and federated learning, both of which are important in deep neural networks in real-world scenarios. Yet little research has been done regarding the scenario where each client learns…

Machine Learning · Computer Science 2021-06-15 Jaehong Yoon , Wonyong Jeong , Giwoong Lee , Eunho Yang , Sung Ju Hwang

Federated Learning has become an important learning paradigm due to its privacy and computational benefits. As the field advances, two key challenges that still remain to be addressed are: (1) system heterogeneity - variability in the…

Machine Learning · Computer Science 2022-06-02 Disha Makhija , Nhat Ho , Joydeep Ghosh

Federated learning (FL) is a distributed paradigm that coordinates massive local clients to collaboratively train a global model via stage-wise local training processes on the heterogeneous dataset. Previous works have implicitly studied…

Machine Learning · Computer Science 2026-04-15 Li Shen , Yan Sun , Dacheng Tao

Hierarchical Federated Learning (HFL) faces the significant challenge of adversarial or unreliable vehicles in vehicular networks, which can compromise the model's integrity through misleading updates. Addressing this, our study introduces…

Machine Learning · Computer Science 2024-05-29 M. Saeid HaghighiFard , Sinem Coleri

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication…

Machine Learning · Computer Science 2019-01-09 Sebastian Caldas , Jakub Konečny , H. Brendan McMahan , Ameet Talwalkar

Federated Learning (FL) is an emerging domain in the broader context of artificial intelligence research. Methodologies pertaining to FL assume distributed model training, consisting of a collection of clients and a server, with the main…

Machine Learning · Computer Science 2023-05-09 Bhargav Ganguly , Vaneet Aggarwal

Hyperparameter selection is critical for stable and efficient convergence of heterogeneous federated learning, where clients differ in computational capabilities, and data distributions are non-IID. Tuning hyperparameters is a manual and…

Machine Learning · Computer Science 2025-10-07 Aayushya Agarwal , Larry Pileggi , Gauri Joshi

We tackle the problem of Federated Learning in the non i.i.d. case, in which local models drift apart, inhibiting learning. Building on an analogy with Lifelong Learning, we adapt a solution for catastrophic forgetting to Federated…

Machine Learning · Computer Science 2019-10-18 Neta Shoham , Tomer Avidor , Aviv Keren , Nadav Israel , Daniel Benditkis , Liron Mor-Yosef , Itai Zeitak

Decentralized Federated Learning has emerged as an alternative to centralized architectures due to its faster training, privacy preservation, and reduced communication overhead. In decentralized communication, the server aggregation phase…

Machine Learning · Computer Science 2024-10-11 Qinglun Li , Miao Zhang , Yingqi Liu , Quanjun Yin , Li Shen , Xiaochun Cao

The Web is naturally heterogeneous with user devices, geographic regions, browsing patterns, and contexts all leading to highly diverse, unique datasets. Federated Learning (FL) is an important paradigm for the Web because it enables…

Machine Learning · Computer Science 2026-02-05 Abdulrahman Alotaibi , Irene Tenison , Miriam Kim , Isaac Lee , Lalana Kagal

Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue…

Machine Learning · Computer Science 2024-09-05 Jinglin Liang , Jin Zhong , Hanlin Gu , Zhongqi Lu , Xingxing Tang , Gang Dai , Shuangping Huang , Lixin Fan , Qiang Yang

Modern big-data systems generate massive, heterogeneous, and geographically dispersed streams that are large-scale and privacy-sensitive, making centralization challenging. While federated learning (FL) provides a privacy-enhancing training…

Machine Learning · Computer Science 2026-02-20 Obaidullah Zaland , Zulfiqar Ahmad Khan , Monowar Bhuyan

Machine and deep learning methods for medical and healthcare applications have shown significant progress and performance improvement in recent years. These methods require vast amounts of training data which are available in the medical…

Machine Learning · Computer Science 2023-05-01 Vincent Scheltjens , Lyse Naomi Wamba Momo , Wouter Verbeke , Bart De Moor