English
Related papers

Related papers: Federated Orthogonal Training: Mitigating Global C…

200 papers

Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client device and exchanged with a central server, which aggregates the…

Machine Learning · Computer Science 2020-12-23 Sagar Dhakal , Saurav Prakash , Yair Yona , Shilpa Talwar , Nageen Himayat

With an increasing number of smart devices like internet of things (IoT) devices deployed in the field, offloadingtraining of neural networks (NNs) to a central server becomes more and more infeasible. Recent efforts toimprove users'…

Machine Learning · Computer Science 2023-07-19 Kilian Pfeiffer , Martin Rapp , Ramin Khalili , Jörg Henkel

Federated learning (FL) is an emerging machine learning paradigm that allows multiple parties to train a shared model collaboratively in a privacy-preserving manner. Existing horizontal FL methods generally assume that the FL server and…

Machine Learning · Computer Science 2023-08-02 Liping Yi , Gang Wang , Xiaoguang Liu , Zhuan Shi , Han Yu

Federated continual learning (FCL) allows each client to continually update its knowledge from task streams, enhancing the applicability of federated learning in real-world scenarios. However, FCL needs to address not only spatial data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hao Yu , Xin Yang , Le Zhang , Hanlin Gu , Tianrui Li , Lixin Fan , Qiang Yang

Federated Learning (FL) marks a transformative approach to distributed model training by combining locally optimized models from various clients into a unified global model. While FL preserves data privacy by eliminating centralized…

Machine Learning · Computer Science 2026-01-08 Pranab Sahoo , Ashutosh Tripathi , Sriparna Saha , Samrat Mondal

In Federated Learning (FL), the distributed nature and heterogeneity of client data present both opportunities and challenges. While collaboration among clients can significantly enhance the learning process, not all collaborations are…

Machine Learning · Computer Science 2024-07-18 Nazarii Tupitsa , Samuel Horváth , Martin Takáč , Eduard Gorbunov

Continual learning has been an active research area in machine learning, focusing on incrementally learning a sequence of tasks. A key challenge is catastrophic forgetting (CF), and most research efforts have been directed toward mitigating…

Machine Learning · Computer Science 2025-02-27 Saleh Momeni , Bing Liu

Custom Diffusion Models (CDMs) have gained significant attention due to their remarkable ability to personalize generative processes. However, existing CDMs suffer from catastrophic forgetting when continuously learning new concepts. Most…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Arjun Ramesh Kaushik , Naresh Kumar Devulapally , Vishnu Suresh Lokhande , Nalini Ratha , Venu Govindaraju

Federated Learning (FL) is a machine learning paradigm where many local nodes collaboratively train a central model while keeping the training data decentralized. This is particularly relevant for clinical applications since patient data…

Federated Learning (FL) refers to learning a high quality global model based on decentralized data storage, without ever copying the raw data. A natural scenario arises with data created on mobile phones by the activity of their users.…

Machine Learning · Computer Science 2023-01-19 Yihan Jiang , Jakub Konečný , Keith Rush , Sreeram Kannan

Catastrophic forgetting remains a critical challenge in the field of continual learning, where neural networks struggle to retain prior knowledge while assimilating new information. Most existing studies emphasize mitigating this issue only…

Machine Learning · Computer Science 2023-09-21 Wenhang Shi , Yiren Chen , Zhe Zhao , Wei Lu , Kimmo Yan , Xiaoyong Du

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang

Federated Learning (FL) enables collaborative learning without directly sharing individual's raw data. FL can be implemented in either a centralized (server-based) or decentralized (peer-to-peer) manner. In this survey, we present a novel…

Machine Learning · Computer Science 2025-03-11 Qiongxiu Li , Wenrui Yu , Yufei Xia , Jun Pang

Federated learning (FL) is a system in which a central aggregator coordinates the efforts of multiple clients to solve machine learning problems. This setting allows training data to be dispersed in order to protect privacy. The purpose of…

Machine Learning · Computer Science 2022-06-27 Subrato Bharati , M. Rubaiyat Hossain Mondal , Prajoy Podder , V. B. Surya Prasath

Federated Class-Incremental Learning (FCIL) refers to a scenario where a dynamically changing number of clients collaboratively learn an ever-increasing number of incoming tasks. FCIL is known to suffer from local forgetting due to class…

Machine Learning · Computer Science 2025-03-17 Milad Khademi Nori , Il-Min Kim , Guanghui Wang

Deep neural networks are known to suffer the catastrophic forgetting problem, where they tend to forget the knowledge from the previous tasks when sequentially learning new tasks. Such failure hinders the application of deep learning based…

Machine Learning · Computer Science 2018-12-04 Junfeng Wen , Yanshuai Cao , Ruitong Huang

Federated learning (FL) enables learning from decentralized privacy-sensitive data, with computations on raw data confined to take place at edge clients. This paper introduces mixed FL, which incorporates an additional loss term calculated…

Machine Learning · Computer Science 2022-06-28 Sean Augenstein , Andrew Hard , Lin Ning , Karan Singhal , Satyen Kale , Kurt Partridge , Rajiv Mathews

Federated Learning Networks (FLNs) have been envisaged as a promising paradigm to collaboratively train models among mobile devices without exposing their local privacy data. Due to the need for frequent model updates and communications,…

Cryptography and Security · Computer Science 2021-10-07 Yuan-Ai Xie , Jiawen Kang , Dusit Niyato , Nguyen Thi Thanh Van , Nguyen Cong Luong , Zhixin Liu , Han Yu

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong

Federated learning (FL) is a recently proposed distributed machine learning paradigm dealing with distributed and private data sets. Based on the data partition pattern, FL is often categorized into horizontal, vertical, and hybrid…

Machine Learning · Computer Science 2021-02-19 Xinwei Zhang , Wotao Yin , Mingyi Hong , Tianyi Chen