English
Related papers

Related papers: Fresh-CL: Feature Realignment through Experts on H…

200 papers

The Federated Learning (FL) workflow of training a centralized model with distributed data is growing in popularity. However, until recently, this was the realm of contributing clients with similar computing capability. The fast expanding…

Machine Learning · Computer Science 2022-03-23 Hongrui Shi , Valentin Radu

Federated Learning (FL) is a machine learning paradigm that allows decentralized clients to learn collaboratively without sharing their private data. However, excessive computation and communication demands pose challenges to current FL…

Cryptography and Security · Computer Science 2022-09-22 Yue Tan , Guodong Long , Jie Ma , Lu Liu , Tianyi Zhou , Jing Jiang

Continual Learning (CL) aims to incrementally update a trained model on new tasks without forgetting the acquired knowledge of old ones. Existing CL methods usually reduce forgetting with task priors, \ie using task identity or a subset of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Tao Zhuo , Zhiyong Cheng , Hehe Fan , Mohan Kankanhalli

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Federated learning (FL) refers to the learning paradigm that trains machine learning models directly in the decentralized systems consisting of smart edge devices without transmitting the raw data, which avoids the heavy communication costs…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Lifeng Sun

Deep learning succeeds by doing hierarchical feature learning, yet tuning hyper-parameters (HP) such as initialization scales, learning rates etc., only give indirect control over this behavior. In this paper, we introduce a key notion to…

Machine Learning · Computer Science 2025-07-29 Lénaïc Chizat , Praneeth Netrapalli

Federated Learning (FL) has evolved as a promising technique to handle distributed machine learning across edge devices. A single neural network (NN) that optimises a global objective is generally learned in most work in FL, which could be…

Information Theory · Computer Science 2022-03-10 Sawan Singh Mahara , Shruti M. , B. N. Bharath , Akash Murthy

In real-world industrial settings, large language models (LLMs) must learn continually to keep pace with diverse and evolving tasks, requiring self-evolution to refine knowledge under dynamic data distributions. However, existing continual…

Machine Learning · Computer Science 2025-10-16 Jiazheng Kang , Le Huang , Cheng Hou , Zhe Zhao , Zhenxiang Yan , Ting Bai

In this paper we propose Fed-ensemble: a simple approach that bringsmodel ensembling to federated learning (FL). Instead of aggregating localmodels to update a single global model, Fed-ensemble uses random permutations to update a group of…

Machine Learning · Statistics 2023-07-04 Naichen Shi , Fan Lai , Raed Al Kontar , Mosharaf Chowdhury

Objective: Machine learning techniques have been used extensively for 12-lead electrocardiogram (ECG) analysis. For physiological time series, deep learning (DL) superiority to feature engineering (FE) approaches based on domain knowledge…

Machine Learning · Computer Science 2022-07-19 Eran Zvuloni , Jesse Read , Antônio H. Ribeiro , Antonio Luiz P. Ribeiro , Joachim A. Behar

Federated learning (FL) scenarios inherently generate a large communication overhead by frequently transmitting neural network updates between clients and server. To minimize the communication cost, introducing sparsity in conjunction with…

Machine Learning · Computer Science 2022-04-12 Daniel Becking , Heiner Kirchhoffer , Gerhard Tech , Paul Haase , Karsten Müller , Heiko Schwarz , Wojciech Samek

Federated Learning (FL) is a decentralized learning method used to train machine learning algorithms. In FL, a global model iteratively collects the parameters of local models without accessing their local data. However, a significant…

Machine Learning · Computer Science 2023-08-29 Mingjie Wang , Jianxiong Guo , Weijia Jia

Federated continual learning (FCL) has garnered increasing attention for its ability to support distributed computation in environments with evolving data distributions. However, the emergence of new tasks introduces both temporal and…

Machine Learning · Computer Science 2025-09-30 Danni Yang , Zhikang Chen , Sen Cui , Mengyue Yang , Ding Li , Abudukelimu Wuerkaixi , Haoxuan Li , Jinke Ren , Mingming Gong

Federated learning (FL) ameliorates privacy concerns in settings where a central server coordinates learning from data distributed across many clients. The clients train locally and communicate the models they learn to the server;…

Machine Learning · Computer Science 2020-10-16 Monica Ribero , Haris Vikalo

Federated learning (FL) enables collaborative model training among distributed devices without data sharing, but existing FL suffers from poor scalability because of global model synchronization. To address this issue, hierarchical…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-22 Tianyu Qi , Yufeng Zhan , Peng Li , Jingcai Guo , Yuanqing Xia

In real-world applications, dynamic scenarios require the models to possess the capability to learn new tasks continuously without forgetting the old knowledge. Experience-Replay methods store a subset of the old images for joint training.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Xinyuan Gao , Songlin Dong , Yuhang He , Xing Wei , Yihong Gong

Few-shot learning (FSL) aims to address the data-scarce problem. A standard FSL framework is composed of two components: (1) Pre-train. Employ the base data to generate a CNN-based feature extraction model (FEM). (2) Meta-test. Apply the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Shuai Shao , Lei Xing , Yan Wang , Rui Xu , Chunyan Zhao , Yan-Jiang Wang , Bao-Di Liu

Federated learning (FL) provides a privacy-preserving solution for distributed machine learning tasks. One challenging problem that severely damages the performance of FL models is the co-occurrence of data heterogeneity and long-tail…

Machine Learning · Computer Science 2022-04-29 Xinyi Shang , Yang Lu , Gang Huang , Hanzi Wang

Federated Learning (FL) enables decentralized, privacy-preserving model training but struggles to balance global generalization and local personalization due to non-identical data distributions across clients. Personalized Fine-Tuning…

Machine Learning · Computer Science 2025-12-30 Minghui Chen , Hrad Ghoukasian , Ruinan Jin , Zehua Wang , Sai Praneeth Karimireddy , Xiaoxiao Li

Federated learning (FL) is a popular solution for distributed machine learning (ML). While FL has traditionally been studied for supervised ML tasks, in many applications, it is impractical to assume availability of labeled data across…

Machine Learning · Computer Science 2024-04-16 Satyavrat Wagle , Seyyedali Hosseinalipour , Naji Khosravan , Christopher G. Brinton