中文
相关论文

相关论文: Avoid Forgetting by Preserving Global Knowledge Gr…

200 篇论文

Federated learning (FL) enables collaborative model training across distributed clients while preserving data privacy. However, data and system heterogeneity often cause catastrophic forgetting and unbounded drift in model updates, leading…

机器学习 · 计算机科学 2026-04-28 Taehwan Yoon , Bongjun Choi , Wesley De Neve

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

机器学习 · 计算机科学 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

机器学习 · 计算机科学 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

Federated recommender systems enable collaborative model training while keeping user interaction data local and sharing only essential model parameters, thereby mitigating privacy risks. However, existing methods overlook a critical issue,…

机器学习 · 计算机科学 2026-03-13 Fengyuan Yu , Xiaohua Feng , Yuyuan Li , Changwang Zhang , Jun Wang , Chaochao Chen

Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients, which…

机器学习 · 计算机科学 2023-12-25 Tiejin Chen , Yuanpu Cao , Yujia Wang , Cho-Jui Hsieh , Jinghui Chen

Federated learning (FL) enables collaborative machine learning across distributed data owners, but data heterogeneity poses a challenge for model calibration. While prior work focused on improving accuracy for non-iid data, calibration…

机器学习 · 计算机科学 2024-06-05 Hongyi Peng , Han Yu , Xiaoli Tang , Xiaoxiao Li

Federated Learning (FL) enables the multiple participating devices to collaboratively contribute to a global neural network model while keeping the training data locally. Unlike the centralized training setting, the non-IID and imbalanced…

机器学习 · 计算机科学 2024-04-16 Moming Duan , Duo Liu , Xinyuan Ji , Renping Liu , Liang Liang , Xianzhang Chen , Yujuan Tan

Federated learning (FL) has attracted growing attention via data-private collaborative training on decentralized clients. However, most existing methods unrealistically assume object classes of the overall framework are fixed over time. It…

机器学习 · 计算机科学 2022-03-23 Jiahua Dong , Lixu Wang , Zhen Fang , Gan Sun , Shichao Xu , Xiao Wang , Qi Zhu

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

机器学习 · 计算机科学 2021-02-15 Filip Hanzely , Peter Richtárik

Federated learning is a method of training models on private data distributed over multiple devices. To keep device data private, the global model is trained by only communicating parameters and updates which poses scalability challenges…

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

机器学习 · 计算机科学 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

Federated Learning (FL) is a promising decentralized learning framework and has great potentials in privacy preservation and in lowering the computation load at the cloud. Recent work showed that FedAvg and FedProx - the two widely-adopted…

机器学习 · 统计学 2022-02-16 Lili Su , Jiaming Xu , Pengkun Yang

Federated Learning is emerging as a privacy-preserving model training approach in distributed edge applications. As such, most edge deployments are heterogeneous in nature i.e., their sensing capabilities and environments vary across…

机器学习 · 计算机科学 2024-07-15 Khotso Selialia , Yasra Chandio , Fatima M. Anwar

Federated Learning (FL) is a distributed machine learning strategy, developed for settings where training data is owned by distributed devices and cannot be shared. FL circumvents this constraint by carrying out model training in…

机器学习 · 计算机科学 2025-01-24 Maria Hartmann , Grégoire Danoy , Pascal Bouvry

The heterogeneity of hardware and data is a well-known and studied problem in the community of Federated Learning (FL) as running under heterogeneous settings. Recently, custom-size client models trained with Knowledge Distillation (KD) has…

机器学习 · 计算机科学 2022-11-15 Hongrui Shi , Valentin Radu , Po Yang

Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms of the systems characteristics on each device in the network…

机器学习 · 计算机科学 2020-04-23 Tian Li , Anit Kumar Sahu , Manzil Zaheer , Maziar Sanjabi , Ameet Talwalkar , Virginia Smith

Federated learning (FL) on heterogeneous data (non-IID data) has recently received great attention. Most existing methods focus on studying the convergence guarantees for the global objective. While these methods can guarantee the decrease…

机器学习 · 计算机科学 2023-11-22 Shu Zheng , Tiandi Ye , Xiang Li , Ming Gao

Federated Learning (FL) is a novel approach that allows for collaborative machine learning while preserving data privacy by leveraging models trained on decentralized devices. However, FL faces challenges due to non-uniformly distributed…

机器学习 · 计算机科学 2024-04-16 Changlin Song , Divya Saxena , Jiannong Cao , Yuqing Zhao

Federated learning (FL) has emerged as the predominant approach for collaborative training of neural network models across multiple users, without the need to gather the data at a central location. One of the important challenges in this…

机器学习 · 计算机科学 2021-07-15 Matthias Reisser , Christos Louizos , Efstratios Gavves , Max Welling

Federated learning is a distributed machine learning paradigm designed to protect data privacy. However, data heterogeneity across various clients results in catastrophic forgetting, where the model rapidly forgets previous knowledge while…

机器学习 · 计算机科学 2024-11-07 Pengju Wang , Bochao Liu , Weijia Guo , Yong Li , Shiming Ge