中文
相关论文

相关论文: FedExP: Speeding Up Federated Averaging via Extrap…

200 篇论文

Federated learning enables a large amount of edge computing devices to learn a model without data sharing jointly. As a leading algorithm in this setting, Federated Average FedAvg, which runs Stochastic Gradient Descent (SGD) in parallel on…

机器学习 · 计算机科学 2022-11-04 Xiaoxiao Li , Zhao Song , Runzhou Tao , Guangyi Zhang

Federated learning (FL) is a fast-developing technique that allows multiple workers to train a global model based on a distributed dataset. Conventional FL (FedAvg) employs gradient descent algorithm, which may not be efficient enough.…

机器学习 · 计算机科学 2022-10-27 Zhengjie Yang , Wei Bao , Dong Yuan , Nguyen H. Tran , Albert Y. Zomaya

Conventional gradient-sharing approaches for federated learning (FL), such as FedAvg, rely on aggregation of local models and often face performance degradation under differential privacy (DP) mechanisms or data heterogeneity, which can be…

机器学习 · 计算机科学 2024-10-25 Hui-Po Wang , Dingfan Chen , Raouf Kerkouche , Mario Fritz

The theoretical landscape of federated learning (FL) undergoes rapid evolution, but its practical application encounters a series of intricate challenges, and hyperparameter optimization is one of these critical challenges. Amongst the…

机器学习 · 计算机科学 2023-10-09 Ziyao Wang , Jianyu Wang , Ang Li

Federated learning (FL) can achieve privacy-safe and reliable collaborative training without collecting users' private data. Its excellent privacy security potential promotes a wide range of FL applications in Internet-of-Things (IoT),…

机器学习 · 计算机科学 2023-09-26 Xiaofeng Liu , Qing Wang , Yunfeng Shao , Yinchuan Li

Federated learning involves a mixture of centralized and decentralized processing tasks, where a server regularly selects a sample of the agents and these in turn sample their local data to compute stochastic gradients for their learning…

机器学习 · 计算机科学 2020-10-27 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

机器学习 · 计算机科学 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

With the increasingly strengthened data privacy act and the difficult data centralization, Federated Learning (FL) has become an effective solution to collaboratively train the model while preserving each client's privacy. FedAvg is a…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Zhifang Deng , Xiaohong Huang , Dandan Li , Xueguang Yuan

Training latency is critical for the success of numerous intrigued applications ignited by federated learning (FL) over heterogeneous mobile devices. By revolutionarily overlapping local gradient transmission with continuous local…

分布式、并行与集群计算 · 计算机科学 2025-05-21 Jiaxiang Geng , Boyu Li , Xiaoqi Qin , Yixuan Li , Liang Li , Yanzhao Hou , Miao Pan

In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure. We apply a principled approach on a method for adaptive client learning rate, number of local…

机器学习 · 计算机科学 2022-11-07 Andrew K Kan

Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is…

机器学习 · 计算机科学 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen

Scalability and privacy are two critical concerns for cross-device federated learning (FL) systems. In this work, we identify that synchronous FL - synchronized aggregation of client updates in FL - cannot scale efficiently beyond a few…

机器学习 · 计算机科学 2022-03-08 John Nguyen , Kshitiz Malik , Hongyuan Zhan , Ashkan Yousefpour , Michael Rabbat , Mani Malek , Dzmitry Huba

Federated Averaging (FedAvg) has emerged as the algorithm of choice for federated learning due to its simplicity and low communication cost. However, in spite of recent research efforts, its performance is not fully understood. We obtain…

Federated Learning has been recently proposed for distributed model training at the edge. The principle of this approach is to aggregate models learned on distributed clients to obtain a new more general "average" model (FedAvg). The…

机器学习 · 统计学 2022-07-20 Adnan Ben Mansour , Gaia Carenini , Alexandre Duplessis , David Naccache

For federated learning (FL) algorithms such as FedSAM, their generalization capability is crucial for real-word applications. In this paper, we revisit the generalization problem in FL and investigate the impact of data heterogeneity on FL…

机器学习 · 计算机科学 2026-04-21 Liu junkang , Yuanyuan Liu , Fanhua Shang , Hongying Liu , Jin Liu , Wei Feng

Federated learning (FL) enables distributed optimization of machine learning models while protecting privacy by independently training local models on each client and then aggregating parameters on a central server, thereby producing an…

机器学习 · 计算机科学 2022-03-08 Chencheng Xu , Zhiwei Hong , Minlie Huang , Tao Jiang

The federated learning (FL) framework trains a machine learning model using decentralized data stored at edge client devices by periodically aggregating locally trained models. Popular optimization algorithms of FL use vanilla (stochastic)…

机器学习 · 计算机科学 2021-06-07 Jianyu Wang , Zheng Xu , Zachary Garrett , Zachary Charles , Luyang Liu , Gauri Joshi

Federated learning (FL) is an emerging learning paradigm to tackle massively distributed data. In Federated Learning, a set of clients jointly perform a machine learning task under the coordination of a server. The FedAvg algorithm is one…

机器学习 · 计算机科学 2023-02-14 Junyi Li , Feihu Huang , Heng Huang

Federated learning (FL) is an emerging machine learning paradigm designed to address the challenge of data silos, attracting considerable attention. However, FL encounters persistent issues related to fairness and data privacy. To tackle…

密码学与安全 · 计算机科学 2026-01-08 Xinpeng Ling , Jie Fu , Kuncan Wang , Huifa Li , Tong Cheng , Zhili Chen

Standard federated learning approaches suffer when client data distributions have sufficient heterogeneity. Recent methods addressed the client data heterogeneity issue via personalized federated learning (PFL) - a class of FL algorithms…

机器学习 · 计算机科学 2024-04-04 Rishub Tamirisa , Chulin Xie , Wenxuan Bao , Andy Zhou , Ron Arel , Aviv Shamsian