English
Related papers

Related papers: Federated Two-stage Learning with Sign-based Votin…

200 papers

We propose a new optimization formulation for training federated learning models. The standard formulation has the form of an empirical risk minimization problem constructed to find a single global model trained from the private data stored…

Machine Learning · Computer Science 2021-02-15 Filip Hanzely , Peter Richtárik

Federated learning is a distributed machine learning paradigm designed to protect user data privacy, which has been successfully implemented across various scenarios. In traditional federated learning, the entire parameter set of local…

Machine Learning · Computer Science 2024-11-07 Haolin Wang , Xuefeng Liu , Jianwei Niu , Wenkai Guo , Shaojie Tang

Federated learning is a distributed machine learning approach to privacy preservation and two major technical challenges prevent a wider application of federated learning. One is that federated learning raises high demands on communication,…

Machine Learning · Computer Science 2020-03-06 Hangyu Zhu , Yaochu Jin

Federated Learning is a machine learning setting where the goal is to train a high-quality centralized model while training data remains distributed over a large number of clients each with unreliable and relatively slow network…

Machine Learning · Computer Science 2017-11-01 Jakub Konečný , H. Brendan McMahan , Felix X. Yu , Peter Richtárik , Ananda Theertha Suresh , Dave Bacon

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem…

Training neural networks on large datasets can be accelerated by distributing the workload over a network of machines. As datasets grow ever larger, networks of hundreds or thousands of machines become economically viable. The time cost of…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-26 Jeremy Bernstein , Jiawei Zhao , Kamyar Azizzadenesheli , Anima Anandkumar

Federated learning is a distributed framework according to which a model is trained over a set of devices, while keeping data localized. This framework faces several systems-oriented challenges which include (i) communication bottleneck…

Machine Learning · Computer Science 2020-06-09 Amirhossein Reisizadeh , Aryan Mokhtari , Hamed Hassani , Ali Jadbabaie , Ramtin Pedarsani

As privacy protection gains increasing importance, more models are being trained on edge devices and subsequently merged into the central server through Federated Learning (FL). However, current research overlooks the impact of network…

Machine Learning · Computer Science 2025-08-04 Hangyu Li , Hongyue Wu , Guodong Fan , Zhen Zhang , Shizhan Chen , Zhiyong Feng

Federated Learning is a distributed machine learning approach that enables geographically distributed data silos to collaboratively learn a joint machine learning model without sharing data. Most of the existing work operates on…

Machine Learning · Computer Science 2023-05-17 Dimitris Stripelis , Jose Luis Ambite

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

In federated learning (FL), reducing the communication overhead is one of the most critical challenges since the parameter server and the mobile devices share the training parameters over wireless links. With such consideration, we adopt…

Machine Learning · Computer Science 2021-09-07 Richeng Jin , Xiaofan He , Huaiyu Dai

Distributed learning is an effective approach to accelerate model training using multiple workers. However, substantial communication delays emerge between workers and a parameter server due to massive costs associated with communicating…

Machine Learning · Computer Science 2024-02-05 Chanho Park , Namyoon Lee

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated Learning (FL) is a distributed machine learning approach that enables model training in communication efficient and privacy-preserving manner. The standard optimization method in FL is Federated Averaging (FedAvg), which performs…

Machine Learning · Computer Science 2023-09-21 Zeyi Tao , Jindi Wu , Qun Li

Federated learning (FL) aims to train machine learning models in the decentralized system consisting of an enormous amount of smart edge devices. Federated averaging (FedAvg), the fundamental algorithm in FL settings, proposes on-device…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Tianchi Huang , Rui-Xiao Zhang , Ruiyu Li , Lifeng Sun

Federated learning (FL) has achieved great success as a privacy-preserving distributed training paradigm, where many edge devices collaboratively train a machine learning model by sharing the model updates instead of the raw data with a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-21 Yuchang Sun , Jiawei Shao , Yuyi Mao , Songze Li , Jun Zhang

Federated learning (FL) has become de facto framework for collaborative learning among edge devices with privacy concern. The core of the FL strategy is the use of stochastic gradient descent (SGD) in a distributed manner. Large scale…

Machine Learning · Computer Science 2022-05-18 Kerem Ozfatura , Emre Ozfatura , Deniz Gunduz

Federated Learning (FL) is a distributed machine learning technique, where each device contributes to the learning model by independently computing the gradient based on its local training data. It has recently become a hot research topic,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 Afaf Taïk , Soumaya Cherkaoui

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun