English
Related papers

Related papers: Communication-Efficient Learning of Deep Networks …

200 papers

Large machine learning models trained on diverse data have recently seen unprecedented success. Federated learning enables training on private data that may otherwise be inaccessible, such as domain-specific datasets decentralized across…

Federated learning is a paradigm of increasing relevance in real world applications, aimed at building a global model across a network of heterogeneous users without requiring the sharing of private data. We focus on model learning over…

Machine Learning · Computer Science 2025-07-24 Aritz Pérez , Carlos Echegoyen , Guzmán Santafé

With the growing availability of smart devices and cloud services, personal speech assistance systems are increasingly used on a daily basis. Most devices redirect the voice recordings to a central server, which uses them for upgrading the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-01 Wentao Yu , Jan Freiwald , Sören Tewes , Fabien Huennemeyer , Dorothea Kolossa

Federated learning can enable remote workers to collaboratively train a shared machine learning model while allowing training data to be kept locally. In the use case of wireless mobile devices, the communication overhead is a critical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-11 Kai Yue , Richeng Jin , Chau-Wai Wong , Huaiyu Dai

Distributed learning techniques such as federated learning have enabled multiple workers to train machine learning models together to reduce the overall training time. However, current distributed training algorithms (centralized or…

Machine Learning · Computer Science 2020-02-25 Zhenheng Tang , Shaohuai Shi , Xiaowen Chu

Federated learning is a novel decentralized learning architecture. During the training process, the client and server must continuously upload and receive model parameters, which consumes a lot of network transmission resources. Some…

Machine Learning · Computer Science 2025-04-14 Yan-Ann Chen , Guan-Lin Chen

Representation learning is a widely adopted framework for learning in data-scarce environments, aiming to extract common features from related tasks. While centralized approaches have been extensively studied, decentralized methods remain…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

The emerging concern about data privacy and security has motivated the proposal of federated learning, which allows nodes to only synchronize the locally-trained models instead their own original data. Conventional federated learning…

Machine Learning · Computer Science 2019-08-22 Chenghao Hu , Jingyan Jiang , Zhi Wang

As the complexity of our neural network models grow, so too do the data and computation requirements for successful training. One proposed solution to this problem is training on a distributed network of computational devices, thus…

Machine Learning · Computer Science 2020-05-22 Kyle Crandall , Dustin Webb

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some…

Cryptography and Security · Computer Science 2024-06-19 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

Federated learning is a powerful distributed learning scheme that allows numerous edge devices to collaboratively train a model without sharing their data. However, training is resource-intensive for edge devices, and limited network…

Machine Learning · Computer Science 2024-10-25 Hui-Po Wang , Sebastian U. Stich , Yang He , Mario Fritz

With privacy as a motivation, Federated Learning (FL) is an increasingly used paradigm where learning takes place collectively on edge devices, each with a cache of user-generated training examples that remain resident on the local device.…

Machine Learning · Computer Science 2021-11-25 Sean Augenstein , Andrew Hard , Kurt Partridge , Rajiv Mathews

Federated learning is a distributed learning paradigm in which multiple mobile clients train a global model while keeping data local. These mobile clients can have various available memory and network bandwidth. However, to achieve the best…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Dixi Yao

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are distributed (unevenly) over an extremely large number of \nodes, but the goal remains to…

Machine Learning · Computer Science 2015-11-12 Jakub Konečný , Brendan McMahan , Daniel Ramage

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Federated Learning offers a way to train deep neural networks in a distributed fashion. While this addresses limitations related to distributed data, it incurs a communication overhead as the model parameters or gradients need to be…

Machine Learning · Computer Science 2023-05-26 Morten From Elvebakken , Alexandros Iosifidis , Lukas Esterle

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie

Federated Learning is a machine learning paradigm where we aim to train machine learning models in a distributed fashion. Many clients/edge devices collaborate with each other to train a single model on the central. Clients do not share…

Machine Learning · Computer Science 2022-11-28 Mann Patel

Fully decentralised federated learning enables collaborative training of individual machine learning models on a distributed network of communicating devices while keeping the training data localised on each node. This approach avoids…

Machine Learning · Computer Science 2025-05-23 Arash Badie-Modiri , Chiara Boldrini , Lorenzo Valerio , János Kertész , Márton Karsai