English
Related papers

Related papers: SwiftAgg+: Achieving Asymptotically Optimal Commun…

200 papers

Federated Learning (FL) has recently emerged as a promising method that employs a distributed learning model structure to overcome data privacy and transmission issues paused by central machine learning models. In FL, datasets collected…

Machine Learning · Computer Science 2021-11-05 Ali Anaissi , Basem Suleiman

Federated learning (FL) enables resource-constrained edge nodes to collaboratively learn a global model under the orchestration of a central server while keeping privacy-sensitive data locally. The…

Machine Learning · Computer Science 2021-04-07 Hongda Wu , Ping Wang

Federated learning (FL) has achieved great success as a privacy-preserving distributed training paradigm, where many edge devices collaboratively train a machine learning model by sharing the model updates instead of the raw data with a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-21 Yuchang Sun , Jiawei Shao , Yuyi Mao , Songze Li , Jun Zhang

Federated learning is a promising framework for learning over decentralized data spanning multiple regions. This approach avoids expensive central training data aggregation cost and can improve privacy because distributed sites do not have…

Machine Learning · Computer Science 2021-01-01 Beomyeol Jeon , S. M. Ferdous , Muntasir Raihan Rahman , Anwar Walid

Federated Learning (FL) allows parties to learn a shared prediction model by delegating the training computation to clients and aggregating all the separately trained models on the server. To prevent private information being inferred from…

Machine Learning · Computer Science 2022-05-13 Kwing Hei Li , Pedro Porto Buarque de Gusmão , Daniel J. Beutel , Nicholas D. Lane

Federated learning (FL) allows a large number of clients to collaboratively train machine learning (ML) models by sending only their local gradients to a central server for aggregation in each training iteration, without sending their raw…

Cryptography and Security · Computer Science 2023-05-23 Fucai Luo , Saif Al-Kuwari , Haiyan Wang , Xingfu Yan

We consider the federated frequency estimation problem, where each user holds a private item $X_i$ from a size-$d$ domain and a server aims to estimate the empirical frequency (i.e., histogram) of $n$ items with $n \ll d$. Without any…

Information Theory · Computer Science 2022-11-21 Wei-Ning Chen , Ayfer Özgür , Graham Cormode , Akash Bharadwaj

Large-scale decentralized learning frameworks such as federated learning (FL), require both communication efficiency and strong data security, motivating the study of secure aggregation (SA). While information-theoretic SA is well…

Information Theory · Computer Science 2026-01-28 Xiang Zhang , Zhou Li , Han Yu , Kai Wan , Hua Sun , Mingyue Ji , Giuseppe Caire

In this paper, we propose the FedFeat+ framework, which distinctively separates feature extraction from classification. We develop a two-tiered model training process: following local training, clients transmit their weights and some…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Mrityunjoy Gain , Kitae Kim , Avi Deb Raha , Apurba Adhikary , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Mobile keyboard suggestion is typically regarded as a word-level language modeling problem. Centralized machine learning technique requires massive user data collected to train on, which may impose privacy concerns for sensitive personal…

Computation and Language · Computer Science 2020-09-22 Shaoxiong Ji , Shirui Pan , Guodong Long , Xue Li , Jing Jiang , Zi Huang

This paper targets solving distributed machine learning problems such as federated learning in a communication-efficient fashion. A class of new stochastic gradient descent (SGD) approaches have been developed, which can be viewed as the…

Optimization and Control · Mathematics 2020-02-27 Tianyi Chen , Yuejiao Sun , Wotao Yin

The decentralized Federated Learning (FL) setting avoids the role of a potentially unreliable or untrustworthy central host by utilizing groups of clients to collaboratively train a model via localized training and model/gradient sharing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-26 Marco Bornstein , Tahseen Rabbani , Evan Wang , Amrit Singh Bedi , Furong Huang

Split-learning (SL) has recently gained popularity due to its inherent privacy-preserving capabilities and ability to enable collaborative inference for devices with limited computational power. Standard SL algorithms assume an ideal…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki ben Issaid , Mehdi Bennis

Federated learning (FL) enables collaborative model training without sharing raw data, but individual model updates may still leak sensitive information. Secure aggregation (SecAgg) mitigates this risk by allowing the server to access only…

Cryptography and Security · Computer Science 2025-08-19 Takumi Suimon , Yuki Koizumi , Junji Takemasa , Toru Hasegawa

Major bottlenecks of large-scale Federated Learning(FL) networks are the high costs for communication and computation. This is due to the fact that most of current FL frameworks only consider a star network topology where all local trained…

Information Theory · Computer Science 2021-09-23 Thinh Quang Dinh , Diep N. Nguyen , Dinh Thai Hoang , Pham Tran Vu , Eryk Dutkiewicz

Federated learning is a widely used distributed deep learning framework that protects the privacy of each client by exchanging model parameters rather than raw data. However, federated learning suffers from high communication costs, as a…

Machine Learning · Computer Science 2021-07-20 Guang Yang , Ke Mu , Chunhe Song , Zhijia Yang , Tierui Gong

To leverage massive distributed data and computation resources, machine learning in the network edge is considered to be a promising technique especially for large-scale model training. Federated learning (FL), as a paradigm of…

Machine Learning · Computer Science 2021-10-25 Hao Chen , Shaocheng Huang , Deyou Zhang , Ming Xiao , Mikael Skoglund , H. Vincent Poor

We consider straggler-resilient learning. In many previous works, e.g., in the coded computing literature, straggling is modeled as random delays that are independent and identically distributed between workers. However, in many practical…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Albin Severinson , Eirik Rosnes , Salim El Rouayheb , Alexandre Graell i Amat

Federated learning is highly valued due to its high-performance computing in distributed environments while safeguarding data privacy. To address resource heterogeneity, researchers have proposed a semi-asynchronous federated learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Yunbo Li , Jiaping Gui , Yue Wu

Edge signal processing facilitates distributed learning and inference in the client-server model proposed in federated learning. In traditional machine learning, clients (IoT devices) that acquire raw signal samples can aid a data center…

Signal Processing · Electrical Eng. & Systems 2024-10-03 Vijay Anavangot