English
Related papers

Related papers: Communication-Efficient ADMM-based Federated Learn…

200 papers

To enable communication-efficient federated learning (FL), this paper studies an unmanned aerial vehicle (UAV)-enabled FL system, where the UAV coordinates distributed ground devices for a shared model training. Specifically, by exploiting…

Signal Processing · Electrical Eng. & Systems 2022-10-21 Min Fu , Yuanming Shi , Yong Zhou

In this paper, we propose feature-based federated transfer learning as a novel approach to improve communication efficiency by reducing the uplink payload by multiple orders of magnitude compared to that of existing approaches in federated…

Machine Learning · Computer Science 2024-05-16 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distributions, limiting its effectiveness in real-world deployments.…

Machine Learning · Computer Science 2025-04-22 Kun Zhai , Yifeng Gao , Difan Zou , Guangnan Ye , Siheng Chen , Xingjun Ma , Yu-Gang Jiang

We propose an innovative algorithm for non-convex composite federated learning that decouples the proximal operator evaluation and the communication between server and clients. Moreover, each client uses local updates to communicate less…

Machine Learning · Computer Science 2025-02-07 Jiaojiao Zhang , Jiang Hu , Mikael Johansson

Federated learning has attracted growing interest as it preserves the clients' privacy. As a variant of federated learning, federated transfer learning utilizes the knowledge from similar tasks and thus has also been intensively studied.…

Machine Learning · Computer Science 2022-09-13 Feng Wang , M. Cenk Gursoy , Senem Velipasalar

Federated reinforcement learning (FedRL) enables agents to collaboratively train a global policy without sharing their individual data. However, high communication overhead remains a critical bottleneck, particularly for natural policy…

Machine Learning · Computer Science 2023-11-01 Guangchen Lan , Han Wang , James Anderson , Christopher Brinton , Vaneet Aggarwal

ADMM is a popular algorithm for solving convex optimization problems. Applying this algorithm to distributed consensus optimization problem results in a fully distributed iterative solution which relies on processing at the nodes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-17 Layla Majzoobi , Farshad Lahouti

Federated learning effectively addresses issues such as data privacy by collaborating across participating devices to train global models. However, factors such as network topology and device computing power can affect its training or…

Machine Learning · Computer Science 2023-11-29 Yizhuo Cai , Bo Lei , Qianying Zhao , Jing Peng , Min Wei , Yushun Zhang , Xing Zhang

Federated Multilingual Neural Machine Translation (Fed-MNMT) has emerged as a promising paradigm for institutions with limited language resources. This approach allows multiple institutions to act as clients and train a unified model…

Computation and Language · Computer Science 2023-05-23 Yi Liu , Xiaohan Bi , Lei Li , Sishuo Chen , Wenkai Yang , Xu Sun

With growth in the number of smart devices and advancements in their hardware, in recent years, data-driven machine learning techniques have drawn significant attention. However, due to privacy and communication issues, it is not possible…

Machine Learning · Computer Science 2020-12-10 Mohammad Salehi , Ekram Hossain

Federated learning (FL) is a novel machine learning setting that enables on-device intelligence via decentralized training and federated optimization. Deep neural networks' rapid development facilitates the learning techniques for modeling…

Machine Learning · Computer Science 2021-09-27 Shaoxiong Ji , Wenqi Jiang , Anwar Walid , Xue Li

Federated learning obtains a central model on the server by aggregating models trained locally on clients. As a result, federated learning does not require clients to upload their data to the server, thereby preserving the data privacy of…

Machine Learning · Computer Science 2020-08-31 Yang Chen , Xiaoyan Sun , Yaochu Jin

Federated learning (FL) enables distributed model training from local data collected by users. In distributed systems with constrained resources and potentially high dynamics, e.g., mobile edge networks, the efficiency of FL is an important…

Machine Learning · Computer Science 2022-12-19 Shiqiang Wang , Jake Perazzone , Mingyue Ji , Kevin S. Chan

Automatic Speech Recognition models require large amount of speech data for training, and the collection of such data often leads to privacy concerns. Federated learning has been widely used and is considered to be an effective…

Machine Learning · Computer Science 2022-09-15 Rongmei Lin , Yonghui Xiao , Tien-Ju Yang , Ding Zhao , Li Xiong , Giovanni Motta , Françoise Beaufays

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

Machine Learning · Computer Science 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Federated learning has emerged as an effective paradigm to achieve privacy-preserving collaborative learning among different parties. Compared to traditional centralized learning that requires collecting data from each party, in federated…

Machine Learning · Computer Science 2023-01-05 Bingyan Liu , Nuoyan Lv , Yuanchun Guo , Yawen Li

Federated Learning enables mobile devices to collaboratively learn a shared inference model while keeping all the training data on a user's device, decoupling the ability to do machine learning from the need to store the data in the cloud.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-03 Keith Bonawitz , Fariborz Salehi , Jakub Konečný , Brendan McMahan , Marco Gruteser

Communication costs within Federated learning hinder the system scalability for reaching more data from more clients. The proposed FL adopts a hub-and-spoke network topology. All clients communicate through the central server. Hence,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-18 Chun-Chih Kuo , Ted Tsei Kuo , Chia-Yu Lin

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched…

Machine Learning · Computer Science 2020-02-18 Hongyi Wang , Mikhail Yurochkin , Yuekai Sun , Dimitris Papailiopoulos , Yasaman Khazaeni