中文
相关论文

相关论文: Data-Aware Gradient Compression for FL in Communic…

200 篇论文

Federated Learning (FL) is a decentralized approach for collaborative model training on edge devices. This distributed method of model training offers advantages in privacy, security, regulatory compliance, and cost-efficiency. Our emphasis…

机器学习 · 计算机科学 2024-10-24 Charuka Herath , Xiaolan Liu , Sangarapillai Lambotharan , Yogachandran Rahulamathavan

The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote…

机器学习 · 计算机科学 2023-05-30 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Decentralized stochastic gradient descent (SGD) is a driving engine for decentralized federated learning (DFL). The performance of decentralized SGD is jointly influenced by inter-node communications and local updates. In this paper, we…

机器学习 · 计算机科学 2022-02-14 Wei Liu , Li Chen , Wenyi Zhang

Federated learning (FL) has been recognized as a viable distributed learning paradigm for training a machine learning model across distributed clients without uploading raw data. However, FL in wireless networks still faces two major…

分布式、并行与集群计算 · 计算机科学 2024-02-21 Xuefeng Han , Wen Chen , Jun Li , Ming Ding , Qingqing Wu , Kang Wei , Xiumei Deng , Zhen Mei

Federated Learning (FL) is a novel distributed machine learning approach to leverage data from Internet of Things (IoT) devices while maintaining data privacy. However, the current FL algorithms face the challenges of non-independent and…

机器学习 · 计算机科学 2023-12-20 Gang Hu , Yinglei Teng , Nan Wang , F. Richard Yu

With more regulations tackling users' privacy-sensitive data protection in recent years, access to such data has become increasingly restricted and controversial. To exploit the wealth of data generated and located at distributed entities…

机器学习 · 计算机科学 2020-11-10 Nader Bouacida , Jiahui Hou , Hui Zang , Xin Liu

Federated Learning (FL) incurs high communication overhead, which can be greatly alleviated by compression for model updates. Yet the tradeoff between compression and model accuracy in the networked environment remains unclear and, for…

机器学习 · 计算机科学 2021-12-14 Laizhong Cui , Xiaoxin Su , Yipeng Zhou , Jiangchuan Liu

Federated Learning (FL) is a distributed machine learning (ML) paradigm, aiming to train a global model by exploiting the decentralized data across millions of edge devices. Compared with centralized learning, FL preserves the clients'…

分布式、并行与集群计算 · 计算机科学 2023-08-15 Bocheng Chen , Nikolay Ivanov , Guangjing Wang , Qiben Yan

In order to achieve the dual goals of privacy and learning across distributed data, Federated Learning (FL) systems rely on frequent exchanges of large files (model updates) between a set of clients and the server. As such FL systems are…

机器学习 · 计算机科学 2023-01-12 Parikshit Hegde , Gustavo de Veciana , Aryan Mokhtari

Federated learning (FL) has become de facto framework for collaborative learning among edge devices with privacy concern. The core of the FL strategy is the use of stochastic gradient descent (SGD) in a distributed manner. Large scale…

机器学习 · 计算机科学 2022-05-18 Kerem Ozfatura , Emre Ozfatura , Deniz Gunduz

Federated learning (FL) can fully leverage large-scale terminal data while ensuring privacy and security, and is considered as a distributed alternative for the centralized machine learning. However, the issue of data heterogeneity poses…

机器学习 · 计算机科学 2025-03-27 Xianke Qiang , Zheng Chang , Ying-Chang Liang

Compression is an efficient way to relieve the tremendous communication overhead of federated learning (FL) systems. However, for the existing works, the information loss under compression will lead to unexpected model/gradient deviation…

机器学习 · 计算机科学 2024-12-31 Jiaming Yan , Jianchun Liu , Hongli Xu , Liusheng Huang , Jiantao Gong , Xudong Liu , Kun Hou

Federated learning is an emerging distributed machine learning method, enables a large number of clients to train a model without exchanging their local data. The time cost of communication is an essential bottleneck in federated learning,…

机器学习 · 计算机科学 2023-09-19 Hao Sun , Li Shen , Shixiang Chen , Jingwei Sun , Jing Li , Guangzhong Sun , Dacheng Tao

Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient…

信息论 · 计算机科学 2022-07-12 Chunmei Xu , Shengheng Liu , Zhaohui Yang , Yongming Huang , Kai-Kit Wong

In federated learning (FL) systems, e.g., wireless networks, the communication cost between the clients and the central server can often be a bottleneck. To reduce the communication cost, the paradigm of communication compression has become…

机器学习 · 统计学 2022-11-28 Xiaoyun Li , Ping Li

Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative training of machine learning models over decentralized devices without exposing their local data. One of the major challenges in FL is…

分布式、并行与集群计算 · 计算机科学 2024-07-11 Md Sirajul Islam , Simin Javaherian , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Due to the substantial computational cost, training state-of-the-art deep neural networks for large-scale datasets often requires distributed training using multiple computation workers. However, by nature, workers need to frequently…

机器学习 · 计算机科学 2018-02-21 Yusuke Tsuzuku , Hiroto Imachi , Takuya Akiba

Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a solution to tackle…

机器学习 · 计算机科学 2022-03-31 S Vineeth

Today, various machine learning (ML) applications offer continuous data processing and real-time data analytics at the edge of a wireless network. Distributed real-time ML solutions are highly sensitive to the so-called straggler effect…

机器学习 · 计算机科学 2024-10-28 Nikita Zeulin , Olga Galinina , Nageen Himayat , Sergey Andreev , Robert W. Heath

To exploit massive amounts of data generated at mobile edge networks, federated learning (FL) has been proposed as an attractive substitute for centralized machine learning (ML). By collaboratively training a shared learning model at edge…

信息论 · 计算机科学 2024-10-30 Hang Liu , Xiaojun Yuan , Ying-Jun Angela Zhang