中文
相关论文

相关论文: Communication-efficient Federated Learning with Si…

200 篇论文

Communication on heterogeneous edge networks is a fundamental bottleneck in Federated Learning (FL), restricting both model capacity and user participation. To address this issue, we introduce two novel strategies to reduce communication…

机器学习 · 计算机科学 2019-01-09 Sebastian Caldas , Jakub Konečny , H. Brendan McMahan , Ameet Talwalkar

Decentralized Federated Learning (DFL) trains models in a collaborative and privacy-preserving manner while removing model centralization risks and improving communication bottlenecks. However, DFL faces challenges in efficient…

In one-shot federated learning (FL), clients collaboratively train a global model in a single round of communication. Existing approaches for one-shot FL enhance communication efficiency at the expense of diminished accuracy. This paper…

机器学习 · 计算机科学 2024-02-06 Mahdi Beitollahi , Alex Bie , Sobhan Hemati , Leo Maxime Brunswic , Xu Li , Xi Chen , Guojun Zhang

In this paper, a new communication-efficient federated learning (FL) framework is proposed, inspired by vector quantized compressed sensing. The basic strategy of the proposed framework is to compress the local model update at each device…

信息论 · 计算机科学 2023-07-04 Yongjeong Oh , Yo-Seb Jeon , Mingzhe Chen , Walid Saad

Recent advancements in semantic communication have primarily focused on image transmission, where neural network-based joint source-channel coding modules play a central role. However, such systems often experience semantic communication…

信号处理 · 电气工程与系统科学 2026-02-20 Yoon Huh , Bumjun Kim , Wan Choi

We propose and study a new class of gradient communication mechanisms for communication-efficient training -- three point compressors (3PC) -- as well as efficient distributed nonconvex optimization algorithms that can take advantage of…

机器学习 · 计算机科学 2022-02-03 Peter Richtárik , Igor Sokolov , Ilyas Fatkhullin , Elnur Gasanov , Zhize Li , Eduard Gorbunov

Federated learning (FL) achieves collaborative learning without the need for data sharing, thus preventing privacy leakage. To extend FL into a fully decentralized algorithm, researchers have applied distributed optimization algorithms to…

网络与互联网体系结构 · 计算机科学 2023-12-20 Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

Communication costs within Federated learning hinder the system scalability for reaching more data from more clients. The proposed FL adopts a hub-and-spoke network topology. All clients communicate through the central server. Hence,…

分布式、并行与集群计算 · 计算机科学 2022-11-18 Chun-Chih Kuo , Ted Tsei Kuo , Chia-Yu Lin

Many studies integrate federated learning (FL) with self-supervised learning (SSL) to take advantage of raw data distributed across edge devices. However, edge devices often struggle with high computational and communication costs imposed…

机器学习 · 计算机科学 2025-12-02 Ye Lin Tun , Chu Myaet Thwal , Huy Q. Le , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

A key feature of federated learning (FL) is to preserve the data privacy of end users. However, there still exist potential privacy leakage in exchanging gradients under FL. As a result, recent research often explores the differential…

密码学与安全 · 计算机科学 2024-03-20 Yuntao Wang , Zhou Su , Yanghe Pan , Tom H Luan , Ruidong Li , Shui Yu

Federated learning (FL) enables a loose set of participating clients to collaboratively learn a global model via coordination by a central server and with no need for data sharing. Existing FL approaches that rely on complex algorithms with…

机器学习 · 计算机科学 2023-12-27 Kazim Ergun , Rishikanth Chandrasekaran , Tajana Rosing

Federated learning (FL) offers a solution to train a global machine learning model while still maintaining data privacy, without needing access to data stored locally at the clients. However, FL suffers performance degradation when client…

机器学习 · 计算机科学 2021-08-13 Zihan Chen , Kai Fong Ernest Chong , Tony Q. S. Quek

Federated learning (FL) has attracted much attention as a privacy-preserving distributed machine learning framework, where many clients collaboratively train a machine learning model by exchanging model updates with a parameter server…

机器学习 · 计算机科学 2022-09-09 Yuchang Sun , Jiawei Shao , Songze Li , Yuyi Mao , Jun Zhang

Secure and reliable medical image classification is crucial for effective patient treatment, but centralized models face challenges due to data and privacy concerns. Federated Learning (FL) enables privacy-preserving collaborations but…

图像与视频处理 · 电气工程与系统科学 2025-10-30 Gousia Habib , Aniket Bhardwaj , Ritvik Sharma , Shoeib Amin Banday , Ishfaq Ahmad Malik

Federated learning (FL) is a machine learning paradigm that targets model training without gathering the local data dispersed over various data sources. Standard FL, which employs a single server, can only support a limited number of users,…

机器学习 · 计算机科学 2024-02-29 Bin Wang , Jun Fang , Hongbin Li , Yonina C. Eldar

Federated recommendations leverage the federated learning (FL) techniques to make privacy-preserving recommendations. Though recent success in the federated recommender system, several vital challenges remain to be addressed: (i) The…

信息检索 · 计算机科学 2022-08-25 Sichun Luo , Yuanzhang Xiao , Yang Liu , Congduan Li , Linqi Song

Federated fine-tuning of on-device large language models (LLMs) mitigates privacy concerns by preventing raw data sharing. However, the intensive computational and memory demands pose significant challenges for resource-constrained edge…

网络与互联网体系结构 · 计算机科学 2026-02-13 Tao Li , Yulin Tang , Yiyang Song , Cong Wu , Xihui Liu , Pan Li , Xianhao Chen

Federated Learning is a collaborative training framework that leverages heterogeneous data distributed across a vast number of clients. Since it is practically infeasible to request and process all clients during the aggregation step,…

机器学习 · 计算机科学 2023-06-07 Michał Grudzień , Grigory Malinovsky , Peter Richtárik

Federated Learning (FL) enables multiple machines to collaboratively train a machine learning model without sharing of private training data. Yet, especially for heterogeneous models, a key bottleneck remains the transfer of knowledge…

计算机视觉与模式识别 · 计算机科学 2024-06-19 Sunny Soni , Aaqib Saeed , Yuki M. Asano

While federated learning (FL) improves the generalization of end-to-end autonomous driving by model aggregation, the conventional single-hop FL (SFL) suffers from slow convergence rate due to long-range communications among vehicles and…

机器人学 · 计算机科学 2024-05-09 Wei-Bin Kou , Shuai Wang , Guangxu Zhu , Bin Luo , Yingxian Chen , Derrick Wing Kwan Ng , Yik-Chung Wu