English
Related papers

Related papers: SwiftAgg+: Achieving Asymptotically Optimal Commun…

200 papers

Secure aggregation, which is a core component of federated learning, aggregates locally trained models from distributed users at a central server. The ``secure'' nature of such aggregation consists of the fact that no information about the…

Information Theory · Computer Science 2023-02-01 Kai Wan , Xin Yao , Hua Sun , Mingyue Ji , Giuseppe Caire

Federated learning (FL) typically relies on synchronous training, which is slow due to stragglers. While asynchronous training handles stragglers efficiently, it does not ensure privacy due to the incompatibility with the secure aggregation…

Machine Learning · Computer Science 2022-02-03 Jinhyun So , Ramy E. Ali , Başak Güler , A. Salman Avestimehr

Federated fine-tuning of on-device large language models (LLMs) mitigates privacy concerns by preventing raw data sharing. However, the intensive computational and memory demands pose significant challenges for resource-constrained edge…

Networking and Internet Architecture · Computer Science 2026-02-13 Tao Li , Yulin Tang , Yiyang Song , Cong Wu , Xihui Liu , Pan Li , Xianhao Chen

Federated Learning enables one to jointly train a machine learning model across distributed clients holding sensitive datasets. In real-world settings, this approach is hindered by expensive communication and privacy concerns. Both of these…

Machine Learning · Statistics 2021-10-19 Constance Beguier , Mathieu Andreux , Eric W. Tramel

Learning over massive data stored in different locations is essential in many real-world applications. However, sharing data is full of challenges due to the increasing demands of privacy and security with the growing use of smart mobile…

Machine Learning · Computer Science 2022-10-11 Jinjin Xu , Wenli Du , Ran Cheng , Wangli He , Yaochu Jin

Federated learning (FL) has attracted tremendous attentions in recent years due to its privacy preserving measures and great potentials in some distributed but privacy-sensitive applications like finance and health. However, high…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-14 Yuzhu Mao , Zihao Zhao , Guangfeng Yan , Yang Liu , Tian Lan , Linqi Song , Wenbo Ding

Federated learning is a collaborative method that aims to preserve data privacy while creating AI models. Current approaches to federated learning tend to rely heavily on secure aggregation protocols to preserve data privacy. However, to…

Cryptography and Security · Computer Science 2022-11-14 John Reuben Gilbert

In 6G mobile communication systems, various AI-based network functions and applications have been standardized. Federated learning (FL) is adopted as the core learning architecture for 6G systems to avoid privacy leakage from mobile user…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Seyoung Ahn , Soohyeong Kim , Yongseok Kwon , Joohan Park , Jiseung Youn , Sunghyun Cho

In many distributed learning setups such as federated learning (FL), client nodes at the edge use individually collected data to compute local gradients and send them to a central master server. The master server then aggregates the…

Information Theory · Computer Science 2023-04-18 Kai Liang , Songze Li , Ming Ding , Youlong Wu

Recent advances in differentially private federated learning (DPFL) algorithms have found that using correlated noise across the rounds of federated learning (DP-FTRL) yields provably and empirically better accuracy than using independent…

Cryptography and Security · Computer Science 2024-10-16 Marshall Ball , James Bell-Clark , Adria Gascon , Peter Kairouz , Sewoong Oh , Zhiye Xie

With the prevalence of Large Learning Models (LLM), Split Federated Learning (SFL), which divides a learning model into server-side and client-side models, has emerged as an appealing technology to deal with the heavy computational burden…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-03 Yipeng Liang , Qimei Chen , Guangxu Zhu , Muhammad Kaleem Awan , Hao Jiang

Federated learning (FL) involves training a model over massive distributed devices, while keeping the training data localized. This form of collaborative learning exposes new tradeoffs among model convergence speed, model accuracy, balance…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-31 Zheng Chai , Yujing Chen , Ali Anwar , Liang Zhao , Yue Cheng , Huzefa Rangwala

Federated Learning allows multiple parties to jointly train a deep learning model on their combined data, without any of the participants having to reveal their local data to a centralized server. This form of privacy-preserving…

Machine Learning · Computer Science 2019-03-08 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

The rapid proliferation of the Internet of Things (IoT) has ushered in transformative connectivity between physical devices and the digital realm. Nonetheless, the escalating threat of Distributed Denial of Service (DDoS) attacks…

Cryptography and Security · Computer Science 2024-03-19 Ghazaleh Shirvani , Saeid Ghasemshirazi , Mohammad Ali Alipour

Non-IID data distribution across clients and poisoning attacks are two main challenges in real-world federated learning (FL) systems. While both of them have attracted great research interest with specific strategies developed, no known…

Machine Learning · Computer Science 2022-11-22 Yueqi Xie , Weizhong Zhang , Renjie Pi , Fangzhao Wu , Qifeng Chen , Xing Xie , Sunghun Kim

Federated learning (FL) is capable of performing large distributed machine learning tasks across multiple edge users by periodically aggregating trained local parameters. To address key challenges of enabling FL over a wireless fog-cloud…

Machine Learning · Computer Science 2024-10-28 Van-Dinh Nguyen , Symeon Chatzinotas , Bjorn Ottersten , Trung Q. Duong

To protect privacy and meet legal regulations, federated learning (FL) has gained significant attention for training speech-to-text (S2T) systems, including automatic speech recognition (ASR) and speech translation (ST). However, the…

Computation and Language · Computer Science 2025-01-22 Yichao Du , Zhirui Zhang , Linan Yue , Xu Huang , Yuqing Zhang , Tong Xu , Linli Xu , Enhong Chen

Secure aggregation (SecAgg) is a commonly-used privacy-enhancing mechanism in federated learning, affording the server access only to the aggregate of model updates while safeguarding the confidentiality of individual updates. Despite…

Machine Learning · Computer Science 2024-07-16 Khac-Hoang Ngo , Johan Östman , Giuseppe Durisi , Alexandre Graell i Amat

It is well understood that client-master communication can be a primary bottleneck in Federated Learning. In this work, we address this issue with a novel client subsampling scheme, where we restrict the number of clients allowed to…

Machine Learning · Computer Science 2022-08-23 Wenlin Chen , Samuel Horvath , Peter Richtarik

Federated learning (FL) enables on-device training over distributed networks consisting of a massive amount of modern smart devices, such as smartphones and IoT (Internet of Things) devices. However, the leading optimization algorithm in…

Machine Learning · Computer Science 2019-09-04 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun