English
Related papers

Related papers: Efficient Wireless Federated Learning via Low-Rank…

200 papers

This paper studies power-efficient uplink transmission design for federated learning (FL) that employs over-the-air analog aggregation and multi-antenna beamforming at the server. We jointly optimize device transmit weights and receive…

Information Theory · Computer Science 2025-01-31 Faeze Moradi Kalarde , Min Dong , Ben Liang , Yahia A. Eldemerdash Ahmed , Ho Ting Cheng

Adaptive optimization has achieved notable success for distributed learning while extending adaptive optimizer to federated Learning (FL) suffers from severe inefficiency, including (i) rugged convergence due to inaccurate gradient…

Machine Learning · Computer Science 2023-08-02 Yan Sun , Li Shen , Hao Sun , Liang Ding , Dacheng Tao

Federated learning (FL) enables multiple devices to collaboratively learn a global model without sharing their personal data. In real-world applications, the different parties are likely to have heterogeneous data distribution and limited…

Machine Learning · Computer Science 2021-11-23 Ouiame Marnissi , Hajar El Hammouti , El Houcine Bergou

Federated Learning (FL) has emerged as a de facto machine learning area and received rapid increasing research interests from the community. However, catastrophic forgetting caused by data heterogeneity and partial participation poses…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Kangyang Luo , Xiang Li , Yunshi Lan , Ming Gao

Communication compression techniques are of growing interests for solving the decentralized optimization problem under limited communication, where the global objective is to minimize the average of local cost functions over a multi-agent…

Optimization and Control · Mathematics 2021-06-21 Yiwei Liao , Zhuorui Li , Kun Huang , Shi Pu

Federated learning (FL) has emerged as a promising learning paradigm in which only local model parameters (gradients) are shared. Private user data never leaves the local devices thus preserving data privacy. However, recent research has…

Cryptography and Security · Computer Science 2022-12-23 Xiaochan Xue , Moh Khalid Hasan , Shucheng Yu , Laxima Niure Kandel , Min Song

Federated learning (FL) is an emerging technique aiming at improving communication efficiency in distributed networks, where many clients often request to transmit their calculated parameters to an FL server simultaneously. However, in…

Optimization and Control · Mathematics 2023-02-20 Zimu Xu , Wei Tian , Yingxin Liu , Wanjun Ning , Jingjin Wu

This paper investigates the role of dimensionality reduction in efficient communication and differential privacy (DP) of the local datasets at the remote users for over-the-air computation (AirComp)-based federated learning (FL) model. More…

Information Theory · Computer Science 2021-06-02 Amir Sonee , Stefano Rini , Yu-Chih Huang

Federated learning (FL) is usually performed on resource-constrained edge devices, e.g., with limited memory for the computation. If the required memory to train a model exceeds this limit, the device will be excluded from the training.…

Machine Learning · Computer Science 2023-11-28 Kilian Pfeiffer , Ramin Khalili , Jörg Henkel

Federated learning (FL) has attracted increasing attention as a promising approach to driving a vast number of end devices with artificial intelligence. However, it is very challenging to guarantee the efficiency of FL considering the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Rui Mao , Carsten Maple , Stephen Jarvis

Deep learning models have become state of the art for natural language processing (NLP) tasks, however deploying these models in production system poses significant memory constraints. Existing compression methods are either lossy or…

Machine Learning · Computer Science 2018-11-05 Anish Acharya , Rahul Goel , Angeliki Metallinou , Inderjit Dhillon

Federated Learning (FL), as a privacy-preserving machine learning paradigm, trains a global model across devices without exposing local data. However, resource heterogeneity and inevitable stragglers in wireless networks severely impact the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Youquan Xian , Xiaoyun Gan , Chuanjian Yao , Dongcheng Li , Peng Wang , Peng Liu , Ying Zhao

Over-the-air federated learning (OTA-FL) has emerged as an efficient mechanism that exploits the superposition property of the wireless medium and performs model aggregation for federated learning in the air. OTA-FL is naturally sensitive…

Information Theory · Computer Science 2022-05-20 Jiayu Mao , Haibo Yang , Peiwen Qiu , Jia Liu , Aylin Yener

Federated learning (FL) is a new artificial intelligence concept that enables Internet-of-Things (IoT) devices to learn a collaborative model without sending the raw data to centralized nodes for processing. Despite numerous advantages, low…

Machine Learning · Computer Science 2022-06-22 Minh-Duong Nguyen , Sang-Min Lee , Quoc-Viet Pham , Dinh Thai Hoang , Diep N. Nguyen , Won-Joo Hwang

Federated Learning (FL) is a widely embraced paradigm for distilling artificial intelligence from distributed mobile data. However, the deployment of FL in mobile networks can be compromised by exposure to interference from neighboring…

Machine Learning · Computer Science 2024-11-25 Zhanwei Wang , Kaibin Huang , Yonina C. Eldar

Under the organization of the base station (BS), wireless federated learning (FL) enables collaborative model training among multiple devices. However, the BS is merely responsible for aggregating local updates during the training process,…

Information Theory · Computer Science 2023-10-05 Jingheng Zheng , Wanli Ni , Hui Tian , Deniz Gunduz , Tony Q. S. Quek , Zhu Han

Employing wireless systems with dual sensing and communications functionalities is becoming critical in next generation of wireless networks. In this paper, we propose a robust design for over-the-air federated edge learning (OTA-FEEL) that…

Emerging Technologies · Computer Science 2025-01-14 Saba Asaad , Ping Wang , Hina Tabassum

Federated learning (FL) is an emerging machine learning paradigm for training models across multiple edge devices holding local data sets, without explicitly exchanging the data. Recently, over-the-air (OTA) FL has been suggested to reduce…

Signal Processing · Electrical Eng. & Systems 2023-03-31 Tomer Gafni , Kobi Cohen , Yonina C. Eldar

Federated Learning (FL) refers to distributed protocols that avoid direct raw data exchange among the participating devices while training for a common learning task. This way, FL can potentially reduce the information on the local data…

Information Theory · Computer Science 2021-10-12 Dongzhu Liu , Osvaldo Simeone

In this paper, a novel secure and private over-the-air federated learning (SP-OTA-FL) framework is studied where noise is employed to protect data privacy and system security. Specifically, the privacy leakage of user data and the security…

Signal Processing · Electrical Eng. & Systems 2022-10-17 Na Yan , Kezhi Wang , Kangda Zhi , Cunhua Pan , Kok Keong Chai , H. Vincent Poor