English
Related papers

Related papers: Communication and Computation Efficient Split Fede…

200 papers

The conjunction of edge intelligence and the ever-growing Internet-of-Things (IoT) network heralds a new era of collaborative machine learning, with federated learning (FL) emerging as the most prominent paradigm. With the growing interest…

Machine Learning · Computer Science 2024-11-25 Nizar Masmoudi , Wael Jaafar

Federated learning (FL) is a promising learning paradigm that can tackle the increasingly prominent isolated data islands problem while keeping users' data locally with privacy and security guarantees. However, FL could result in…

Information Theory · Computer Science 2022-03-30 Peng Yang , Yuning Jiang , Ting Wang , Yong Zhou , Yuanming Shi , Colin N. Jones

Distributed machine learning (ML) over wireless networks hinges on accurate channel state information (CSI) and efficient exchange of high-dimensional model updates. These demands are governed by channel coherence time and bandwidth, which…

Information Theory · Computer Science 2026-03-10 Mehdi Karbalayghareh , David J. Love , Christopher G. Brinton

The longstanding goals of federated learning (FL) require rigorous privacy guarantees and low communication overhead while holding a relatively high model accuracy. However, simultaneously achieving all the goals is extremely challenging.…

Machine Learning · Computer Science 2021-06-02 He Yang

This paper investigates efficient distributed training of a Federated Learning~(FL) model over a wireless network of wireless devices. The communication iterations of the distributed training algorithm may be substantially deteriorated or…

The vision of 5G lies in providing high data rates, low latency (for the aim of near-real-time applications), significantly increased base station capacity, and near-perfect quality of service (QoS) for users, compared to LTE networks. In…

Networking and Internet Architecture · Computer Science 2022-09-14 Hakan Erdol , Xiaoyang Wang , Peizheng Li , Jonathan D. Thomas , Robert Piechocki , George Oikonomou , Rui Inacio , Abdelrahim Ahmad , Keith Briggs , Shipra Kapoor

Sixth-generation (6G) networks anticipate intelligently supporting a wide range of smart services and innovative applications. Such a context urges a heavy usage of Machine Learning (ML) techniques, particularly Deep Learning (DL), to…

Networking and Internet Architecture · Computer Science 2023-09-19 Houda Hafi , Bouziane Brik , Pantelis A. Frangoudis , Adlen Ksentini

Federated learning (FL), as a disruptive machine learning paradigm, enables the collaborative training of a global model over decentralized local datasets without sharing them. It spans a wide scope of applications from Internet-of-Things…

Signal Processing · Electrical Eng. & Systems 2022-04-01 Yuhan Yang , Yong Zhou , Youlong Wu , Yuanming Shi

The traditional framework of federated learning (FL) requires each client to re-train their models in every iteration, making it infeasible for resource-constrained mobile devices to train deep-learning (DL) models. Split learning (SL)…

Machine Learning · Computer Science 2023-03-21 Manas Wadhwa , Gagan Raj Gupta , Ashutosh Sahu , Rahul Saini , Vidhi Mittal

Federated Learning (FL) since proposed has been applied in many fields, such as credit assessment, medical, etc. Because of the difference in the network or computing resource, the clients may not update their gradients at the same time…

Machine Learning · Computer Science 2021-11-19 Zhicheng Zhou , Hailong Chen , Kunhua Li , Fei Hu , Bingjie Yan , Jieren Cheng , Xuyan Wei , Bernie Liu , Xiulai Li , Fuwen Chen , Yongji Sui

Federated Learning (FL) is a popular collaborative learning scheme involving multiple clients and a server. FL focuses on protecting clients' data but turns out to be highly vulnerable to Intellectual Property (IP) threats. Since FL…

Machine Learning · Computer Science 2023-03-16 Jingtao Li , Adnan Siraj Rakin , Xing Chen , Li Yang , Zhezhi He , Deliang Fan , Chaitali Chakrabarti

We compare communication efficiencies of two compelling distributed machine learning approaches of split learning and federated learning. We show useful settings under which each method outperforms the other in terms of communication…

Machine Learning · Computer Science 2019-09-23 Abhishek Singh , Praneeth Vepakomma , Otkrist Gupta , Ramesh Raskar

This paper investigates a communication-efficient split learning (SL) over multiple-input multiple-output (MIMO) communication system. In particular, we mathematically decompose the inter-layer connection of a neural network (NN) to a…

Signal Processing · Electrical Eng. & Systems 2022-10-11 Yuzhi Yang , Zhaoyang Zhang , Zhaohui Yang

Federated learning (FL) enables mobile devices to collaboratively learn a shared prediction model while keeping data locally. However, there are two major research challenges to practically deploy FL over mobile devices: (i) frequent…

Machine Learning · Computer Science 2022-08-16 Liang Li , Chenpei Huang , Dian Shi , Hao Wang , Xiangwei Zhou , Minglei Shu , Miao Pan

With the development of edge networks and mobile computing, the need to serve heterogeneous data sources at the network edge requires the design of new distributed machine learning mechanisms. As a prevalent approach, Federated Learning…

Machine Learning · Computer Science 2024-06-04 Yilin Zheng , Atilla Eryilmaz

The communication bottleneck of over-the-air federated learning (OA-FL) lies in uploading the gradients of local learning models. In this paper, we study the reduction of the communication overhead in the gradients uploading by using the…

Signal Processing · Electrical Eng. & Systems 2023-04-11 Chenxi Zhong , Xiaojun Yuan

One-shot Federated Learning (OFL) significantly reduces communication costs in FL by aggregating trained models only once. However, the performance of advanced OFL methods is far behind the normal FL. In this work, we provide a causal view…

Machine Learning · Computer Science 2024-10-29 Zhenheng Tang , Yonggang Zhang , Peijie Dong , Yiu-ming Cheung , Amelie Chi Zhou , Bo Han , Xiaowen Chu

Intelligent, large-scale IoT ecosystems have become possible due to recent advancements in sensing technologies, distributed learning, and low-power inference in embedded devices. In traditional cloud-centric approaches, raw data is…

Machine Learning · Computer Science 2023-05-16 Theo Chow , Usman Raza , Ioannis Mavromatis , Aftab Khan

Over-the-air federated learning (OTA-FL) provides bandwidth-efficient learning by leveraging the inherent superposition property of wireless channels. Personalized federated learning balances performance for users with diverse datasets,…

Information Theory · Computer Science 2024-01-23 Jiayu Mao , Aylin Yener

Over-the-air federated learning (OTA-FL) exploits the inherent superposition property of wireless channels to integrate the communication and model aggregation. Though a naturally promising framework for wireless federated learning, it…

Information Theory · Computer Science 2023-09-20 Jiayu Mao , Aylin Yener