English
Related papers

Related papers: GP-FL: Model-Based Hessian Estimation for Second-O…

200 papers

In this paper, the problem of training federated learning (FL) algorithms over a realistic wireless network is studied. In particular, in the considered model, wireless users execute an FL algorithm while training their local FL models…

Networking and Internet Architecture · Computer Science 2022-02-01 Mingzhe Chen , Zhaohui Yang , Walid Saad , Changchuan Yin , H. Vincent Poor , Shuguang Cui

Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However,…

Machine Learning · Computer Science 2022-11-28 Mingjia Shi , Yuhao Zhou , Qing Ye , Jiancheng Lv

Federated learning (FL) has recently emerged as an attractive decentralized solution for wireless networks to collaboratively train a shared model while keeping data localized. As a general approach, existing FL methods tend to assume…

Machine Learning · Computer Science 2021-04-02 Francesco Pase , Marco Giordani , Michele Zorzi

Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model. This design is not well-suited for scenarios involving…

Machine Learning · Computer Science 2024-04-22 Liping Yi , Han Yu , Zhuan Shi , Gang Wang , Xiaoguang Liu , Lizhen Cui , Xiaoxiao Li

Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model…

Information Theory · Computer Science 2023-02-14 Yujia Mu , Cong Shen

Federated Learning (FL) involves training a model over a dataset distributed among clients, with the constraint that each client's dataset is localized and possibly heterogeneous. In FL, small and noisy datasets are common, highlighting the…

Machine Learning · Computer Science 2024-01-11 Mohsin Hasan , Guojun Zhang , Kaiyang Guo , Xi Chen , Pascal Poupart

Latent Factor (LF) models are effective in representing high-dimension and sparse (HiDS) data via low-rank matrices approximation. Hessian-free (HF) optimization is an efficient method to utilizing second-order information of an LF model's…

Machine Learning · Computer Science 2022-08-15 Jialiang Wang , Yurong Zhong , Weiling Li

Federated learning (FL) is a framework for distributed learning of centralized models. In FL, a set of edge devices train a model using their local data, while repeatedly exchanging their trained updates with a central server. This…

Machine Learning · Computer Science 2021-08-11 Tomer Sery , Nir Shlezinger , Kobi Cohen , Yonina C. Eldar

Federated learning (FL), as an emerging edge artificial intelligence paradigm, enables many edge devices to collaboratively train a global model without sharing their private data. To enhance the training efficiency of FL, various…

Machine Learning · Computer Science 2022-11-23 Wenzhi Fang , Ziyi Yu , Yuning Jiang , Yuanming Shi , Colin N. Jones , Yong Zhou

Federated learning (FL) enables multiple clients to train a machine learning model collaboratively without exchanging their local data. Federated unlearning is an inverse FL process that aims to remove a specified target client's…

Machine Learning · Computer Science 2023-02-27 Guanghao Li , Li Shen , Yan Sun , Yue Hu , Han Hu , Dacheng Tao

While network coverage maps continue to expand, many devices located in remote areas remain unconnected to terrestrial communication infrastructures, preventing them from getting access to the associated data-driven services. In this paper,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-27 Dong-Jun Han , Seyyedali Hosseinalipour , David J. Love , Mung Chiang , Christopher G. Brinton

Federated learning (FL) refers to the learning paradigm that trains machine learning models directly in the decentralized systems consisting of smart edge devices without transmitting the raw data, which avoids the heavy communication costs…

Machine Learning · Computer Science 2020-12-17 Xin Yao , Lifeng Sun

Federated learning (FL) and federated distillation (FD) are distributed learning paradigms that train UE models with enhanced privacy, each offering different trade-offs between noise robustness and learning speed. To mitigate their…

Machine Learning · Computer Science 2026-01-09 Yongjun Kim , Hyeongjun Park , Hwanjin Kim , Junil Choi

Federated learning client selection is crucial for determining participant clients while balancing model accuracy and communication efficiency. Existing methods have limitations in handling data heterogeneity, computational burdens, and…

Machine Learning · Computer Science 2024-05-28 Shijie Na , Yuzhi Liang , Siu-Ming Yiu

In this paper, we consider the federated learning (FL) problem in the presence of communication errors. We model the link between the devices and the central node (CN) by a packet erasure channel, where the local parameters from devices are…

Machine Learning · Computer Science 2022-04-13 Mahyar Shirvanimoghaddam , Ayoob Salari , Yifeng Gao , Aradhika Guha

Federated Learning (FL) emerged as a learning method to enable the server to train models over data distributed among various clients. These clients are protective about their data being leaked to the server, any other client, or an…

Machine Learning · Computer Science 2025-01-27 Uday Bhaskar , Varul Srivastava , Avyukta Manjunatha Vummintala , Naresh Manwani , Sujit Gujar

With huge amounts of data explosively increasing in the mobile edge, over-the-air federated learning (OA-FL) emerges as a promising technique to reduce communication costs and privacy leak risks. However, when devices in a relatively large…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Xiangyu Zhong , Xiaojun Yuan , Huiyuan Yang , Chenxi Zhong

Federated Learning (FL) allows devices to train a global machine learning model without sharing data. In the context of wireless networks, the inherently unreliable nature of the transmission channel introduces delays and errors that…

Networking and Internet Architecture · Computer Science 2024-08-05 Renan R. de Oliveira , Kleber V. Cardoso , Antonio Oliveira-Jr

Second-order methods for neural network optimization have several advantages over methods based on first-order gradient descent, including better scaling to large mini-batch sizes and fewer updates needed for convergence. But they are…

Machine Learning · Computer Science 2017-12-21 Huishuai Zhang , Caiming Xiong , James Bradbury , Richard Socher

The newly emerging federated learning (FL) framework offers a new way to train machine learning models in a privacy-preserving manner. However, traditional FL algorithms are based on an event-triggered aggregation, which suffers from…

Machine Learning · Computer Science 2022-05-03 Xiaokang Zhou , Yansha Deng , Huiyun Xia , Shaochuan Wu , Mehdi Bennis