English
Related papers

Related papers: Distributed Non-Convex Optimization with Sublinear…

200 papers

Federated learning is a distributed and privacy-preserving approach to train a statistical model collaboratively from decentralized data of different parties. However, when datasets of participants are not independent and identically…

Machine Learning · Computer Science 2023-01-24 Li Ju , Tianru Zhang , Salman Toor , Andreas Hellander

Federated Learning enables visual models to be trained on-device, bringing advantages for user privacy (data need never leave the device), but challenges in terms of data diversity and quality. Whilst typical models in the datacenter are…

Machine Learning · Computer Science 2020-07-20 Tzu-Ming Harry Hsu , Hang Qi , Matthew Brown

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

We propose an innovative algorithm for non-convex composite federated learning that decouples the proximal operator evaluation and the communication between server and clients. Moreover, each client uses local updates to communicate less…

Machine Learning · Computer Science 2025-02-07 Jiaojiao Zhang , Jiang Hu , Mikael Johansson

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a…

Machine Learning · Computer Science 2022-05-06 Jake Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Federated Learning is an emerging learning paradigm that allows training models from samples distributed across a large network of clients while respecting privacy and communication restrictions. Despite its success, federated learning…

Machine Learning · Computer Science 2022-06-07 Isidoros Tziotis , Zebang Shen , Ramtin Pedarsani , Hamed Hassani , Aryan Mokhtari

Federated learning is highly valued due to its high-performance computing in distributed environments while safeguarding data privacy. To address resource heterogeneity, researchers have proposed a semi-asynchronous federated learning…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Yunbo Li , Jiaping Gui , Yue Wu

Federated Learning (FL) aims to train a global inference model from remotely distributed clients, gaining popularity due to its benefit of improving data privacy. However, traditional FL often faces challenges in practical applications,…

Machine Learning · Computer Science 2025-10-24 Insu Jeon , Minui Hong , Junhyeog Yun , Gunhee Kim

Although Federated Learning (FL) enables global model training across clients without compromising their raw data, due to the unevenly distributed data among clients, existing Federated Averaging (FedAvg)-based methods suffer from the…

Machine Learning · Computer Science 2024-07-08 Ming Hu , Zhihao Yue , Xiaofei Xie , Cheng Chen , Yihao Huang , Xian Wei , Xiang Lian , Yang Liu , Mingsong Chen

Recent attacks have shown that user data can be recovered from FedSGD updates, thus breaking privacy. However, these attacks are of limited practical relevance as federated learning typically uses the FedAvg algorithm. Compared to FedSGD,…

Machine Learning · Computer Science 2022-11-02 Dimitar I. Dimitrov , Mislav Balunović , Nikola Konstantinov , Martin Vechev

Federated Learning (FL) has shown great potential as a privacy-preserving solution to learning from decentralized data that are only accessible to end devices (i.e., clients). In many scenarios, however, a large proportion of the clients…

Machine Learning · Computer Science 2022-01-31 Wentai Wu , Ligang He , Weiwei Lin , Carsten Maple

In federated optimization, heterogeneity in the clients' local datasets and computation speeds results in large variations in the number of local updates performed by each client in each communication round. Naive weighted aggregation of…

Machine Learning · Computer Science 2020-07-16 Jianyu Wang , Qinghua Liu , Hao Liang , Gauri Joshi , H. Vincent Poor

Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is…

Machine Learning · Computer Science 2022-01-27 Canh T. Dinh , Nguyen H. Tran , Tuan Dung Nguyen

Over the past few years, Federated Learning (FL) has become a popular distributed machine learning paradigm. FL involves a group of clients with decentralized data who collaborate to learn a common model under the coordination of a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Jieming Bian , Lei Wang , Kun Yang , Cong Shen , Jie Xu

Pervasive computing promotes the installation of connected devices in our living spaces in order to provide services. Two major developments have gained significant momentum recently: an advanced use of edge resources and the integration of…

Machine Learning · Computer Science 2021-10-22 Sannara Ek , François Portet , Philippe Lalanda , German Vega

Federated learning (FL), as a collaborative distributed training paradigm with several edge computing devices under the coordination of a centralized server, is plagued by inconsistent local stationary points due to the heterogeneity of the…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Yixing Liu , Yan Sun , Zhengtao Ding , Li Shen , Bo Liu , Dacheng Tao

Federated learning involves training statistical models in massive, heterogeneous networks. Naively minimizing an aggregate loss function in such a network may disproportionately advantage or disadvantage some of the devices. In this work,…

Machine Learning · Computer Science 2020-02-18 Tian Li , Maziar Sanjabi , Ahmad Beirami , Virginia Smith

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

Mobile crowdsensing has gained significant attention in recent years and has become a critical paradigm for emerging Internet of Things applications. The sensing devices continuously generate a significant quantity of data, which provide…

Machine Learning · Computer Science 2020-02-07 Zhouyuan Huo , Qian Yang , Bin Gu , Lawrence Carin. Heng Huang

Federated learning (FL) is a fast-developing technique that allows multiple workers to train a global model based on a distributed dataset. Conventional FL (FedAvg) employs gradient descent algorithm, which may not be efficient enough.…

Machine Learning · Computer Science 2022-10-27 Zhengjie Yang , Wei Bao , Dong Yuan , Nguyen H. Tran , Albert Y. Zomaya