English
Related papers

Related papers: Federated Multi-Sequence Stochastic Approximation …

200 papers

The minimax problems arise throughout machine learning applications, ranging from adversarial training and policy evaluation in reinforcement learning to AUROC maximization. To address the large-scale data challenges across multiple clients…

Machine Learning · Computer Science 2023-10-06 Xidong Wu , Jianhui Sun , Zhengmian Hu , Aidong Zhang , Heng Huang

We present a novel theoretical analysis of Federated SARSA (FedSARSA) with linear function approximation and local training. We establish convergence guarantees for FedSARSA in the presence of heterogeneity, both in local transitions and…

Machine Learning · Computer Science 2026-02-05 Paul Mangold , Eloïse Berthier , Eric Moulines

Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still…

Machine Learning · Computer Science 2023-03-10 Xidong Wu , Feihu Huang , Zhengmian Hu , Heng Huang

Motivated by collaborative reinforcement learning (RL) and optimization with time-correlated data, we study a generic federated stochastic approximation problem involving $M$ agents, where each agent is characterized by an agent-specific…

Machine Learning · Computer Science 2025-04-17 Feng Zhu , Aritra Mitra , Robert W. Heath

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning, but faces challenges with heterogeneous data distributions across clients. This paper presents FedSat, a novel FL approach…

Machine Learning · Computer Science 2024-12-31 Sujit Chowdhury , Raju Halder

Federated Learning (FL) is a collaborative machine learning technique to train a global model without obtaining clients' private data. The main challenges in FL are statistical diversity among clients, limited computing capability among…

Machine Learning · Computer Science 2023-03-07 Xiaofeng Liu , Yinchuan Li , Qing Wang , Xu Zhang , Yunfeng Shao , Yanhui Geng

We study the personalized federated learning problem under asynchronous updates. In this problem, each client seeks to obtain a personalized model that simultaneously outperforms local and global models. We consider two optimization-based…

Machine Learning · Computer Science 2023-10-05 Mohammad Taha Toghani , Soomin Lee , César A. Uribe

Group Relative Policy Optimization (GRPO) has recently emerged as an effective approach for improving the reasoning capabilities of large language models through online multi-objective reinforcement learning. While personalization on…

Machine Learning · Computer Science 2026-02-03 Ziyao Wang , Daeun Jung , Yexiao He , Guoheng Sun , Zheyu Shen , Myungjin Lee , Ang Li

In federated learning (FL), the multi-step update and data heterogeneity among clients often lead to a loss landscape with sharper minima, degenerating the performance of the resulted global model. Prevalent federated approaches incorporate…

Machine Learning · Computer Science 2024-05-30 Ziqing Fan , Shengchao Hu , Jiangchao Yao , Gang Niu , Ya Zhang , Masashi Sugiyama , Yanfeng Wang

In the federated learning setting, multiple clients jointly train a model under the coordination of the central server, while the training data is kept on the client to ensure privacy. Normally, inconsistent distribution of data across…

Machine Learning · Computer Science 2020-12-21 Wei Huang , Tianrui Li , Dexian Wang , Shengdong Du , Junbo Zhang

Stochastic approximation (SA) algorithms have been widely applied in minimization problems when the loss functions and/or the gradient information are only accessible through noisy evaluations. Stochastic gradient (SG) descent---a…

Optimization and Control · Mathematics 2019-08-26 Jingyi Zhu , Long Wang , James C. Spall

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. While the SGD-based FL algorithms have demonstrated considerable success in the past, there is a growing trend towards…

Machine Learning · Computer Science 2024-07-29 Yujia Wang , Shiqiang Wang , Songtao Lu , Jinghui Chen

Federated learning faces critical challenges in balancing communication efficiency and model accuracy. One key issue lies in the approximation of update errors without incurring high computational costs. In this paper, we propose a…

Machine Learning · Computer Science 2025-05-29 Ganglou Xu

Recent demands on data privacy have called for federated learning (FL) as a new distributed learning paradigm in massive and heterogeneous networks. Although many FL algorithms have been proposed, few of them have considered the matrix…

Machine Learning · Computer Science 2020-11-02 Shuai Wang , Tsung-Hui Chang

Sequence alignment supports numerous tasks in bioinformatics, natural language processing, pattern recognition, social sciences, and others fields. While the alignment of two sequences may be performed swiftly in many applications, the…

Data Structures and Algorithms · Computer Science 2021-12-06 Eloi Araujo , Luiz Rozante , Diego P. Rubert , Fabio V. Martinez

Multi-user spatial modulation (SM) assisted by sparse code multiple access (SCMA) has been recently proposed to provide uplink high spectral efficiency transmission. The message passing algorithm (MPA) is employed to detect the transmitted…

Signal Processing · Electrical Eng. & Systems 2020-08-19 Ibrahim Al-Nahhal , Octavia A. Dobre , Salama Ikki

Federated learning (FL) aims to minimize the communication complexity of training a model over heterogeneous data distributed across many clients. A common approach is local methods, where clients take multiple optimization steps over local…

Machine Learning · Computer Science 2023-04-18 Charlie Hou , Kiran K. Thekumparampil , Giulia Fanti , Sewoong Oh

Federated Learning (FL) has emerged as an excellent solution for performing deep learning on different data owners without exchanging raw data. However, statistical heterogeneity in FL presents a key challenge, leading to a phenomenon of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junfeng Liao , Sifan Wang , Ye Yuan , Riquan Zhang

This paper proposes an algorithm for Federated Learning (FL) with a two-layer structure that achieves both variance reduction and a faster convergence rate to an optimal solution in the setting where each agent has an arbitrary probability…

Machine Learning · Computer Science 2023-04-04 M. R. Rostami , S. S. Kia

Federated semantic segmentation enables pixel-level classification in images through collaborative learning while maintaining data privacy. However, existing research commonly overlooks the fine-grained class relationships within the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Xiaoyang Yu , Xiaoming Wu , Xin Wang , Dongrun Li , Ming Yang , Peng Cheng