English
Related papers

Related papers: Right Reward Right Time for Federated Learning

200 papers

Federated learning (FL) is typically performed in a synchronous parallel manner, where the involvement of a slow client delays a training iteration. Current FL systems employ a participant selection strategy to select fast clients with…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-22 Zhifeng Jiang , Wei Wang , Baochun Li , Bo Li

Federated learning (FL) is a machine learning paradigm where multiple clients collaborate to optimize a single global model using their private data. The global model is maintained by a central server that orchestrates the FL training…

Machine Learning · Computer Science 2024-02-14 Waqwoya Abebe , Pablo Munoz , Ali Jannesari

Understanding spatial dynamics and semantics in point cloud is fundamental for comprehensive 3D comprehension. While reinforcement learning algorithms such as Group Relative Policy Optimization (GRPO) have recently achieved remarkable…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yankai Wang , Yiding Sun , Qirui Wang , Pengbo Li , Chaoyi Lu , Dongxu Zhang

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

Federated learning (FL) trains a shared model from updates contributed by distributed clients, often implicitly assuming that contributing clients are representative of the target population. In practice, this representativeness assumption…

Machine Learning · Computer Science 2026-04-30 Gota Morishita

Large language models (LLMs) excel at complex tasks thanks to advances in their reasoning abilities. However, existing methods overlook the trade-off between reasoning effectiveness and efficiency, often encouraging unnecessarily long…

Machine Learning · Computer Science 2025-10-16 Jingyao Wang , Wenwen Qiang , Zeen Song , Changwen Zheng , Hui Xiong

Reward specification plays a central role in reinforcement learning (RL), guiding the agent's behavior. To express non-Markovian rewards, formalisms such as reward machines have been introduced to capture dependencies on histories. However,…

Artificial Intelligence · Computer Science 2026-05-13 Rajarshi Roy , Anirban Majumdar , Ritam Raha , David Parker , Marta Kwiatkowska

Process Reward Models (PRMs) have emerged as a promising approach to enhance the reasoning capabilities of large language models (LLMs) by guiding their step-by-step reasoning toward a final answer. However, existing PRMs either treat each…

Machine Learning · Computer Science 2026-03-02 Zheng Zhang , Ziwei Shan , Kaitao Song , Yexin Li , Kan Ren

Offline reinforcement learning (RL) aims to learn an optimal policy from pre-collected and labeled datasets, which eliminates the time-consuming data collection in online RL. However, offline RL still bears a large burden of…

Machine Learning · Computer Science 2023-10-17 Jinxin Liu , Lipeng Zu , Li He , Donglin Wang

Federated learning (FL) is a machine learning approach where nodes collaboratively train a global model. As more nodes participate in a round of FL, the effectiveness of individual model updates by nodes also diminishes. In this study, we…

Machine Learning · Computer Science 2025-03-12 Akash Dhasade , Anne-Marie Kermarrec , Tuan-Anh Nguyen , Rafael Pires , Martijn de Vos

Federated learning (FL) is a distributed paradigm that coordinates massive local clients to collaboratively train a global model via stage-wise local training processes on the heterogeneous dataset. Previous works have implicitly studied…

Machine Learning · Computer Science 2026-04-15 Li Shen , Yan Sun , Dacheng Tao

Federated learning (FL) is a useful tool that enables the training of machine learning models over distributed data without having to collect data centrally. When deploying FL in constrained wireless environments, however, intermittent…

Machine Learning · Computer Science 2025-03-04 Jake B. Perazzone , Shiqiang Wang , Mingyue Ji , Kevin Chan

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

Collaborative learning (CL) enables multiple participants to jointly train machine learning (ML) models on decentralized data sources without raw data sharing. While the primary goal of CL is to maximize the expected accuracy gain for each…

Machine Learning · Computer Science 2025-10-02 Nurbek Tastan , Samuel Horvath , Karthik Nandakumar

In this work, we propose a novel joint client scheduling and resource block (RB) allocation policy to minimize the loss of accuracy in federated learning (FL) over wireless compared to a centralized training-based solution, under imperfect…

Networking and Internet Architecture · Computer Science 2020-02-07 Madhusanka Manimel Wadu , Sumudu Samarakoon , Mehdi Bennis

The paper studies a fundamental federated learning (FL) problem involving multiple clients with heterogeneous constrained resources. Compared with the numerous training parameters, the computing and communication resources of clients are…

Machine Learning · Computer Science 2024-06-21 Ruirui Zhang , Xingze Wu , Yifei Zou , Zhenzhen Xie , Peng Li , Xiuzhen Cheng , Dongxiao Yu

Federated Learning (FL) is a widespread and well adopted paradigm of decentralized learning that allows training one model from multiple sources without the need to directly transfer data between participating clients. Since its inception…

Machine Learning · Computer Science 2025-04-30 Maciej Krzysztof Zuziak , Roberto Pellungrini , Salvatore Rinzivillo

Federated Learning (FL) is a distributed machine learning approach to learn models on decentralized heterogeneous data, without the need for clients to share their data. Many existing FL approaches assume that all clients have equal…

Machine Learning · Computer Science 2023-10-10 Aditya Narayan Ravi , Ilan Shomorony

Blockchain-based federated learning (BCFL) has recently gained tremendous attention because of its advantages such as decentralization and privacy protection of raw data. However, there has been few research focusing on the allocation of…

Cryptography and Security · Computer Science 2022-02-23 Zhilin Wang , Qin Hu , Ruinian Li , Minghui Xu , Zehui Xiong

Federated Learning (FL) facilitates collaborative model training across distributed clients while ensuring data privacy. Traditionally, FL relies on a centralized server to coordinate learning, which creates bottlenecks and a single point…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Phani Sahasra Akkinepally , Manaswini Piduguralla , Sushant Joshi , Sathya Peri , Sandeep Kulkarni