English
Related papers

Related papers: Proxy Experience Replay: Federated Distillation fo…

200 papers

Recent analyses question whether reinforcement learning (RL) is responsible for strong reasoning in large language models (LLMs). At the same time, distillation and inference-time sampling, including power sampling, have emerged as…

Machine Learning · Computer Science 2026-05-07 Akiyoshi Tomihari , Issei Sato

Federated representation learning (FRL) aims to learn personalized federated models with effective feature extraction from local data. FRL algorithms that share the majority of the model parameters face significant challenges with huge…

Machine Learning · Computer Science 2024-10-15 Haolin Yu , Guojun Zhang , Pascal Poupart

The paper considers independent reinforcement learning (IRL) for multi-agent collaborative decision-making in the paradigm of federated learning (FL). However, FL generates excessive communication overheads between agents and a remote…

Machine Learning · Computer Science 2023-05-30 Xing Xu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Reinforcement learning (RL) is a powerful technique for training intelligent agents, but understanding why these agents make specific decisions can be quite challenging. This lack of transparency in RL models has been a long-standing…

Machine Learning · Computer Science 2024-04-02 Wenhao Lu , Xufeng Zhao , Thilo Fryen , Jae Hee Lee , Mengdi Li , Sven Magg , Stefan Wermter

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Next Generation (NextG) networks are expected to support demanding tactile internet applications such as augmented reality and connected autonomous vehicles. Whereas recent innovations bring the promise of larger link capacity, their…

Machine Learning · Computer Science 2021-12-08 Peyman Tehrani , Francesco Restuccia , Marco Levorato

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized…

Multiagent Systems · Computer Science 2019-06-07 Maximilian Hüttenrauch , Adrian Šošić , Gerhard Neumann

Federated reinforcement learning (FRL) enables distributed learning of optimal policies while preserving local data privacy through gradient sharing.However, FRL faces the risk of data privacy leaks, where attackers exploit shared gradients…

Machine Learning · Computer Science 2025-12-02 Shenghong He

Deep reinforcement learning (DRL) has delivered strong results in domains such as Atari and Go, but it still suffers from high sample cost and weak transfer beyond the training setting. A common response is to reuse information from…

Machine Learning · Computer Science 2026-05-05 Ujjwal Patil , Javad Ghofrani

Using privileged information during training can improve the sample efficiency and performance of machine learning systems. This paradigm has been applied to reinforcement learning (RL), primarily in the form of distillation or auxiliary…

Machine Learning · Computer Science 2020-05-20 Pierre-Alexandre Kamienny , Kai Arulkumaran , Feryal Behbahani , Wendelin Boehmer , Shimon Whiteson

Deep reinforcement learning has demonstrated increasing capabilities for continuous control problems, including agents that can move with skill and agility through their environment. An open problem in this setting is that of developing…

Machine Learning · Computer Science 2018-02-14 Glen Berseth , Cheng Xie , Paul Cernek , Michiel Van de Panne

Recent progress in Quality Diversity Reinforcement Learning (QD-RL) has enabled learning a collection of behaviorally diverse, high performing policies. However, these methods typically involve storing thousands of policies, which results…

Machine Learning · Computer Science 2023-06-27 Shashank Hegde , Sumeet Batra , K. R. Zentner , Gaurav S. Sukhatme

In this paper, we introduce DistDD, a novel approach within the federated learning framework that reduces the need for repetitive communication by distilling data directly on clients' devices. Unlike traditional federated learning that…

Machine Learning · Computer Science 2024-10-14 Peiran Wang , Haohan Wang

In federated healthcare systems, Federated Class-Incremental Learning (FCIL) has emerged as a key paradigm, enabling continuous adaptive model learning among distributed clients while safeguarding data privacy. However, in practical…

Machine Learning · Computer Science 2026-03-31 Tiantian Wang , Xiang Xiang , Simon S. Du

Federated Learning (FL) enables collaborative model training across multiple devices while preserving data privacy. However, it remains susceptible to backdoor attacks, where malicious participants can compromise the global model. Existing…

Cryptography and Security · Computer Science 2025-02-26 Ebtisaam Alharbi , Leandro Soriano Marcolino , Qiang Ni , Antonios Gouglidis

Decentralized Federated Learning (DFL) trains models in a collaborative and privacy-preserving manner while removing model centralization risks and improving communication bottlenecks. However, DFL faces challenges in efficient…

Intrinsic motivation, inspired by the psychology of developmental learning in infants, stimulates exploration in agents without relying solely on sparse external rewards. Existing methods in reinforcement learning like Random Network…

Machine Learning · Computer Science 2024-10-03 Mohammadamin Davoodabadi , Negin Hashemi Dijujin , Mahdieh Soleymani Baghshah

Offline Reinforcement Learning (RL) aims to learn effective policies from a static dataset without requiring further agent-environment interactions. However, its practical adoption is often hindered by the need for explicit reward…

Machine Learning · Computer Science 2025-12-23 Gaurav Chaudhary , Laxmidhar Behera

Reinforcement learning (RL) trains many agents, which is resource-intensive and must scale to large GPU clusters. Different RL training algorithms offer different opportunities for distributing and parallelising the computation. Yet,…

Machine Learning · Computer Science 2022-10-31 Huanzhou Zhu , Bo Zhao , Gang Chen , Weifeng Chen , Yijie Chen , Liang Shi , Yaodong Yang , Peter Pietzuch , Lei Chen

Federated learning is widely used to learn intelligent models from decentralized data. In federated learning, clients need to communicate their local model updates in each iteration of model learning. However, model updates are large in…

Machine Learning · Computer Science 2022-05-04 Chuhan Wu , Fangzhao Wu , Lingjuan Lyu , Yongfeng Huang , Xing Xie