中文
相关论文

相关论文: Single-Loop Federated Actor-Critic across Heteroge…

200 篇论文

In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged…

机器学习 · 计算机科学 2019-11-27 Yifan Wu , George Tucker , Ofir Nachum

Although Federated Learning (FL) promises privacy and distributed collaboration, its effectiveness in real-world scenarios is often hampered by the stochastic heterogeneity of clients and unpredictable system dynamics. Existing static…

多智能体系统 · 计算机科学 2026-04-07 Rafael O. Jarczewski , Gabriel U. Talasso , Leandro Villas , Allan M. de Souza

Federated learning (FL) faces challenges of intermittent client availability and computation/communication efficiency. As a result, only a small subset of clients can participate in FL at a given time. It is important to understand how…

机器学习 · 计算机科学 2024-12-31 Shiqiang Wang , Mingyue Ji

We propose a new policy iteration theory as an important extension of soft policy iteration and Soft Actor-Critic (SAC), one of the most efficient model free algorithms for deep reinforcement learning. Supported by the new theory, arbitrary…

机器学习 · 计算机科学 2019-02-18 Gang Chen , Yiming Peng

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

人工智能 · 计算机科学 2018-07-26 Sanyam Kapoor

In recommendation systems, diversity and novelty are essential for capturing varied user preferences and encouraging exploration, yet many systems prioritize click relevance. While reinforcement learning (RL) has been explored to improve…

机器学习 · 计算机科学 2025-07-30 Jiin Woo , Alireza Bagheri Garakani , Tianchen Zhou , Zhishen Huang , Yan Gao

Since reinforcement learning algorithms are notoriously data-intensive, the task of sampling observations from the environment is usually split across multiple agents. However, transferring these observations from the agents to a central…

机器学习 · 计算机科学 2024-10-22 Sajad Khodadadian , Pranay Sharma , Gauri Joshi , Siva Theja Maguluri

The synergies between Quality-Diversity (QD) and Deep Reinforcement Learning (RL) have led to powerful hybrid QD-RL algorithms that have shown tremendous potential, and brings the best of both fields. However, only a single deep RL…

机器学习 · 计算机科学 2023-03-14 Bryan Lim , Manon Flageat , Antoine Cully

In practical federated learning (FL), the large communication overhead between clients and the server is often a significant bottleneck. Gradient compression methods can effectively reduce this overhead, while error feedback (EF) restores…

机器学习 · 计算机科学 2026-02-13 Diying Yang , Yingwei Hou , Weigang Wu

Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous…

机器学习 · 计算机科学 2023-05-04 Gang Chen , Victoria Huang

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

多智能体系统 · 计算机科学 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

Soft Actor-Critic (SAC) is one of the state-of-the-art off-policy reinforcement learning (RL) algorithms that is within the maximum entropy based RL framework. SAC is demonstrated to perform very well in a list of continous control tasks…

机器学习 · 计算机科学 2021-12-22 Zhenyang Shi , Surya P. N. Singh

Open-ended generation tasks require outputs to satisfy diverse and often implicit task-specific evaluation rubrics. The sheer number of relevant rubrics leads to prohibitively high verification costs and incomplete assessments of a…

机器学习 · 计算机科学 2025-11-04 Mian Wu , Gavin Zhang , Sewon Min , Sergey Levine , Aviral Kumar

In this paper, we study the problem of robust cooperative multi-agent reinforcement learning (RL) where a large number of cooperative agents with distributed information aim to learn policies in the presence of \emph{stochastic} and…

多智能体系统 · 计算机科学 2025-06-16 Muhammad Aneeq uz Zaman , Mathieu Laurière , Alec Koppel , Tamer Başar

In this study, we investigate the use of global information to speed up the learning process and increase the cumulative rewards of reinforcement learning (RL) in competition tasks. Within the actor-critic RL, we introduce multiple…

机器学习 · 计算机科学 2020-03-03 Zehong Cao , Chin-Teng Lin

We propose FACtored Multi-Agent Centralised policy gradients (FACMAC), a new method for cooperative multi-agent reinforcement learning in both discrete and continuous action spaces. Like MADDPG, a popular multi-agent actor-critic method,…

The application of deep reinforcement learning in multi-agent systems introduces extra challenges. In a scenario with numerous agents, one of the most important concerns currently being addressed is how to develop sufficient collaboration…

人工智能 · 计算机科学 2022-10-12 Bin Zhang , Yunpeng Bai , Zhiwei Xu , Dapeng Li , Guoliang Fan

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

人工智能 · 计算机科学 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

系统与控制 · 电气工程与系统科学 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Deep Reinforcement Learning (DRL) algorithms for continuous action spaces are known to be brittle toward hyperparameters as well as \cut{being}sample inefficient. Soft Actor Critic (SAC) proposes an off-policy deep actor critic algorithm…

机器学习 · 计算机科学 2019-06-10 Patrick Nadeem Ward , Ariella Smofsky , Avishek Joey Bose