English
Related papers

Related papers: Reinforcement Learning Architectures: SAC, TAC, an…

200 papers

Conventional reinforcement learning (RL) allows an agent to learn policies via environmental rewards only, with a long and slow learning curve, especially at the beginning stage. On the contrary, human learning is usually much faster…

Artificial Intelligence · Computer Science 2019-12-25 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

Machine Learning · Computer Science 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new…

Systems and Control · Electrical Eng. & Systems 2025-08-08 Wafeeq Jaleel , Md Ragib Rownak , Athar Hanif , Sidra Ghayour Bhatti , Qadeer Ahmed

Actor-critic (AC) methods are a cornerstone of reinforcement learning (RL) but offer limited interpretability. Current explainable RL methods seldom use state attributions to assist training. Rather, they treat all state features equally,…

Machine Learning · Computer Science 2026-02-02 Na Li , Hangguan Shan , Wei Ni , Wenjie Zhang , Xinyu Li

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

Robotics · Computer Science 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

Federated reinforcement learning (FRL) has emerged as a promising paradigm, enabling multiple agents to collaborate and learn a shared policy adaptable across heterogeneous environments. Among the various reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-25 Ye Zhu , Xiaowen Gong

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

Machine Learning · Computer Science 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

Machine Learning · Computer Science 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Team competition in multi-agent Markov games is an increasingly important setting for multi-agent reinforcement learning, due to its general applicability in modeling many real-life situations. Multi-agent actor-critic methods are the most…

Multiagent Systems · Computer Science 2023-01-18 Paramita Koley , Aurghya Maiti , Niloy Ganguly , Sourangshu Bhattacharya

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

Machine Learning · Computer Science 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Efficient exploration for an agent is challenging in reinforcement learning (RL). In this paper, a novel actor-critic framework namely virtual action actor-critic (VAAC), is proposed to address the challenge of efficient exploration in RL.…

Machine Learning · Computer Science 2023-11-07 Bumgeun Park , Taeyoung Kim , Quoc-Vinh Lai-Dang , Dongsoo Har

In this work we present a new agent architecture, called Reactor, which combines multiple algorithmic and architectural contributions to produce an agent with higher sample-efficiency than Prioritized Dueling DQN (Wang et al., 2016) and…

Artificial Intelligence · Computer Science 2018-06-20 Audrunas Gruslys , Will Dabney , Mohammad Gheshlaghi Azar , Bilal Piot , Marc Bellemare , Remi Munos

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

Artificial Intelligence · Computer Science 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

We present Distributional Soft Actor-Critic (DSAC), a distributional reinforcement learning (RL) algorithm that combines the strengths of distributional information of accumulated rewards and entropy-driven exploration from Soft…

Machine Learning · Computer Science 2025-07-01 Xiaoteng Ma , Junyao Chen , Li Xia , Jun Yang , Qianchuan Zhao , Zhengyuan Zhou

Quantum optimal control in the presence of decoherence is difficult, particularly when not all Hamiltonian parameters are known precisely, as in quantum sensing applications. In this context, maximizing the sensitivity of the system is the…

Quantum Physics · Physics 2026-01-19 Logan W. Cooke , Stefanie Czischek

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

Machine Learning · Computer Science 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

Machine Learning · Computer Science 2019-05-29 Shariq Iqbal , Fei Sha

Asynchronous Advantage Actor Critic (A3C) is an effective Reinforcement Learning (RL) algorithm for a wide range of tasks, such as Atari games and robot control. The agent learns policies and value function through trial-and-error…

Machine Learning · Computer Science 2019-12-03 Zhaoyuan Gu , Zhenzhong Jia , Howie Choset

\Ac{MPC} and \ac{RL} are two powerful control strategies with, arguably, complementary advantages. In this work, we show how actor-critic \ac{RL} techniques can be leveraged to improve the performance of \ac{MPC}. The \ac{RL} critic is used…

Systems and Control · Electrical Eng. & Systems 2024-06-07 Rudolf Reiter , Andrea Ghezzi , Katrin Baumgärtner , Jasper Hoffmann , Robert D. McAllister , Moritz Diehl