中文
相关论文

相关论文: Reinforcement Learning Architectures: SAC, TAC, an…

200 篇论文

Conventional reinforcement learning (RL) allows an agent to learn policies via environmental rewards only, with a long and slow learning curve, especially at the beginning stage. On the contrary, human learning is usually much faster…

人工智能 · 计算机科学 2019-12-25 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

机器学习 · 计算机科学 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

As hybrid electric vehicles (HEVs) gain traction in heavy-duty trucks, adaptive and efficient energy management is critical for reducing fuel consumption while maintaining battery charge for long operation times. We present a new…

系统与控制 · 电气工程与系统科学 2025-08-08 Wafeeq Jaleel , Md Ragib Rownak , Athar Hanif , Sidra Ghayour Bhatti , Qadeer Ahmed

Actor-critic (AC) methods are a cornerstone of reinforcement learning (RL) but offer limited interpretability. Current explainable RL methods seldom use state attributions to assist training. Rather, they treat all state features equally,…

机器学习 · 计算机科学 2026-02-02 Na Li , Hangguan Shan , Wei Ni , Wenjie Zhang , Xinyu Li

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

机器人学 · 计算机科学 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

Federated reinforcement learning (FRL) has emerged as a promising paradigm, enabling multiple agents to collaborate and learn a shared policy adaptable across heterogeneous environments. Among the various reinforcement learning (RL)…

机器学习 · 计算机科学 2024-12-25 Ye Zhu , Xiaowen Gong

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

机器学习 · 计算机科学 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

机器学习 · 计算机科学 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Team competition in multi-agent Markov games is an increasingly important setting for multi-agent reinforcement learning, due to its general applicability in modeling many real-life situations. Multi-agent actor-critic methods are the most…

多智能体系统 · 计算机科学 2023-01-18 Paramita Koley , Aurghya Maiti , Niloy Ganguly , Sourangshu Bhattacharya

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

机器学习 · 计算机科学 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Efficient exploration for an agent is challenging in reinforcement learning (RL). In this paper, a novel actor-critic framework namely virtual action actor-critic (VAAC), is proposed to address the challenge of efficient exploration in RL.…

机器学习 · 计算机科学 2023-11-07 Bumgeun Park , Taeyoung Kim , Quoc-Vinh Lai-Dang , Dongsoo Har

In this work we present a new agent architecture, called Reactor, which combines multiple algorithmic and architectural contributions to produce an agent with higher sample-efficiency than Prioritized Dueling DQN (Wang et al., 2016) and…

人工智能 · 计算机科学 2018-06-20 Audrunas Gruslys , Will Dabney , Mohammad Gheshlaghi Azar , Bilal Piot , Marc Bellemare , Remi Munos

Reinforcement learning (RL) is a powerful tool for solving complex decision-making problems, but its lack of transparency and interpretability has been a major challenge in domains where decisions have significant real-world consequences.…

人工智能 · 计算机科学 2023-09-12 Muzhe Guo , Feixu Yu , Tian Lan , Fang Jin

We present Distributional Soft Actor-Critic (DSAC), a distributional reinforcement learning (RL) algorithm that combines the strengths of distributional information of accumulated rewards and entropy-driven exploration from Soft…

机器学习 · 计算机科学 2025-07-01 Xiaoteng Ma , Junyao Chen , Li Xia , Jun Yang , Qianchuan Zhao , Zhengyuan Zhou

Quantum optimal control in the presence of decoherence is difficult, particularly when not all Hamiltonian parameters are known precisely, as in quantum sensing applications. In this context, maximizing the sensitivity of the system is the…

量子物理 · 物理学 2026-01-19 Logan W. Cooke , Stefanie Czischek

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

机器学习 · 计算机科学 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

机器学习 · 计算机科学 2019-05-29 Shariq Iqbal , Fei Sha

Asynchronous Advantage Actor Critic (A3C) is an effective Reinforcement Learning (RL) algorithm for a wide range of tasks, such as Atari games and robot control. The agent learns policies and value function through trial-and-error…

机器学习 · 计算机科学 2019-12-03 Zhaoyuan Gu , Zhenzhong Jia , Howie Choset

\Ac{MPC} and \ac{RL} are two powerful control strategies with, arguably, complementary advantages. In this work, we show how actor-critic \ac{RL} techniques can be leveraged to improve the performance of \ac{MPC}. The \ac{RL} critic is used…

系统与控制 · 电气工程与系统科学 2024-06-07 Rudolf Reiter , Andrea Ghezzi , Katrin Baumgärtner , Jasper Hoffmann , Robert D. McAllister , Moritz Diehl