中文
相关论文

相关论文: Revisiting Discrete Soft Actor-Critic

200 篇论文

Soft Actor-Critic (SAC) is one of the state-of-the-art off-policy reinforcement learning (RL) algorithms that is within the maximum entropy based RL framework. SAC is demonstrated to perform very well in a list of continous control tasks…

机器学习 · 计算机科学 2021-12-22 Zhenyang Shi , Surya P. N. Singh

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

机器学习 · 计算机科学 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

State-of-the-art deep reinforcement learning (RL) methods have achieved remarkable performance in continuous control tasks, yet their computational complexity is often incompatible with the constraints of resource-limited hardware, due to…

机器学习 · 计算机科学 2026-05-12 Riccardo De Monte , Matteo Cederle , Gian Antonio Susto

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

机器学习 · 计算机科学 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

Soft Actor-Critic (SAC) is an off-policy actor-critic deep reinforcement learning (DRL) algorithm based on maximum entropy reinforcement learning. By combining off-policy updates with an actor-critic formulation, SAC achieves…

机器学习 · 计算机科学 2019-06-11 Che Wang , Keith Ross

We aim to develop off-policy DRL algorithms that not only exceed state-of-the-art performance but are also simple and minimalistic. For standard continuous control benchmarks, Soft Actor-Critic (SAC), which employs entropy maximization,…

机器学习 · 计算机科学 2020-12-08 Che Wang , Yanqiu Wu , Quan Vuong , Keith Ross

Actor-critic algorithms address the dual goals of reinforcement learning (RL), policy evaluation and improvement via two separate function approximators. The practicality of this approach comes at the expense of training instability, caused…

机器学习 · 计算机科学 2024-06-11 Bahareh Tasdighi , Abdullah Akgül , Manuel Haussmann , Kenny Kazimirzak Brink , Melih Kandemir

We present GuidedSAC, a novel reinforcement learning (RL) algorithm that facilitates efficient exploration in vast state-action spaces. GuidedSAC leverages large language models (LLMs) as intelligent supervisors that provide action-level…

机器学习 · 计算机科学 2026-03-19 Hao Ma , Zhiqiang Pu , Xiaolin Ai , Huimu Wang

Multi-agent deep reinforcement learning has been applied to address a variety of complex problems with either discrete or continuous action spaces and achieved great success. However, most real-world environments cannot be described by only…

机器学习 · 计算机科学 2022-06-13 Hongzhi Hua , Kaigui Wu , Guixuan Wen

Soft Actor-Critic (SAC) is widely used in practical applications and is now one of the most relevant off-policy online model-free reinforcement learning (RL) methods. The technique of n-step returns is known to increase the convergence…

机器学习 · 计算机科学 2025-12-16 Jakub Łyskawa , Jakub Lewandowski , Paweł Wawrzyński

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

机器学习 · 计算机科学 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

Soft Actor Critic (SAC) algorithms show remarkable performance in complex simulated environments. A key element of SAC networks is entropy regularization, which prevents the SAC actor from optimizing against fine grained features,…

机器学习 · 计算机科学 2020-06-23 Miguel Campo , Zhengxing Chen , Luke Kung , Kittipat Virochsiri , Jianyu Wang

We propose a new policy iteration theory as an important extension of soft policy iteration and Soft Actor-Critic (SAC), one of the most efficient model free algorithms for deep reinforcement learning. Supported by the new theory, arbitrary…

机器学习 · 计算机科学 2019-02-18 Gang Chen , Yiming Peng

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

机器人学 · 计算机科学 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

机器学习 · 计算机科学 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Intrusion detection systems (IDS) generate a large number of false alerts which makes it difficult to inspect true positives. Hence, alert prioritization plays a crucial role in deciding which alerts to investigate from an enormous number…

密码学与安全 · 计算机科学 2022-08-04 Lalitha Chavali , Tanay Gupta , Paresh Saxena

Deep Actor-Critic algorithms, which combine Actor-Critic with deep neural network (DNN), have been among the most prevalent reinforcement learning algorithms for decision-making problems in simulated environments. However, the existing deep…

机器学习 · 计算机科学 2024-09-19 Kexuan Wang , An Liu , Baishuo Lin

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

机器学习 · 计算机科学 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

机器学习 · 计算机科学 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding