中文
相关论文

相关论文: DSAC: Distributional Soft Actor-Critic for Risk-Se…

200 篇论文

Soft Actor-Critic (SAC) is an off-policy actor-critic reinforcement learning algorithm, essentially based on entropy regularization. SAC trains a policy by maximizing the trade-off between expected return and entropy (randomness in the…

机器学习 · 计算机科学 2021-09-27 Chayan Banerjee , Zhiyong Chen , Nasimul Noman

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

机器人学 · 计算机科学 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

机器学习 · 计算机科学 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Model-free deep reinforcement learning (RL) algorithms have achieved tremendous success on a range of challenging tasks. However, safety concerns remain when these methods are deployed on real-world applications, necessitating risk-aware…

机器学习 · 计算机科学 2026-02-10 Alonso Granados , Jason Pacheco

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered when applied to…

机器学习 · 计算机科学 2023-08-22 Yechen Zhang , Jian Sun , Gang Wang , Zhuo Li , Wei Chen

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

机器人学 · 计算机科学 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

This study develops and evaluates a deep reinforcement learning framework for dynamic portfolio allocation across global equity markets. The Soft Actor-Critic algorithm is used to learn continuous portfolio weights within a Markov Decision…

投资组合管理 · 定量金融 2026-05-19 Kamil Kashif , Robert Ślepaczuk

Soft Actor-Critic algorithm is widely recognized for its robust performance across a range of deep reinforcement learning tasks, where it leverages the tanh transformation to constrain actions within bounded limits. However, this…

机器学习 · 计算机科学 2025-04-23 Yanjun Chen , Xinming Zhang , Xianghui Wang , Zhiqiang Xu , Xiaoyu Shen , Wei Zhang

Risk-aware Reinforcement Learning (RL) algorithms like SAC and TD3 were shown empirically to outperform their risk-neutral counterparts in a variety of continuous-action tasks. However, the theoretical basis for the pessimistic objectives…

机器学习 · 计算机科学 2024-05-27 Michal Nauman , Marek Cygan

Reinforcement Learning (RL) is a powerful framework to address the discrepancy between loss functions used during training and the final evaluation metrics to be used at test time. When applied to neural Machine Translation (MT), it…

计算与语言 · 计算机科学 2021-02-24 Julia Ive , Zixu Wang , Marina Fomicheva , Lucia Specia

In this paper, we propose an off-policy deep reinforcement learning (DRL) method utilizing the average reward criterion. While most existing DRL methods employ the discounted reward criterion, this can potentially lead to a discrepancy…

机器学习 · 计算机科学 2024-08-06 Yukinari Hisaki , Isao Ono

The development of Distributional Reinforcement Learning (DRL) has introduced a natural way to incorporate risk sensitivity into value-based and actor-critic methods by employing risk measures other than expectation in the value function.…

机器学习 · 计算机科学 2025-07-08 Mehrdad Moghimi , Hyejin Ku

Hidden confounders that influence both states and actions can bias policy learning in reinforcement learning (RL), leading to suboptimal or non-generalizable behavior. Most RL algorithms ignore this issue, learning policies from…

机器学习 · 计算机科学 2025-06-09 Thanh Vinh Vo , Young Lee , Haozhe Ma , Chien Lu , Tze-Yun Leong

We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to improve upon an arbitrary reference policy with limited…

机器学习 · 计算机科学 2024-11-01 Honghao Wei , Xiyue Peng , Arnob Ghosh , Xin Liu

Reinforcement learning (RL) agents are vulnerable to adversarial disturbances, which can deteriorate task performance or compromise safety specifications. Existing methods either address safety requirements under the assumption of no…

机器学习 · 计算机科学 2023-09-14 Zeyang Li , Chuxiong Hu , Yunan Wang , Yujie Yang , Shengbo Eben Li

Traditional Reinforcement Learning (RL) policies are typically implemented with fixed control rates, often disregarding the impact of control rate selection. This can lead to inefficiencies as the optimal control rate varies with task…

机器人学 · 计算机科学 2024-08-13 Dong Wang , Giovanni Beltrame

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. However, for many…

机器学习 · 计算机科学 2024-03-22 Baohe Zhang , Yuan Zhang , Lilli Frison , Thomas Brox , Joschka Bödecker

Soft actor-critic (SAC) in reinforcement learning is expected to be one of the next-generation robot control schemes. Its ability to maximize policy entropy would make a robotic controller robust to noise and perturbation, which is useful…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

Soft Actor-Critic (SAC) is widely used in practical applications and is now one of the most relevant off-policy online model-free reinforcement learning (RL) methods. The technique of n-step returns is known to increase the convergence…

机器学习 · 计算机科学 2025-12-16 Jakub Łyskawa , Jakub Lewandowski , Paweł Wawrzyński