中文
相关论文

相关论文: A Single-Loop Deep Actor-Critic Algorithm for Cons…

200 篇论文

A key aspect of intelligence is the ability to demonstrate a broad spectrum of behaviors for adapting to unexpected situations. Over the past decade, advancements in deep reinforcement learning have led to groundbreaking achievements to…

机器学习 · 计算机科学 2024-06-04 Luca Grillotti , Maxence Faldor , Borja G. León , Antoine Cully

Deep Reinforcement Learning (DRL) has become a popular method for solving control problems in power systems. Conventional DRL encourages the agent to explore various policies encoded in a neural network (NN) with the goal of maximizing the…

系统与控制 · 电气工程与系统科学 2024-10-28 Tong Wu , Anna Scaglione , Daniel Arnold

Deep reinforcement learning (RL) has achieved remarkable success, yet its deployment in real-world scenarios is often limited by vulnerability to environmental uncertainties. Distributionally robust RL (DR-RL) algorithms have been proposed…

机器学习 · 计算机科学 2026-04-21 Mingxuan Cui , Duo Zhou , Yuxuan Han , Grani A. Hanasusanto , Qiong Wang , Huan Zhang , Zhengyuan Zhou

Soft actor-critic (SAC) in reinforcement learning is expected to be one of the next-generation robot control schemes. Its ability to maximize policy entropy would make a robotic controller robust to noise and perturbation, which is useful…

机器学习 · 计算机科学 2023-07-04 Taisuke Kobayashi

Despite intense efforts in basic and clinical research, an individualized ventilation strategy for critically ill patients remains a major challenge. Recently, dynamic treatment regime (DTR) with reinforcement learning (RL) on electronic…

机器学习 · 计算机科学 2022-06-01 Changchang Yin , Ruoqi Liu , Jeffrey Caterino , Ping Zhang

This paper explores the application of the Soft Actor-Critic (SAC) algorithm within a Distributional Reinforcement Learning setting and introduces an implementation of such algorithm named Cram\'er-based Distributional Soft Actor-Critic…

机器学习 · 计算机科学 2026-05-12 Vanya Aziz , Ivo Nowak , E. M. T Hendrix

Multi-task reinforcement learning (RL) aims to find a single policy that effectively solves multiple tasks at the same time. This paper presents a constrained formulation for multi-task RL where the goal is to maximize the average…

最优化与控制 · 数学 2024-05-07 Sihan Zeng , Thinh T. Doan , Justin Romberg

Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample…

机器人学 · 计算机科学 2025-09-08 Zhihao Zhang , Chengyang Peng , Ekim Yurtsever , Keith A. Redmill

Deep Reinforcement Learning (DRL) has been extensively used to address portfolio optimization problems. The DRL agents acquire knowledge and make decisions through unsupervised interactions with their environment without requiring explicit…

机器学习 · 计算机科学 2025-01-14 Ruoyu Sun , Yue Xi , Angelos Stefanidis , Zhengyong Jiang , Jionglong Su

We focus on a simulation-based optimization problem of choosing the best design from the feasible space. Although the simulation model can be queried with finite samples, its internal processing rule cannot be utilized in the optimization…

机器学习 · 计算机科学 2021-11-02 Kuo Li , Qing-Shan Jia , Jiaqi Yan

We study the global convergence and global optimality of actor-critic, one of the most popular families of reinforcement learning algorithms. While most existing works on actor-critic employ bi-level or two-timescale updates, we focus on…

机器学习 · 计算机科学 2021-06-15 Zuyue Fu , Zhuoran Yang , Zhaoran Wang

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard…

We present Distributional Soft Actor-Critic (DSAC), a distributional reinforcement learning (RL) algorithm that combines the strengths of distributional information of accumulated rewards and entropy-driven exploration from Soft…

机器学习 · 计算机科学 2025-07-01 Xiaoteng Ma , Junyao Chen , Li Xia , Jun Yang , Qianchuan Zhao , Zhengyuan Zhou

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Autonomous parking is a key technology in modern autonomous driving systems, requiring high precision, strong adaptability, and efficiency in complex environments. This paper proposes a Deep Reinforcement Learning (DRL) framework based on…

机器人学 · 计算机科学 2025-05-01 Zheyu Zhang , Yutong Luo , Yongzhou Chen , Haopeng Zhao , Zhichao Ma , Hao Liu

Life-cycle management of large-scale transportation systems requires determining a sequence of inspection and maintenance decisions to minimize long-term risks and costs while dealing with multiple uncertainties and constraints that lie in…

多智能体系统 · 计算机科学 2026-02-26 M. Saifullah , K. G. Papakonstantinou , A. Bhattacharya , S. M. Stoffels , C. P. Andriotis

Temporal-Difference (TD) learning with nonlinear smooth function approximation for policy evaluation has achieved great success in modern reinforcement learning. It is shown that such a problem can be reformulated as a stochastic…

机器学习 · 计算机科学 2020-08-25 Shuang Qiu , Zhuoran Yang , Xiaohan Wei , Jieping Ye , Zhaoran Wang

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple…

机器学习 · 计算机科学 2019-08-23 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar

The synergies between Quality-Diversity (QD) and Deep Reinforcement Learning (RL) have led to powerful hybrid QD-RL algorithms that have shown tremendous potential, and brings the best of both fields. However, only a single deep RL…

机器学习 · 计算机科学 2023-03-14 Bryan Lim , Manon Flageat , Antoine Cully

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

机器学习 · 计算机科学 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe