中文
相关论文

相关论文: Adviser-Actor-Critic: Eliminating Steady-State Err…

200 篇论文

Off-policy actor-critic algorithms have shown strong potential in deep reinforcement learning for continuous control tasks. Their success primarily comes from leveraging pessimistic state-action value function updates, which reduce function…

机器学习 · 计算机科学 2025-08-21 Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

Existing reinforcement learning (RL) methods struggle with long-horizon robotic manipulation tasks, particularly those involving sparse rewards. While action chunking is a promising paradigm for robotic manipulation, using RL to directly…

机器人学 · 计算机科学 2026-03-02 Jiarui Yang , Bin Zhu , Jingjing Chen , Yu-Gang Jiang

Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to…

机器学习 · 计算机科学 2021-12-02 Chayan Banerjee , Zhiyong Chen , Nasimul Noman , Mohsen Zamani

Deep Actor-Critic algorithms, which combine Actor-Critic with deep neural network (DNN), have been among the most prevalent reinforcement learning algorithms for decision-making problems in simulated environments. However, the existing deep…

机器学习 · 计算机科学 2024-09-19 Kexuan Wang , An Liu , Baishuo Lin

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

机器学习 · 计算机科学 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

This paper describes a purely data-driven solution to a class of sequential decision-making problems with a large number of concurrent online decisions, with applications to computing systems and operations research. We assume that while…

人工智能 · 计算机科学 2019-10-02 Hardik Meisheri , Vinita Baniwal , Nazneen N Sultana , Balaraman Ravindran , Harshad Khadilkar

Biological agents learn and act intelligently in spite of a highly limited capacity to process and store information. Many real-world problems involve continuous control, which represents a difficult task for artificial intelligence agents.…

机器学习 · 计算机科学 2025-05-16 Tailia Malloy , Chris R. Sims , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro

This study presents a benchmark for evaluating action-constrained reinforcement learning (RL) algorithms. In action-constrained RL, each action taken by the learning system must comply with certain constraints. These constraints are crucial…

机器学习 · 计算机科学 2023-06-30 Kazumi Kasaura , Shuwa Miura , Tadashi Kozuno , Ryo Yonetani , Kenta Hoshino , Yohei Hosoe

Open-ended generation tasks require outputs to satisfy diverse and often implicit task-specific evaluation rubrics. The sheer number of relevant rubrics leads to prohibitively high verification costs and incomplete assessments of a…

机器学习 · 计算机科学 2025-11-04 Mian Wu , Gavin Zhang , Sewon Min , Sergey Levine , Aviral Kumar

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

机器学习 · 计算机科学 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

The trend is to implement intelligent agents capable of analyzing available information and utilize it efficiently. This work presents a number of reinforcement learning (RL) architectures; one of them is designed for intelligent agents.…

机器学习 · 计算机科学 2020-04-07 Ala'eddin Masadeh , Zhengdao Wang , Ahmed E. Kamal

Adversarial Imitation Learning (AIL) is a class of popular state-of-the-art Imitation Learning algorithms commonly used in robotics. In AIL, an artificial adversary's misclassification is used as a reward signal that is optimized by any…

机器学习 · 计算机科学 2022-12-01 Ankur Deka , Changliu Liu , Katia Sycara

We present the first class of policy-gradient algorithms that work with both state-value and policy function-approximation, and are guaranteed to converge under off-policy training. Our solution targets problems in reinforcement learning…

人工智能 · 计算机科学 2018-02-23 Hamid Reza Maei

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

计算与语言 · 计算机科学 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

系统与控制 · 电气工程与系统科学 2025-07-23 Aria Delshad , Maryam Babazadeh

Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to…

最优化与控制 · 数学 2020-12-14 Ruisheng Diao , Di Shi , Bei Zhang , Siqi Wang , Haifeng Li , Chunlei Xu , Tu Lan , Desong Bian , Jiajun Duan

Many sequential decision-making problems need optimization of different objectives which possibly conflict with each other. The conventional way to deal with a multi-task problem is to establish a scalar objective function based on a linear…

机器学习 · 计算机科学 2023-02-28 Mohsen Amidzadeh

Off-policy reinforcement learning (RL) is concerned with learning a rewarding policy by executing another policy that gathers samples of experience. While the former policy (i.e. target policy) is rewarding but in-expressive (in most cases,…

机器学习 · 计算机科学 2020-03-02 Anji Liu , Yitao Liang , Guy Van den Broeck

This paper presents a model-free reinforcement learning (RL) algorithm to solve the risk-averse optimal control (RAOC) problem for discrete-time nonlinear systems. While successful RL algorithms have been presented to learn optimal control…

系统与控制 · 电气工程与系统科学 2021-03-29 Yuzhen Han , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

\Ac{MPC} and \ac{RL} are two powerful control strategies with, arguably, complementary advantages. In this work, we show how actor-critic \ac{RL} techniques can be leveraged to improve the performance of \ac{MPC}. The \ac{RL} critic is used…

系统与控制 · 电气工程与系统科学 2024-06-07 Rudolf Reiter , Andrea Ghezzi , Katrin Baumgärtner , Jasper Hoffmann , Robert D. McAllister , Moritz Diehl