中文
相关论文

相关论文: Mirror Descent Actor Critic via Bounded Advantage …

200 篇论文

Reinforcement Learning (RL) techniques have drawn great attention in many challenging tasks, but their performance deteriorates dramatically when applied to real-world problems. Various methods, such as domain randomization, have been…

机器学习 · 计算机科学 2022-08-05 Wangyang Yue , Yuan Zhou , Xiaochuan Zhang , Yuchen Hua , Zhiyuan Wang , Guang Kou

We present an actor-critic framework for MDPs where the objective is the variance-adjusted expected return. Our critic uses linear function approximation, and we extend the concept of compatible features to the variance-adjusted setting. We…

机器学习 · 统计学 2013-10-15 Aviv Tamar , Shie Mannor

Actor-Critic based approaches were among the first to address reinforcement learning in a general setting. Recently, these algorithms have gained renewed interest due to their generality, good convergence properties, and possible biological…

机器学习 · 计算机科学 2009-09-17 D. Di Castro , R. Meir

\Ac{MPC} and \ac{RL} are two powerful control strategies with, arguably, complementary advantages. In this work, we show how actor-critic \ac{RL} techniques can be leveraged to improve the performance of \ac{MPC}. The \ac{RL} critic is used…

系统与控制 · 电气工程与系统科学 2024-06-07 Rudolf Reiter , Andrea Ghezzi , Katrin Baumgärtner , Jasper Hoffmann , Robert D. McAllister , Moritz Diehl

Despite definite success in deep reinforcement learning problems, actor-critic algorithms are still confronted with sample inefficiency in complex environments, particularly in tasks where efficient exploration is a bottleneck. These…

机器学习 · 计算机科学 2021-02-09 Yannis Flet-Berliac , Johan Ferret , Olivier Pietquin , Philippe Preux , Matthieu Geist

Model-based reinforcement learning (MBRL) improves sample efficiency by leveraging learned dynamics models for policy optimization. However, the effectiveness of methods such as actor-critic is often limited by compounding model errors,…

系统与控制 · 电气工程与系统科学 2026-04-01 Chengyang Gu , Yuxin Pan , Hui Xiong , Yize Chen

Training a game-playing reinforcement learning agent requires multiple interactions with the environment. Ignorant random exploration may cause a waste of time and resources. It's essential to alleviate such waste. As discussed in this…

机器学习 · 计算机科学 2022-06-24 Tairan Huang , Xu Li , Hao Li , Mingming Sun , Ping Li

Actor-critic methods solve reinforcement learning problems by updating a parameterized policy known as an actor in a direction that increases an estimate of the expected return known as a critic. However, existing actor-critic methods only…

机器学习 · 统计学 2018-02-23 Voot Tangkaratt , Abbas Abdolmaleki , Masashi Sugiyama

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

机器学习 · 计算机科学 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

Risk-aware Reinforcement Learning (RL) algorithms like SAC and TD3 were shown empirically to outperform their risk-neutral counterparts in a variety of continuous-action tasks. However, the theoretical basis for the pessimistic objectives…

机器学习 · 计算机科学 2024-05-27 Michal Nauman , Marek Cygan

For those seeking healthcare advice online, AI based dialogue agents capable of interacting with patients to perform automatic disease diagnosis are a viable option. This application necessitates efficient inquiry of relevant disease…

机器学习 · 计算机科学 2022-06-09 Weijie He , Ting Chen

Actor-critic (AC) algorithms, empowered by neural networks, have had significant empirical success in recent years. However, most of the existing theoretical support for AC algorithms focuses on the case of linear function approximations,…

机器学习 · 计算机科学 2024-04-02 Yufeng Zhang , Siyu Chen , Zhuoran Yang , Michael I. Jordan , Zhaoran Wang

Model-free deep reinforcement learning (RL) has been successfully applied to challenging continuous control domains. However, poor sample efficiency prevents these methods from being widely used in real-world domains. This paper introduces…

机器学习 · 计算机科学 2022-10-27 Sicen Li , Qinyun Tang , Yiming Pang , Xinmeng Ma , Gang Wang

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

机器学习 · 计算机科学 2019-05-29 Shariq Iqbal , Fei Sha

We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an…

机器学习 · 计算机科学 2022-06-02 Sanae Amani , Lin F. Yang , Ching-An Cheng

In recommendation systems, diversity and novelty are essential for capturing varied user preferences and encouraging exploration, yet many systems prioritize click relevance. While reinforcement learning (RL) has been explored to improve…

机器学习 · 计算机科学 2025-07-30 Jiin Woo , Alireza Bagheri Garakani , Tianchen Zhou , Zhishen Huang , Yan Gao

Actor-critic algorithms learn an explicit policy (actor), and an accompanying value function (critic). The actor performs actions in the environment, while the critic evaluates the actor's current policy. However, despite their stability…

人工智能 · 计算机科学 2019-02-08 Hélène Plisnier , Denis Steckelmacher , Diederik M. Roijers , Ann Nowé

The Robust Regularized Markov Decision Process (RRMDP) is proposed to learn policies robust to dynamics shifts by adding regularization to the transition dynamics in the value function. Existing methods mostly use unstructured…

机器学习 · 计算机科学 2025-11-03 Cheng Tang , Zhishuai Liu , Pan Xu

In our work we implicitly suggest that it is a misconception to think that humans learn fast. The learning process takes time. Babies start learning to move in the restricted fluid environment of the womb. Children are often limited by…

机器人学 · 计算机科学 2026-03-03 Timur Ishuov , Michele Folgheraiter , Madi Nurmanov , Goncalo Gordo , Richárd Farkas , József Dombi

Deep reinforcement learning (RL) has proven a powerful technique in many sequential decision making domains. However, Robotics poses many challenges for RL, most notably training on a physical system can be expensive and dangerous, which…

机器人学 · 计算机科学 2017-10-19 Lerrel Pinto , Marcin Andrychowicz , Peter Welinder , Wojciech Zaremba , Pieter Abbeel