中文
相关论文

相关论文: Inverse Policy Evaluation for Value-based Sequenti…

200 篇论文

Despite recent successes in Reinforcement Learning, value-based methods often suffer from high variance hindering performance. In this paper, we illustrate this in a continuous control setting where state of the art methods perform poorly…

机器学习 · 计算机科学 2019-05-24 Pierre Thodoroff , Nishanth Anand , Lucas Caccia , Doina Precup , Joelle Pineau

We present an algorithm for learning an approximate action-value soft Q-function in the relative entropy regularised reinforcement learning setting, for which an optimal improved policy can be recovered in closed form. We use recent…

机器学习 · 计算机科学 2019-11-06 Jonas Degrave , Abbas Abdolmaleki , Jost Tobias Springenberg , Nicolas Heess , Martin Riedmiller

Many reinforcement learning algorithms use value functions to guide the search for better policies. These methods estimate the value of a single policy while generalizing across many states. The core idea of this paper is to flip this…

机器学习 · 计算机科学 2020-02-28 Jean Harb , Tom Schaul , Doina Precup , Pierre-Luc Bacon

Searching the space of policies directly for the optimal policy has been one popular method for solving partially observable reinforcement learning problems. Typically, with each change of the target policy, its value is estimated from the…

人工智能 · 计算机科学 2007-05-23 Leonid Peshkin , Christian R. Shelton

In offline reinforcement learning, a policy learns to maximize cumulative rewards with a fixed collection of data. Towards conservative strategy, current methods choose to regularize the behavior policy or learn a lower bound of the value…

机器学习 · 计算机科学 2021-03-02 Hongchang Zhang , Jianzhun Shao , Yuhang Jiang , Shuncheng He , Xiangyang Ji

Many large MDPs can be represented compactly using a dynamic Bayesian network. Although the structure of the value function does not retain the structure of the process, recent work has shown that value functions in factored MDPs can often…

人工智能 · 计算机科学 2013-01-18 Daphne Koller , Ron Parr

Standard reinforcement learning methods aim to master one way of solving a task whereas there may exist multiple near-optimal policies. Being able to identify this collection of near-optimal policies can allow a domain expert to efficiently…

机器学习 · 计算机科学 2019-06-04 Muhammad A. Masood , Finale Doshi-Velez

Decision trees and decision rule systems play important roles as classifiers, knowledge representation tools, and algorithms. They are easily interpretable models for data analysis, making them widely used and studied in computer science.…

人工智能 · 计算机科学 2024-01-17 Kerven Durdymyradov , Mikhail Moshkov

Risk-sensitive reinforcement learning (RL) has garnered significant attention in recent years due to the growing interest in deploying RL agents in real-world scenarios. A critical aspect of risk awareness involves modeling highly rare risk…

机器学习 · 计算机科学 2023-08-30 Karthik Somayaji NS , Yu Wang , Malachi Schram , Jan Drgona , Mahantesh Halappanavar , Frank Liu , Peng Li

A key impediment to reinforcement learning (RL) in real applications with limited, batch data is defining a reward function that reflects what we implicitly know about reasonable behaviour for a task and allows for robust off-policy…

机器学习 · 计算机科学 2019-05-31 Niranjani Prasad , Barbara E Engelhardt , Finale Doshi-Velez

We introduce Implicit Policy, a general class of expressive policies that can flexibly represent complex action distributions in reinforcement learning, with efficient algorithms to compute entropy regularized policy gradients. We…

机器学习 · 计算机科学 2019-02-05 Yunhao Tang , Shipra Agrawal

Evidence-based decision-making entails collecting (costly) observations about an underlying phenomenon of interest, and subsequently committing to an (informed) decision on the basis of accumulated evidence. In this setting, active sensing…

机器学习 · 统计学 2020-06-26 Daniel Jarrett , Mihaela van der Schaar

Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education, but safe deployment in high stakes settings requires ways of assessing its…

Although the Music Sight Reading process has been studied from the cognitive psychology view points, but the computational learning methods like the Reinforcement Learning have not yet been used to modeling of such processes. In this paper,…

人工智能 · 计算机科学 2013-07-16 Keyvan Yahya , Pouyan Rafiei Fard

Reinforcement learning can acquire complex behaviors from high-level specifications. However, defining a cost function that can be optimized effectively and encodes the correct task is challenging in practice. We explore how inverse optimal…

机器学习 · 计算机科学 2016-05-30 Chelsea Finn , Sergey Levine , Pieter Abbeel

Reinforcement learning (RL) policies are typically trained for fixed objectives, making reuse difficult when task requirements change. We study inference-time policy reuse: given a library of pre-trained policies and a new composite…

机器学习 · 计算机科学 2026-04-29 Ihor Vitenko , Noha Ibrahim , Sihem Amer-Yahia

Many reinforcement learning algorithms, particularly those that rely on return estimates for policy improvement, can suffer from poor sample efficiency and training instability due to high-variance return estimates. In this paper we…

机器学习 · 计算机科学 2026-01-06 Alexander W. Goodall , Edwin Hamel-De le Court , Francesco Belardinelli

Model-free reinforcement learning (RL) is a powerful tool to learn a broad range of robot skills and policies. However, a lack of policy interpretability can inhibit their successful deployment in downstream applications, particularly when…

机器学习 · 计算机科学 2020-12-04 Tatiana Lopez-Guevara , Michael Burke , Nicholas K. Taylor , Kartic Subr

Inverse reinforcement learning (IRL) aims to explain observed strategic behavior by fitting reinforcement learning models to behavioral data. However, traditional IRL methods are only applicable when the observations are in the form of…

机器学习 · 计算机科学 2018-06-26 Antti Kangasrääsiö , Samuel Kaski

Inverse classification uses an induced classifier as a queryable oracle to guide test instances towards a preferred posterior class label. The result produced from the process is a set of instance-specific feature perturbations, or…

机器学习 · 计算机科学 2018-02-15 Michael T. Lash , Qihang Lin , W. Nick Street