中文
相关论文

相关论文: Inverse Policy Evaluation for Value-based Sequenti…

200 篇论文

This article introduces an imitation learning method for learning maximum entropy policies that comply with constraints demonstrated by expert trajectories executing a task. The formulation of the method takes advantage of results…

机器学习 · 计算机科学 2025-07-10 George Papadopoulos , George A. Vouros

Building interpretable parameterizations of real-world decision-making on the basis of demonstrated behavior -- i.e. trajectories of observations and actions made by an expert maximizing some unknown reward function -- is essential for…

机器学习 · 计算机科学 2021-03-31 Ioana Bica , Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

A data-based policy for iterative control task is presented. The proposed strategy is model-free and can be applied whenever safe input and state trajectories of a system performing an iterative task are available. These trajectories,…

系统与控制 · 计算机科学 2019-03-22 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

We study the use of randomized value functions to guide deep exploration in reinforcement learning. This offers an elegant means for synthesizing statistically and computationally efficient exploration with common practical approaches to…

机器学习 · 统计学 2019-09-25 Ian Osband , Benjamin Van Roy , Daniel Russo , Zheng Wen

We study the problem of generalizing an expert agent's behavior, provided through demonstrations, to new environments and/or additional constraints. Inverse Reinforcement Learning (IRL) offers a promising solution by seeking to recover the…

机器学习 · 计算机科学 2025-09-16 Filippo Lazzati , Alberto Maria Metelli

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

机器学习 · 计算机科学 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Reinforcement learning provides a mathematical framework for learning-based control, whose success largely depends on the amount of data it can utilize. The efficient utilization of historical trajectories obtained from previous policies is…

机器学习 · 计算机科学 2025-03-06 Yifan Lin , Yuhao Wang , Enlu Zhou

We study the off-policy evaluation (OPE) problem in reinforcement learning with linear function approximation, which aims to estimate the value function of a target policy based on the offline data collected by a behavior policy. We propose…

机器学习 · 计算机科学 2022-01-05 Yifei Min , Tianhao Wang , Dongruo Zhou , Quanquan Gu

We study the problem of teaching via demonstrations in sequential decision-making tasks. In particular, we focus on the situation when the teacher has no access to the learner's model and policy, and the feedback from the learner is limited…

机器学习 · 计算机科学 2023-09-19 Rustam Zayanov , Francisco S. Melo , Manuel Lopes

In this paper we present a new way of predicting the performance of a reinforcement learning policy given historical data that may have been generated by a different policy. The ability to evaluate a policy from historical data is important…

机器学习 · 计算机科学 2016-04-05 Philip S. Thomas , Emma Brunskill

In this paper we argue for the fundamental importance of the value distribution: the distribution of the random return received by a reinforcement learning agent. This is in contrast to the common approach to reinforcement learning which…

机器学习 · 计算机科学 2017-07-24 Marc G. Bellemare , Will Dabney , Rémi Munos

Supervised approaches for text summarisation suffer from the problem of mismatch between the target labels/scores of individual sentences and the evaluation score of the final summary. Reinforcement learning can solve this problem by…

计算与语言 · 计算机科学 2017-11-15 Diego Molla

We present an iterative inverse reinforcement learning algorithm to infer optimal cost functions in continuous spaces. Based on a popular maximum entropy criteria, our approach iteratively finds a weight improvement step and proposes a…

机器学习 · 计算机科学 2025-05-14 Sarmad Mehrdad , Avadesh Meduri , Ludovic Righetti

Adaptive behavior in volatile environments requires agents to switch among value-control regimes across latent contexts, but maintaining separate preferences, policy biases, and action-confidence parameters for every situation is…

机器学习 · 计算机科学 2025-12-16 Jacob Poschl

We devise and analyze algorithms for the empirical policy evaluation problem in reinforcement learning. Our algorithms explore backward from high-cost states to find high-value ones, in contrast to forward approaches that work forward from…

机器学习 · 计算机科学 2022-03-02 Daniel Vial , Vijay Subramanian

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

人工智能 · 计算机科学 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

Relational Markov Decision Processes are a useful abstraction for complex reinforcement learning problems and stochastic planning problems. Recent work developed representation schemes and algorithms for planning in such problems using the…

人工智能 · 计算机科学 2012-06-26 Chenggang Wang , Roni Khardon

With reinforcement learning, an agent could learn complex behaviors from high-level abstractions of the task. However, exploration and reward shaping remained challenging for existing methods, especially in scenarios where the extrinsic…

机器学习 · 计算机科学 2020-06-11 Jie Chen , Wenjun Xu

Humans have the ability to deviate from their natural behavior when necessary, which is a cognitive process called response inhibition. Similar approaches have independently received increasing attention in recent years for ensuring the…

系统与控制 · 电气工程与系统科学 2023-10-04 Armin Lederer , Erfaun Noorani , John S. Baras , Sandra Hirche

This paper aims to establish an entropy-regularized value-based reinforcement learning method that can ensure the monotonic improvement of policies at each policy update. Unlike previously proposed lower-bounds on policy improvement in…

机器学习 · 计算机科学 2020-08-26 Lingwei Zhu , Takamitsu Matsubara