中文
相关论文

相关论文: Deep PQR: Solving Inverse Reinforcement Learning u…

200 篇论文

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

机器学习 · 计算机科学 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Inverse reinforcement learning (IRL) has progressed significantly toward accurately learning the underlying rewards in both discrete and continuous domains from behavior data. The next advance is to learn {\em intrinsic} preferences in ways…

机器学习 · 计算机科学 2026-05-28 Yikang Gui , Prashant Doshi

This paper introduces EnergyFlow, a framework that unifies generative action modeling with inverse reinforcement learning by parameterizing a scalar energy function whose gradient is the denoising field. We establish that under…

机器人学 · 计算机科学 2026-05-12 Yanbiao Ji , Qiuchang Li , Yuting Hu , Shaokai Wu , Wenyuan Xie , Guodong Zhang , Qicheng He , Deyi Ji , Yue Ding , Hongtao Lu

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

机器学习 · 计算机科学 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

机器学习 · 计算机科学 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Inverse reinforcement learning (IRL) is an imitation learning approach to learning reward functions from expert demonstrations. Its use avoids the difficult and tedious procedure of manual reward specification while retaining the…

机器学习 · 计算机科学 2024-03-25 Daulet Baimukashev , Gokhan Alcan , Ville Kyrki

Recently, there are many trials to apply reinforcement learning in asset allocation for earning more stable profits. In this paper, we compare performance between several reinforcement learning algorithms - actor-only, actor-critic and PPO…

计算金融 · 定量金融 2023-01-16 Jiwon Kim , Moon-Ju Kang , KangHun Lee , HyungJun Moon , Bo-Kwan Jeon

We present a novel definition of the reinforcement learning state, actions and reward function that allows a deep Q-network (DQN) to learn to control an optimization hyperparameter. Using Q-learning with experience replay, we train two DQNs…

最优化与控制 · 数学 2016-06-21 Samantha Hansen

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

机器学习 · 计算机科学 2019-10-24 Egor Rotinov

Estimating the unknown reward functions driving agents' behaviors is of central interest in inverse reinforcement learning and game theory. To tackle this problem, we develop a unified framework for reward function recovery in two-player…

机器学习 · 计算机科学 2026-05-20 Junyi Liao , Zihan Zhu , Ethan Fang , Zhuoran Yang , Vahid Tarokh

The standard feedback model of reinforcement learning requires revealing the reward of every visited state-action pair. However, in practice, it is often the case that such frequent feedback is not available. In this work, we take a first…

机器学习 · 计算机科学 2021-03-08 Yonathan Efroni , Nadav Merlis , Shie Mannor

Inverse reinforcement learning (IRL) is a powerful paradigm for uncovering the incentive structure that drives agent behavior, by inferring an unknown reward function from observed trajectories within a Markov decision process (MDP).…

We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new…

机器学习 · 计算机科学 2017-07-25 Tuomas Haarnoja , Haoran Tang , Pieter Abbeel , Sergey Levine

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

机器学习 · 计算机科学 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury

Reinforcement learning in complex environments is a challenging problem. In particular, the success of reinforcement learning algorithms depends on a well-designed reward function. Inverse reinforcement learning (IRL) solves the problem of…

机器学习 · 计算机科学 2021-01-20 Rakhoon Hwang , Hanjin Lee , Hyung Ju Hwang

Preference-based Reinforcement Learning (PbRL) replaces reward values in traditional reinforcement learning by preferences to better elicit human opinion on the target objective, especially when numerical reward values are hard to design or…

机器学习 · 计算机科学 2020-10-27 Yichong Xu , Ruosong Wang , Lin F. Yang , Aarti Singh , Artur Dubrawski

In reinforcement learning an agent interacts with the environment by taking actions and observing the next state and reward. When sampled probabilistically, these state transitions, rewards, and actions can all induce randomness in the…

人工智能 · 计算机科学 2017-10-30 Will Dabney , Mark Rowland , Marc G. Bellemare , Rémi Munos

Reinforcement learning (RL) has drawn increasing interests in recent years due to its tremendous success in various applications. However, standard RL algorithms can only be applied for single reward function, and cannot adapt to an unseen…

机器学习 · 计算机科学 2022-01-04 Ziyang Tang , Yihao Feng , Qiang Liu

Optimism in the face of uncertainty is a popular approach to balance exploration and exploitation in reinforcement learning. Here, we consider the online linear quadratic regulator (LQR) problem, i.e., to learn the LQR corresponding to an…

系统与控制 · 电气工程与系统科学 2026-04-01 Marcell Bartos , Bruce D. Lee , Lenart Treven , Andreas Krause , Florian Dörfler , Melanie N. Zeilinger

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

机器学习 · 计算机科学 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha