中文
相关论文

相关论文: Reinforcement Learning with Exogenous States and R…

200 篇论文

Many real-world applications of reinforcement learning (RL) require the agent to deal with high-dimensional observations such as those generated from a megapixel camera. Prior work has addressed such problems with representation learning,…

机器学习 · 计算机科学 2022-03-08 Yonathan Efroni , Dipendra Misra , Akshay Krishnamurthy , Alekh Agarwal , John Langford

Reinforcement Learning (RL) algorithms have led to recent successes in solving complex games, such as Atari or Starcraft, and to a huge impact in real-world applications, such as cybersecurity or autonomous driving. In the side of the…

机器学习 · 计算机科学 2021-02-15 Rubén Majadas , Javier García , Fernando Fernández

Markov Decision Processes (MDPs) are a mathematical framework for modeling sequential decision making under uncertainty. The classical approaches for solving MDPs are well known and have been widely studied, some of which rely on…

机器学习 · 计算机科学 2018-05-18 Joshua R. Bertram , Xuxi Yang , Peng Wei

Reinforcement learning (RL) algorithms struggle with learning optimal policies for tasks where reward feedback is sparse and depends on a complex sequence of events in the environment. Probabilistic reward machines (PRMs) are finite-state…

机器学习 · 计算机科学 2025-10-20 Jan Corazza , Hadi Partovi Aria , Daniel Neider , Zhe Xu

Reward-free reinforcement learning (RL) considers the setting where the agent does not have access to a reward function during exploration, but must propose a near-optimal policy for an arbitrary reward function revealed only after…

机器学习 · 计算机科学 2022-06-22 Andrew Wagenmaker , Yifang Chen , Max Simchowitz , Simon S. Du , Kevin Jamieson

In the framework of MDP, although the general reward function takes three arguments-current state, action, and successor state; it is often simplified to a function of two arguments-current state and action. The former is called a…

人工智能 · 计算机科学 2018-12-03 Shuai Ma , Jia Yuan Yu

In this work, we consider the problem of collaborative multi-user reinforcement learning. In this setting there are multiple users with the same state-action space and transition probabilities but with different rewards. Under the…

机器学习 · 计算机科学 2023-05-23 Naman Agarwal , Prateek Jain , Suhas Kowshik , Dheeraj Nagaraj , Praneeth Netrapalli

The aim of this paper is to study the reward based policy exploration problem in a supervised learning approach and enable robots to form complex movement trajectories in challenging reward settings and search spaces. For this, the…

机器人学 · 计算机科学 2020-11-10 M. Tuluhan Akbulut , Utku Bozdogan , Ahmet Tekden , Emre Ugur

Although in recent years reinforcement learning has become very popular the number of successful applications to different kinds of operations research problems is rather scarce. Reinforcement learning is based on the well-studied dynamic…

机器学习 · 计算机科学 2020-04-03 Manuel Schneckenreither

This paper presents a novel state representation for reward-free Markov decision processes. The idea is to learn, in a self-supervised manner, an embedding space where distances between pairs of embedded states correspond to the minimum…

机器学习 · 计算机科学 2022-05-05 Lorenzo Steccanella , Anders Jonsson

Reinforcement learning (RL) methods usually treat reward functions as black boxes. As such, these methods must extensively interact with the environment in order to discover rewards and optimal policies. In most RL applications, however,…

机器学习 · 计算机科学 2022-01-19 Rodrigo Toro Icarte , Toryn Q. Klassen , Richard Valenzano , Sheila A. McIlraith

Reinforcement learning usually uses the feedback rewards of environmental to train agents. But the rewards in the actual environment are sparse, and even some environments will not rewards. Most of the current methods are difficult to get…

机器学习 · 计算机科学 2020-01-13 Kai Jiang , XiaoLong Qin

Training reinforcement learning (RL) agents using scalar reward signals is often infeasible when an environment has sparse and non-Markovian rewards. Moreover, handcrafting these reward functions before training is prone to…

机器学习 · 计算机科学 2023-10-04 Alessandro Abate , Yousif Almulla , James Fox , David Hyland , Michael Wooldridge

In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative rewards to obtain the optimal policy. However, in many real-world…

机器学习 · 计算机科学 2024-10-29 Yuting Tang , Xin-Qiang Cai , Yao-Xiang Ding , Qiyu Wu , Guoqing Liu , Masashi Sugiyama

We consider reinforcement learning (RL) in Markov Decision Processes in which an agent repeatedly interacts with an environment that is modeled by a controlled Markov process. At each time step $t$, it earns a reward, and also incurs a…

机器学习 · 计算机科学 2023-03-16 Rahul Singh , Abhishek Gupta , Ness B. Shroff

Exploration in sparse reward environments remains a significant challenge in reinforcement learning, particularly in Contextual Markov Decision Processes (CMDPs), where environments differ across episodes. Existing episodic intrinsic…

机器学习 · 计算机科学 2025-01-28 Yuhua Jiang , Qihan Liu , Yiqin Yang , Xiaoteng Ma , Dianyu Zhong , Hao Hu , Jun Yang , Bin Liang , Bo Xu , Chongjie Zhang , Qianchuan Zhao

We provide improved gap-dependent regret bounds for reinforcement learning in finite episodic Markov decision processes. Compared to prior work, our bounds depend on alternative definitions of gaps. These definitions are based on the…

机器学习 · 计算机科学 2021-10-27 Christoph Dann , Teodor V. Marinov , Mehryar Mohri , Julian Zimmert

We present the problem of reinforcement learning with exogenous termination. We define the Termination Markov Decision Process (TerMDP), an extension of the MDP framework, in which episodes may be interrupted by an external non-Markovian…

机器学习 · 计算机科学 2023-10-09 Guy Tennenholtz , Nadav Merlis , Lior Shani , Shie Mannor , Uri Shalit , Gal Chechik , Assaf Hallak , Gal Dalal

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

机器人学 · 计算机科学 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Reward machines are an established tool for dealing with reinforcement learning problems in which rewards are sparse and depend on complex sequences of actions. However, existing algorithms for learning reward machines assume an overly…

机器学习 · 计算机科学 2025-10-20 Jan Corazza , Ivan Gavran , Daniel Neider