中文
相关论文

相关论文: Provable RL with Exogenous Distractors via Multist…

200 篇论文

The problem of selecting the right state-representation in a reinforcement learning problem is considered. Several models (functions mapping past observations to a finite set) of the observations are given, and it is known that for at least…

机器学习 · 计算机科学 2013-02-12 Odalric-Ambrym Maillard , Rémi Munos , Daniil Ryabko

Continuous state spaces and stochastic, switching dynamics characterize a number of rich, realworld domains, such as robot navigation across varying terrain. We describe a reinforcementlearning algorithm for learning in these domains and…

机器学习 · 计算机科学 2012-06-18 Emma Brunskill , Bethany Leffler , Lihong Li , Michael L. Littman , Nicholas Roy

Bayesian reinforcement learning (BRL) encodes prior knowledge of the world in a model and represents uncertainty in model parameters by maintaining a probability distribution over them. This paper presents Monte Carlo BRL (MC-BRL), a simple…

机器学习 · 计算机科学 2012-07-03 Yi Wang , Kok Sung Won , David Hsu , Wee Sun Lee

Visual model-based RL methods typically encode image observations into low-dimensional representations in a manner that does not eliminate redundant information. This leaves them susceptible to spurious variations -- changes in…

机器学习 · 计算机科学 2023-10-26 Chuning Zhu , Max Simchowitz , Siri Gadipudi , Abhishek Gupta

We study the setting of \emph{performative reinforcement learning} where the deployed policy affects both the reward, and the transition of the underlying Markov decision process. Prior work~\parencite{MTR23} has addressed this problem…

机器学习 · 计算机科学 2025-03-18 Debmalya Mandal , Goran Radanovic

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

最优化与控制 · 数学 2025-11-17 Rene Carmona , Mathieu Lauriere

Learning informative representations from image-based observations is of fundamental concern in deep Reinforcement Learning (RL). However, data-inefficiency remains a significant barrier to this objective. To overcome this obstacle, we…

机器学习 · 计算机科学 2022-01-19 Tao Huang , Jiachen Wang , Xiao Chen

POMDPs capture a broad class of decision making problems, but hardness results suggest that learning is intractable even in simple settings due to the inherent partial observability. However, in many realistic problems, more information is…

机器学习 · 计算机科学 2023-02-07 Jonathan N. Lee , Alekh Agarwal , Christoph Dann , Tong Zhang

Shifting from traditional control strategies to Deep Reinforcement Learning (RL) for legged robots poses inherent challenges, especially when addressing real-world physical constraints during training. While high-fidelity simulations…

机器人学 · 计算机科学 2023-09-28 Joonho Lee , Lukas Schroth , Victor Klemm , Marko Bjelonic , Alexander Reske , Marco Hutter

Reinforcement learning algorithms are typically designed for discrete-time dynamics, even though the underlying real-world control systems are often continuous in time. In this paper, we study the problem of continuous-time reinforcement…

机器学习 · 计算机科学 2026-03-03 Klemens Iten , Lenart Treven , Bhavya Sukhija , Florian Dörfler , Andreas Krause

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

机器学习 · 计算机科学 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

Effective contact-rich manipulation requires robots to synergistically leverage vision, force, and proprioception. However, Reinforcement Learning agents struggle to learn in such multisensory settings, especially amidst sensory noise and…

机器人学 · 计算机科学 2026-04-27 Rickmer Krohn , Vignesh Prasad , Gabriele Tiboni , Georgia Chalvatzaki

Recursion is the fundamental paradigm to finitely describe potentially infinite objects. As state-of-the-art reinforcement learning (RL) algorithms cannot directly reason about recursion, they must rely on the practitioner's ingenuity in…

机器学习 · 计算机科学 2022-06-24 Ernst Moritz Hahn , Mateo Perez , Sven Schewe , Fabio Somenzi , Ashutosh Trivedi , Dominik Wojtczak

We study reinforcement learning with function approximation for large-scale Partially Observable Markov Decision Processes (POMDPs) where the state space and observation space are large or even continuous. Particularly, we consider Hilbert…

机器学习 · 计算机科学 2022-06-27 Masatoshi Uehara , Ayush Sekhari , Jason D. Lee , Nathan Kallus , Wen Sun

Markov Decision Processes (MDPs), the mathematical framework underlying most algorithms in Reinforcement Learning (RL), are often used in a way that wrongfully assumes that the state of an agent's environment does not change during action…

机器学习 · 计算机科学 2019-12-13 Simon Ramstedt , Christopher Pal

Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic…

机器学习 · 计算机科学 2021-01-08 Kaige Yang

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

机器学习 · 计算机科学 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

Ensuring the robustness of deep reinforcement learning (DRL) agents against adversarial attacks is critical for their trustworthy deployment. Recent research highlights the challenges of achieving state-adversarial robustness and suggests…

机器学习 · 计算机科学 2025-02-25 Haoran Li , Zicheng Zhang , Wang Luo , Congying Han , Jiayu Lv , Tiande Guo , Yudong Hu

This paper addresses the problem of training a reinforcement learning (RL) policy under partial observability by exploiting a privileged, anytime-feasible planner agent available exclusively during training. We formalize this as a Partially…

机器学习 · 计算机科学 2026-04-10 Mohsen Amiri , Mohsen Amiri , Ali Beikmohammadi , Sindri Magnuśson , Mehdi Hosseinzadeh

Representations are at the core of all deep reinforcement learning (RL) methods for both Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs). Many representation learning methods and theoretical…