中文
相关论文

相关论文: Reinforcement Learning in Rich-Observation MDPs us…

200 篇论文

Recursion is the fundamental paradigm to finitely describe potentially infinite objects. As state-of-the-art reinforcement learning (RL) algorithms cannot directly reason about recursion, they must rely on the practitioner's ingenuity in…

机器学习 · 计算机科学 2022-06-24 Ernst Moritz Hahn , Mateo Perez , Sven Schewe , Fabio Somenzi , Ashutosh Trivedi , Dominik Wojtczak

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

机器学习 · 计算机科学 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Reinforcement learning (RL) approaches based on Markov Decision Processes (MDPs) are predominantly applied in the robot joint space, often relying on limited task-specific information and partial awareness of the 3D environment. In…

机器人学 · 计算机科学 2026-03-09 Bingkun Huang , Yuhe Gong , Zewen Yang , Tianyu Ren , Luis Figueredo

In reinforcement learning (RL), an agent learns to perform a task by interacting with an environment and receiving feedback (a numerical reward) for its actions. However, the assumption that rewards are always observable is often not…

Reinforcementlearning(RL)folkloresuggeststhathistory-basedfunctionapproximationmethods,suchas recurrent neural nets or history-based state abstraction, perform better than their memory-less counterparts, due to the fact that function…

机器学习 · 计算机科学 2022-11-08 Gandharv Patil , Aditya Mahajan , Doina Precup

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

机器学习 · 计算机科学 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

Despite rapid progress in theoretical reinforcement learning (RL) over the last few years, most of the known guarantees are worst-case in nature, failing to take advantage of structure that may be known a priori about a given RL problem at…

机器学习 · 计算机科学 2021-10-26 Noah Golowich , Ankur Moitra

Sequential decision making, commonly formalized as optimization of a Markov Decision Process, is a key challenge in artificial intelligence. Two successful approaches to MDP optimization are reinforcement learning and planning, which both…

机器学习 · 计算机科学 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

机器学习 · 计算机科学 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

We study the offline reinforcement learning (RL) in the face of unmeasured confounders. Due to the lack of online interaction with the environment, offline RL is facing the following two significant challenges: (i) the agent may be…

机器学习 · 计算机科学 2022-09-20 Zuyue Fu , Zhengling Qi , Zhaoran Wang , Zhuoran Yang , Yanxun Xu , Michael R. Kosorok

Deep RL approaches build much of their success on the ability of the deep neural network to generate useful internal representations. Nevertheless, they suffer from a high sample-complexity and starting with a good input representation can…

机器学习 · 计算机科学 2021-02-17 Vikram Waradpande , Daniel Kudenko , Megha Khosla

Obtaining no-regret guarantees for reinforcement learning (RL) in the case of problems with continuous state and/or action spaces is still one of the major open challenges in the field. Recently, a variety of solutions have been proposed,…

机器学习 · 计算机科学 2024-02-07 Davide Maran , Alberto Maria Metelli , Matteo Papini , Marcello Restell

We consider the problem of learning to optimize an unknown Markov decision process (MDP). We show that, if the MDP can be parameterized within some known function class, we can obtain regret bounds that scale with the dimensionality, rather…

机器学习 · 统计学 2014-11-04 Ian Osband , Benjamin Van Roy

In real-world reinforcement learning (RL) systems, various forms of {\it impaired observability} can complicate matters. These situations arise when an agent is unable to observe the most recent state of the system due to latency or lossy…

机器学习 · 计算机科学 2023-10-30 Minshuo Chen , Jie Meng , Yu Bai , Yinyu Ye , H. Vincent Poor , Mengdi Wang

One key challenge for multi-task Reinforcement learning (RL) in practice is the absence of task indicators. Robust RL has been applied to deal with task ambiguity, but may result in over-conservative policies. To balance the worst-case…

机器学习 · 计算机科学 2022-10-25 Mengdi Xu , Peide Huang , Yaru Niu , Visak Kumar , Jielin Qiu , Chao Fang , Kuan-Hui Lee , Xuewei Qi , Henry Lam , Bo Li , Ding Zhao

We study lifelong reinforcement learning (RL) in a regret minimization setting of linear contextual Markov decision process (MDP), where the agent needs to learn a multi-task policy while solving a streaming sequence of tasks. We propose an…

机器学习 · 计算机科学 2022-06-02 Sanae Amani , Lin F. Yang , Ching-An Cheng

In dynamic programming (DP) and reinforcement learning (RL), an agent learns to act optimally in terms of expected long-term return by sequentially interacting with its environment modeled by a Markov decision process (MDP). More generally…

机器学习 · 计算机科学 2022-01-03 Mastane Achab , Gergely Neu

Learning Markov decision processes (MDPs) in the presence of the adversary is a challenging problem in reinforcement learning (RL). In this paper, we study RL in episodic MDPs with adversarial reward and full information feedback, where the…

机器学习 · 计算机科学 2022-04-21 Jiafan He , Dongruo Zhou , Quanquan Gu

Reinforcement learning (RL) has been demonstrated to have great potential in many applications of scientific discovery and design. Recent work includes, for example, the design of new structures and compositions of molecules for therapeutic…

机器学习 · 计算机科学 2020-04-17 Colin Bellinger , Rory Coles , Mark Crowley , Isaac Tamblyn

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

机器学习 · 计算机科学 2023-11-21 Ukjo Hwang , Songnam Hong