中文
相关论文

相关论文: PAC Reinforcement Learning for Predictive State Re…

200 篇论文

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

机器学习 · 统计学 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei

In this paper we consider self-supervised representation learning to improve sample efficiency in reinforcement learning (RL). We propose a forward prediction objective for simultaneously learning embeddings of states and action sequences.…

机器学习 · 计算机科学 2020-01-15 William Whitney , Rajat Agarwal , Kyunghyun Cho , Abhinav Gupta

In many practical uses of reinforcement learning (RL) the set of actions available at a given state is a random variable, with realizations governed by an exogenous stochastic process. Somewhat surprisingly, the foundations for such…

Batch reinforcement learning (RL) is important to apply RL algorithms to many high stakes tasks. Doing batch RL in a way that yields a reliable new policy in large domains is challenging: a new decision policy may visit states and actions…

机器学习 · 计算机科学 2020-07-23 Yao Liu , Adith Swaminathan , Alekh Agarwal , Emma Brunskill

The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with…

机器学习 · 计算机科学 2022-10-28 Bingyan Wang , Yuling Yan , Jianqing Fan

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

A state space representation of an environment is a classic and yet powerful tool used by many autonomous robotic systems for efficient and often optimal solution planning. However, designing these representations with high performance is…

机器学习 · 计算机科学 2020-12-23 Andrew Wilhelm , Aaron Wilhelm , Garrett Fosdick

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

机器人学 · 计算机科学 2021-07-19 Hanna Kurniawati

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

机器学习 · 计算机科学 2013-01-07 Christian R. Shelton

In many practical settings control decisions must be made under partial/imperfect information about the evolution of a relevant state variable. Partially Observable Markov Decision Processes (POMDPs) is a relatively well-developed framework…

机器学习 · 计算机科学 2021-12-30 Yanling Chang , Alfredo Garcia , Zhide Wang , Lu Sun

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

机器学习 · 计算机科学 2026-04-07 Yaoze Guo , Shana Moothedath

We study model-based reinforcement learning (RL) for episodic Markov decision processes (MDP) whose transition probability is parametrized by an unknown transition core with features of state and action. Despite much recent progress in…

机器学习 · 统计学 2024-11-19 Taehyun Hwang , Min-hwan Oh

Recent theoretical work studies sample-efficient reinforcement learning (RL) extensively in two settings: learning interactively in the environment (online RL), or learning from an offline dataset (offline RL). However, existing algorithms…

机器学习 · 计算机科学 2022-02-14 Tengyang Xie , Nan Jiang , Huan Wang , Caiming Xiong , Yu Bai

We consider the problem of imitation learning from expert demonstrations in partially observable Markov decision processes (POMDPs). Belief representations, which characterize the distribution over the latent states in a POMDP, have been…

机器学习 · 计算机科学 2019-06-25 Tanmay Gangwani , Joel Lehman , Qiang Liu , Jian Peng

This paper studies the sample-efficiency of learning in Partially Observable Markov Decision Processes (POMDPs), a challenging problem in reinforcement learning that is known to be exponentially hard in the worst-case. Motivated by…

机器学习 · 计算机科学 2023-07-07 Jiacheng Guo , Minshuo Chen , Huan Wang , Caiming Xiong , Mengdi Wang , Yu Bai

We present a probabilistic logic programming framework to reinforcement learning, by integrating reinforce-ment learning, in POMDP environments, with normal hybrid probabilistic logic programs with probabilistic answer set seman-tics, that…

人工智能 · 计算机科学 2010-11-30 Emad Saad

Policy gradient methods are extensively used in reinforcement learning as a way to optimize expected return. In this paper, we explore the evolution of the policy parameters, for a special class of exactly solvable POMDPs, as a…

机器学习 · 计算机科学 2020-11-04 Gavin McCracken , Colin Daniels , Rosie Zhao , Anna Brandenberger , Prakash Panangaden , Doina Precup

Learning effective representations in image-based environments is crucial for sample efficient Reinforcement Learning (RL). Unfortunately, in RL, representation learning is confounded with the exploratory experience of the agent -- learning…

机器学习 · 计算机科学 2021-07-21 Denis Yarats , Rob Fergus , Alessandro Lazaric , Lerrel Pinto

We study the optimal sample complexity in large-scale Reinforcement Learning (RL) problems with policy space generalization, i.e. the agent has a prior knowledge that the optimal policy lies in a known policy space. Existing results show…

机器学习 · 计算机科学 2020-08-18 Wenlong Mou , Zheng Wen , Xi Chen

Penetration testing, the simulation of cyberattacks to identify security vulnerabilities, presents a sequential decision-making problem well-suited for reinforcement learning (RL) automation. Like many applications of RL to real-world…

机器学习 · 计算机科学 2025-09-25 Raphael Simon , Pieter Libin , Wim Mees