中文
相关论文

相关论文: Learning Belief Representations for Imitation Lear…

200 篇论文

We develop a simple framework to learn bio-inspired foraging policies using human data. We conduct an experiment where humans are virtually immersed in an open field foraging environment and are trained to collect the highest amount of…

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

统计理论 · 数学 2021-11-11 Zhengling Qi , Peng Liao

We introduce an uncertainty-aware graph representation framework for learning to guide planning in Partially Observable Markov Decision Processes (POMDPs). Unlike existing approaches that require domain or problem size specific neural…

人工智能 · 计算机科学 2026-03-31 Rajesh Mangannavar , Prasad Tadepalli

Reinforcement learning in partially observed Markov decision processes (POMDPs) faces two challenges. (i) It often takes the full history to predict the future, which induces a sample complexity that scales exponentially with the horizon.…

机器学习 · 计算机科学 2024-04-02 Lingxiao Wang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Addressing uncertainty is critical for autonomous systems to robustly adapt to the real world. We formulate the problem of model uncertainty as a continuous Bayes-Adaptive Markov Decision Process (BAMDP), where an agent maintains a…

机器人学 · 计算机科学 2019-05-09 Gilwoo Lee , Brian Hou , Aditya Mandalika , Jeongseok Lee , Sanjiban Choudhury , Siddhartha S. Srinivasa

This work examines a social learning problem, where dispersed agents connected through a network topology interact locally to form their opinions (beliefs) as regards certain hypotheses of interest. These opinions evolve over time, since…

信号处理 · 电气工程与系统科学 2023-01-26 Michele Cirillo , Virginia Bordignon , Vincenzo Matta , Ali H. Sayed

We introduce a Bayesian (deep) model-based reinforcement learning method (RoMBRL) that can capture model uncertainty to achieve sample-efficient policy optimisation. We propose to formulate the model-based policy optimisation problem as a…

机器人学 · 计算机科学 2021-01-06 Tai Hoang , Ngo Anh Vien

We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…

系统与控制 · 电气工程与系统科学 2023-05-10 Timothy L. Molloy , Girish N. Nair

Much of reinforcement learning theory is built on top of oracles that are computationally hard to implement. Specifically for learning near-optimal policies in Partially Observable Markov Decision Processes (POMDPs), existing algorithms…

机器学习 · 计算机科学 2022-06-08 Noah Golowich , Ankur Moitra , Dhruv Rohatgi

Many processes, such as discrete event systems in engineering or population dynamics in biology, evolve in discrete space and continuous time. We consider the problem of optimal decision making in such discrete state and action space…

机器学习 · 计算机科学 2020-10-27 Bastian Alt , Matthias Schultheis , Heinz Koeppl

How to learn an effective reinforcement learning-based model for control tasks from high-level visual observations is a practical and challenging problem. A key to solving this problem is to learn low-dimensional state representations from…

机器学习 · 计算机科学 2022-12-27 Jianda Chen , Sinno Jialin Pan

Learning in POMDPs is known to be significantly harder than in MDPs. In this paper, we consider the online learning problem for episodic POMDPs with unknown transition and observation models. We propose a Posterior Sampling-based…

机器学习 · 计算机科学 2024-10-24 Dengwang Tang , Dongze Ye , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

In this work, we generalize the problem of learning through interaction in a POMDP by accounting for eventual additional information available at training time. First, we introduce the informed POMDP, a new learning paradigm offering a…

机器学习 · 计算机科学 2025-06-09 Gaspard Lambrechts , Adrien Bolland , Damien Ernst

We study planning problems where autonomous agents operate inside environments that are subject to uncertainties and not fully observable. Partially observable Markov decision processes (POMDPs) are a natural formal model to capture such…

人工智能 · 计算机科学 2018-02-28 Steven Carr , Nils Jansen , Ralf Wimmer , Jie Fu , Ufuk Topcu

Meta-reinforcement learning requires utilizing prior task distribution information obtained during exploration to rapidly adapt to unknown tasks. The efficiency of an agent's exploration hinges on accurately identifying the current task.…

人工智能 · 计算机科学 2025-06-25 Menglong Zhang , Fuyuan Qian

We propose to deal with sequential processes where only partial observations are available by learning a latent representation space on which policies may be accurately learned.

机器学习 · 计算机科学 2014-06-18 Gabriella Contardo , Ludovic Denoyer , Thierry Artieres , Patrick Gallinari

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

机器学习 · 计算机科学 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

The standard problem setting in Dec-POMDPs is self-play, where the goal is to find a set of policies that play optimally together. Policies learned through self-play may adopt arbitrary conventions and implicitly rely on multi-step…

人工智能 · 计算机科学 2021-08-19 Hengyuan Hu , Adam Lerer , Brandon Cui , David Wu , Luis Pineda , Noam Brown , Jakob Foerster

Partially-Observable Markov Decision Processes (POMDPs) are a well-known stochastic model for sequential decision making under limited information. We consider the EXPTIME-hard problem of synthesising policies that almost-surely reach some…

人工智能 · 计算机科学 2021-03-22 Sebastian Junges , Nils Jansen , Sanjit A. Seshia

We introduce a Transformer-based Reinforcement Learning framework for autonomous orbital collision avoidance that explicitly models the effects of partial observability and imperfect monitoring in space operations. The framework combines a…

机器学习 · 计算机科学 2026-03-26 Thomas Georges , Adam Abdin