English
Related papers

Related papers: Learning Attentive Neural Processes for Planning w…

200 papers

We consider the human-aware task planning problem where a human-robot team is given a shared task with a known objective to achieve. Recent approaches tackle it by modeling it as a team of independent, rational agents, where the robot plans…

Robotics · Computer Science 2022-10-18 Anthony Favier , Shashank Shekhar , Rachid Alami

Given the task of positioning a ball-like object to a goal region beyond direct reach, humans can often throw, slide, or rebound objects against the wall to attain the goal. However, enabling robots to reason similarly is non-trivial.…

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

For widespread deployment in domains characterized by partial observability, non-deterministic actions and unforeseen changes, robots need to adapt sensing, processing and interaction with humans to the tasks at hand. While robots typically…

Artificial Intelligence · Computer Science 2013-08-05 Shiqi Zhang , Mohan Sridharan

The partially observable Markov decision process (POMDP) provides a principled general model for planning under uncertainty. However, solving a general POMDP is computationally intractable in the worst case. This paper introduces…

Artificial Intelligence · Computer Science 2016-02-24 Min Chen , Emilio Frazzoli , David Hsu , Wee Sun Lee

We propose a neural network architecture, called TransNet, that combines planning and model learning for solving Partially Observable Markov Decision Processes (POMDPs) with non-uniform system dynamics. The past decade has seen a…

Robotics · Computer Science 2019-07-11 Nicholas Collins , Hanna Kurniawati

We consider the problem of imitation learning from expert demonstrations in partially observable Markov decision processes (POMDPs). Belief representations, which characterize the distribution over the latent states in a POMDP, have been…

Machine Learning · Computer Science 2019-06-25 Tanmay Gangwani , Joel Lehman , Qiang Liu , Jian Peng

Partially observable Markov decision processes (POMDPs) are a principled planning model for sequential decision-making under uncertainty. Yet, real-world problems with high-dimensional observations, such as camera images, remain intractable…

Machine Learning · Computer Science 2026-02-06 Miriam Schäfers , Merlijn Krale , Thiago D. Simão , Nils Jansen , Maximilian Weininger

Mobile robots rely on maps to navigate through an environment. In the absence of any map, the robots must build the map online from partial observations as they move in the environment. Traditional methods build a map using only direct…

Robotics · Computer Science 2024-10-14 Vishnu Dutt Sharma

We present a data-efficient reinforcement learning algorithm resistant to observation noise. Our method extends the highly data-efficient PILCO algorithm (Deisenroth & Rasmussen, 2011) into partially observed Markov decision processes…

Machine Learning · Statistics 2016-02-09 Rowan McAllister , Carl Edward Rasmussen

Policies for partially observed Markov decision processes can be efficiently learned by imitating policies for the corresponding fully observed Markov decision processes. Unfortunately, existing approaches for this kind of imitation…

Machine Learning · Computer Science 2021-07-02 Andrew Warrington , J. Wilder Lavington , Adam Ścibior , Mark Schmidt , Frank Wood

People with Alzheimer's disease and related dementias (ADRD) often show the problem of repetitive questioning, which brings a great burden on persons with ADRD (PwDs) and their caregivers. Conversational robots hold promise of coping with…

Robotics · Computer Science 2021-04-20 Fengpei Yuan , Amir Sadovnik , Ran Zhang , Devin Casenhiser , Eun Jin Paek , Si On Yoon , Xiaopeng Zhao

We present a substantial extension of our Human-Aware Task Planning framework, tailored for scenarios with intermittent shared execution experiences and significant belief divergence between humans and robots, particularly due to the…

Robotics · Computer Science 2024-09-30 Shashank Shekhar , Anthony Favier , Rachid Alami

Partially observable Markov decision processes (POMDPs) are a general mathematical model for sequential decision-making in stochastic environments under state uncertainty. POMDPs are often solved \textit{online}, which enables the algorithm…

Artificial Intelligence · Computer Science 2025-03-26 Yunuo Zhang , Baiting Luo , Ayan Mukhopadhyay , Abhishek Dubey

Planning robust robot manipulation requires good forward models that enable robust plans to be found. This work shows how to achieve this using a forward model learned from robot data to plan push manipulations. We explore learning methods…

Robotics · Computer Science 2019-07-03 Ermano Arruda , Michael J Mathew , Marek Kopicki , Michael Mistry , Morteza Azad , Jeremy L Wyatt

We formalize decision-making problems in robotics and automated control using continuous MDPs and actions that take place over continuous time intervals. We then approximate the continuous MDP using finer and finer discretizations. Doing…

Robotics · Computer Science 2020-05-22 Nan Rong , Joseph Y. Halpern , Ashutosh Saxena

In real-world reinforcement learning (RL) scenarios, agents often encounter partial observability, where incomplete or noisy information obscures the true state of the environment. Partially Observable Markov Decision Processes (POMDPs) are…

Machine Learning · Computer Science 2025-05-19 Ashok Arora , Neetesh Kumar

General-purpose robots require diverse repertoires of behaviors to complete challenging tasks in real-world unstructured environments. To address this issue, goal-conditioned reinforcement learning aims to acquire policies that can reach…

Robotics · Computer Science 2023-04-19 Kuan Fang , Patrick Yin , Ashvin Nair , Sergey Levine

Whether navigating a building, operating a robot, or playing a game, an agent that acts effectively in an environment must first learn an internal model of how that environment works. Partially-observable Markov decision processes (POMDPs)…

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

Machine Learning · Computer Science 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill