English
Related papers

Related papers: Efficient Planning under Uncertainty with Macro-ac…

200 papers

This paper presents a new multi-layered algorithm for motion planning under motion and sensing uncertainties for Linear Temporal Logic specifications. We propose a technique to guide a sampling-based search tree in the combined task and…

Robotics · Computer Science 2023-04-11 Qi Heng Ho , Zachary N. Sunberg , Morteza Lahijanian

In this paper, we consider online planning in partially observable domains. Solving the corresponding POMDP problem is a very challenging task, particularly in an online setting. Our key contribution is a novel algorithmic approach,…

Artificial Intelligence · Computer Science 2021-05-13 Ori Sztyglic , Vadim Indelman

Robotic systems, particularly in demanding environments like narrow corridors or disaster zones, often grapple with imperfect state estimation. Addressing this challenge requires a trajectory plan that not only navigates these restrictive…

Robotics · Computer Science 2023-09-19 Zhenyang Chen , Hongzhe Yu , Yongxin Chen

We present a method for active inference with partial observations in stochastic systems through incentive design, also known as the leader-follower game. Consider a leader agent who aims to infer a follower agent's type given a finite set…

Systems and Control · Electrical Eng. & Systems 2025-02-12 Xinyi Wei , Chongyang Shi , Shuo Han , Ahmed H. Hemida , Charles A. Kamhoua , Jie Fu

Our goal is to perform out-of-distribution (OOD) detection, i.e., to detect when a robot is operating in environments drawn from a different distribution than the ones used to train the robot. We leverage Probably Approximately Correct…

Robotics · Computer Science 2023-11-08 Alec Farid , Sushant Veer , Divyanshu Pachisia , Anirudha Majumdar

In this work, we examine the problem of online decision making under uncertainty, which we formulate as planning in the belief space. Maintaining beliefs (i.e., distributions) over high-dimensional states (e.g., entire trajectories) was not…

Robotics · Computer Science 2021-12-30 Khen Elimelech , Vadim Indelman

We propose a scalable track-before-detect (TBD) tracking method based on a Poisson/multi-Bernoulli model. To limit computational complexity, we approximate the exact multi-Bernoulli mixture posterior probability density function (pdf) by a…

Signal Processing · Electrical Eng. & Systems 2021-09-06 Thomas Kropfreiter , Jason L. Williams , Florian Meyer

This thesis aims to study some of the mathematical challenges that arise in the analysis of statistical sequential decision-making algorithms for postoperative patients follow-up. Stochastic bandits (multiarmed, contextual) model the…

Machine Learning · Statistics 2024-05-06 Patrick Saux

Planning in stochastic and partially observable environments is a central issue in artificial intelligence. One commonly used technique for solving such a problem is by constructing an accurate model firstly. Although some recent approaches…

Artificial Intelligence · Computer Science 2019-04-08 Yunlong Liu , Jianyang Zheng

Prior-data fitted networks (PFNs) have recently emerged as a powerful approach for Bayesian prediction tasks, approximating the posterior predictive distribution (PPD) through in-context learning. Despite their strong empirical performance…

Machine Learning · Statistics 2026-05-27 Gyeonghun Kang , Changwoo J. Lee , Xiang Cheng

Estimating uncertainty from deep neural networks is a widely used approach for detecting out-of-distribution (OoD) samples, which typically exhibit high predictive uncertainty. However, conventional methods such as Monte Carlo (MC) Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 JinYoung Kim , DaeUng Jo , Kimin Yun , Jeonghyo Song , Youngjoon Yoo

As autonomous vehicles move from a simplified research setting to practical use, there exists a large gap between the dynamic behavior of a human driving and an autonomous system. Risk-aware behavior needs to naturally develop in order to…

Robotics · Computer Science 2026-05-14 Jason Gibson , Bogdan Vlahov , Patrick Spieler , Evangelos A. Theodorou

The combination of Monte Carlo tree search and neural networks has revolutionized online planning. As neural network approximations are often imperfect, we ask whether uncertainty estimates about the network outputs could be used to improve…

Artificial Intelligence · Computer Science 2024-06-05 Nir Greshler , David Ben Eli , Carmel Rabinovitz , Gabi Guetta , Liran Gispan , Guy Zohar , Aviv Tamar

We study the problem of online sequential decision-making given auxiliary demonstrations from experts who made their decisions based on unobserved contextual information. These demonstrations can be viewed as solving related but slightly…

Machine Learning · Computer Science 2025-06-17 Vahid Balazadeh , Keertana Chidambaram , Viet Nguyen , Rahul G. Krishnan , Vasilis Syrgkanis

Partially observable Markov decision processes (POMDP) are a useful model for decision-making under partial observability and stochastic actions. Partially Observable Monte-Carlo Planning is an online algorithm for deciding on the next…

Artificial Intelligence · Computer Science 2023-10-05 Oded Blumenthal , Guy Shani

Online planning under uncertainty in partially observable domains is an essential capability in robotics and AI. The partially observable Markov decision process (POMDP) is a mathematically principled framework for addressing…

Robotics · Computer Science 2024-10-14 Da Kong , Vadim Indelman

Approximate Bayesian computation (ABC) is a method for Bayesian inference when the likelihood is unavailable but simulating from the model is possible. However, many ABC algorithms require a large number of simulations, which can be costly.…

Machine Learning · Statistics 2018-10-15 Marko Järvenpää , Michael U. Gutmann , Arijus Pleska , Aki Vehtari , Pekka Marttinen

This paper presents a search-based partial motion planner to generate dynamically feasible trajectories for car-like robots in highly dynamic environments. The planner searches for smooth, safe, and near-time-optimal trajectories by…

Robotics · Computer Science 2020-11-10 Jiahui Lin , Tong Zhou , Delong Zhu , Jianbang Liu , Max Q. -H. Meng

Partially observable Markov decision processes (POMDPs) are a powerful abstraction for tasks that require decision making under uncertainty, and capture a wide range of real world tasks. Today, effective planning approaches exist that…

Machine Learning · Statistics 2018-05-24 Sebastian Tschiatschek , Kai Arulkumaran , Jan Stühmer , Katja Hofmann

Reasoning about uncertainty is vital in many real-life autonomous systems. However, current state-of-the-art planning algorithms cannot either reason about uncertainty explicitly, or do so with a high computational burden. Here, we focus on…

Artificial Intelligence · Computer Science 2022-01-31 Moran Barenboim , Vadim Indelman