English
Related papers

Related papers: Resolving the measurement uncertainty paradox in e…

200 papers

Probabilistic control design is founded on the principle that a rational agent attempts to match modelled with an arbitrary desired closed-loop system trajectory density. The framework was originally proposed as a tractable alternative to…

Machine Learning · Computer Science 2023-11-16 Tom Lefebvre

We study the problem of synthesizing a controller that maximizes the entropy of a partially observable Markov decision process (POMDP) subject to a constraint on the expected total reward. Such a controller minimizes the predictability of…

Optimization and Control · Mathematics 2021-05-18 Yagiz Savas , Michael Hibbard , Bo Wu , Takashi Tanaka , Ufuk Topcu

Parrondo's paradox (PP) is a fundamental principle in nonlinear science where the alternation of individually losing strategies leads to a winning outcome. In this topical review, we provide the first systematic panorama of the synergy…

Chaotic Dynamics · Physics 2026-03-24 Marcelo A. Pires , Erveton P. Pinto , Jose S. Cánovas , Silvio M. Duarte Queirós

The second industrial revolution saw the development of management methods tailored to the challenges of the times: firstly, the need for mass production, and then, the pursuit of improved quality and customer satisfaction, followed by a…

Physics and Society · Physics 2026-01-13 Brunet Luc E. , Longcôté Éric

Partial observability and uncertainty are common problems in sequential decision-making that particularly impede the use of formal models such as Markov decision processes (MDPs). However, in practice, agents may be able to employ costly…

Machine Learning · Computer Science 2023-12-19 Merlijn Krale , Thiago D. Simão , Jana Tumova , Nils Jansen

Planning robust executions under uncertainty is a fundamental challenge for building autonomous robots. Partially Observable Markov Decision Processes (POMDPs) provide a standard framework for modeling uncertainty in many applications. In…

Robotics · Computer Science 2018-05-10 Yue Wang , Swarat Chaudhuri , Lydia E. Kavraki

Robots operating in complex and unknown environments frequently require geometric-semantic representations of the environment to safely perform their tasks. While inferring the environment, they must account for many possible scenarios when…

Robotics · Computer Science 2025-10-09 Tuvy Lemberg , Vadim Indelman

Managing announced task completion times is a fundamental control problem in project management. While extensive research exists on estimating task durations and task scheduling, the problem of when and how to update completion times…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Duncan Eddy , Esen Yel , Emma Passmore , Niles Egan , Grayson Armour , Dylan M. Asmar , Mykel J. Kochenderfer

Bayesian Optimisation has gained much popularity lately, as a global optimisation technique for functions that are expensive to evaluate or unknown a priori. While classical BO focuses on where to gather an observation next, it does not…

Robotics · Computer Science 2017-03-14 Philippe Morere , Roman Marchant , Fabio Ramos

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu

Mine planning is a complex task that involves many uncertainties. During early stage feasibility, available mineral resources can only be estimated based on limited sampling of ore grades from sparse drilling, leading to large uncertainty…

Neural and Evolutionary Computing · Computer Science 2023-05-30 Michael Stimson , William Reid , Aneta Neumann , Simon Ratcliffe , Frank Neumann

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

We study the continuity properties of optimal solutions to stochastic control problems with respect to initial probability measures and applications of these to the robustness of optimal control policies applied to systems with incomplete…

Systems and Control · Computer Science 2019-04-16 Ali Devran Kara , Serdar Yüksel

Understanding functional diversity, the range and variability of species' roles and actions within their communities, is key to predicting and preserving the functions that sustain both nature and human well-being. In this paper, we provide…

Populations and Evolution · Quantitative Biology 2025-07-16 Ines Meraoumia , Adji Bousso Dieng

Partially-observable problems pose a trade-off between reducing costs and gathering information. They can be solved optimally by planning in belief space, but that is often prohibitively expensive. Model-predictive control (MPC) takes the…

Machine Learning · Computer Science 2023-04-21 Baris Kayalibay , Atanas Mirchev , Ahmed Agha , Patrick van der Smagt , Justin Bayer

We consider the problem of designing policies for partially observable Markov decision processes (POMDPs) with dynamic coherent risk objectives. Synthesizing risk-averse optimal policies for POMDPs requires infinite memory and thus…

Robotics · Computer Science 2019-09-30 Mohamadreza Ahmadi , Masahiro Ono , Michel D. Ingham , Richard M. Murray , Aaron D. Ames

The problem of incorporating information from observations received serially in time is widespread in the field of uncertainty quantification. Within a probabilistic framework, such problems can be addressed using standard filtering…

Methodology · Statistics 2024-12-02 Chatchuea Kimchaiwong , Jeremie Houssineau , Adam M. Johansen

This paper addresses a fundamental question of multi-agent knowledge distribution: what information should be sent to whom and when, with the limited resources available to each agent? Communication requirements for multi-agent systems can…

Multiagent Systems · Computer Science 2019-03-08 Michael C. Fowler , T. Charles Clancy , Ryan K. Williams

In this study I proposed a filtering beliefs method for improving performance of Partially Observable Markov Decision Processes(POMDPs), which is a method wildly used in autonomous robot and many other domains concerning control policy. My…

Artificial Intelligence · Computer Science 2021-01-07 Oscar LiJen Hsu

Multi-agent decision-making under uncertainty is fundamental for effective and safe autonomous operation. In many real-world scenarios, each agent maintains its own belief over the environment and must plan actions accordingly. However,…

Multiagent Systems · Computer Science 2025-12-25 Moshe Rafaeli Shimron , Vadim Indelman