English
Related papers

Related papers: Optimal Sensing Policy With Interference-Model Unc…

200 papers

Motion planning at urban intersections that accounts for the situation context, handles occlusions, and deals with measurement and prediction uncertainty is a major challenge on the way to urban automated driving. In this work, we address…

Robotics · Computer Science 2021-10-22 Johannes Müller , Jan Strohbeck , Martin Herrmann , Michael Buchholz

We investigate the classical active pure exploration problem in Markov Decision Processes, where the agent sequentially selects actions and, from the resulting system trajectory, aims at identifying the best policy as fast as possible. We…

Machine Learning · Statistics 2021-10-26 Aymen Al Marjani , Aurélien Garivier , Alexandre Proutiere

Coordination of distributed agents is required for problems arising in many areas, including multi-robot systems, networking and e-commerce. As a formal framework for such problems, we use the decentralized partially observable Markov…

Artificial Intelligence · Computer Science 2014-01-16 Daniel S. Bernstein , Christopher Amato , Eric A. Hansen , Shlomo Zilberstein

We consider optimal sensor scheduling with unknown communication channel statistics. We formulate two types of scheduling problems with the communication rate being a soft or hard constraint, respectively. We first present some structural…

Systems and Control · Computer Science 2025-04-03 Shuang Wu , Xiaoqiang Ren , Qing-Shan Jia , Karl Henrik Johansson , Ling Shi

Markov decision processes (MDPs) are a popular model for performance analysis and optimization of stochastic systems. The parameters of stochastic behavior of MDPs are estimates from empirical observations of a system; their values are not…

Artificial Intelligence · Computer Science 2017-10-26 Dimitri Scheftelowitsch , Peter Buchholz , Vahid Hashemi , Holger Hermanns

We present a novel data-driven model predictive control (MPC) approach to control unknown nonlinear systems using only measured input-output data with closed-loop stability guarantees. Our scheme relies on the data-driven system…

Optimization and Control · Mathematics 2022-09-20 Julian Berberich , Johannes Köhler , Matthias A. Müller , Frank Allgöwer

We study a general class of dynamic multi-agent decision problems with asymmetric information and non-strategic agents, which includes dynamic teams as a special case. When agents are non-strategic, an agent's strategy is known to the other…

Multiagent Systems · Computer Science 2018-12-05 Hamidreza Tavafoghi , Yi Ouyang , Demosthenis Teneketzis

In this work we seek for an approach to integrate safety in the learning process that relies on a partly known state-space model of the system and regards the unknown dynamics as an additive bounded disturbance. We introduce a framework for…

Machine Learning · Computer Science 2018-11-12 Stanislav Fedorov , Antonio Candelieri

A challenging category of robotics problems arises when sensing incurs substantial costs. This paper examines settings in which a robot wishes to limit its observations of state, for instance, motivated by specific considerations of energy…

Robotics · Computer Science 2023-09-26 Patrick Zhong , Federico Rossi , Dylan A. Shell

Markov decision processes (MDPs) are widely used for modeling decision-making problems in robotics, automated control, and economics. Traditional MDPs assume that the decision maker (DM) knows all states and actions. However, this may not…

Artificial Intelligence · Computer Science 2014-07-29 Joseph Y. Halpern , Nan Rong , Ashutosh Saxena

Markov decision processes (MDPs) are widely used for modeling decision-making problems in robotics, automated control, and economics. Traditional MDPs assume that the decision maker (DM) knows all states and actions. However, this may not…

Artificial Intelligence · Computer Science 2010-06-14 Joseph Y. Halpern , Nan Rong , Ashutosh Saxena

The distributionally robust Markov Decision Process (MDP) approach asks for a distributionally robust policy that achieves the maximal expected total reward under the most adversarial distribution of uncertain parameters. In this paper, we…

Systems and Control · Computer Science 2018-10-10 Zhi Chen , Pengqian Yu , William B. Haskell

The paper proposes an intermittent communication mechanism for the tracking consensus of high-order nonlinear multi-agent systems (MASs) surrounded by random disturbances. Each collaborating agent is described by a class of high-order…

Systems and Control · Electrical Eng. & Systems 2024-01-12 Ali Azarbahram

This paper considers optimal attack attention allocation on remote state estimation in multi-systems. Suppose there are $\mathtt{M}$ independent systems, each of which has a remote sensor monitoring the system and sending its local…

Systems and Control · Computer Science 2016-09-06 Xiaoqiang Ren , Junfeng Wu , Subhrakanti Dey , Ling Shi

Designing data-driven controllers in the presence of noise is an important research problem, in particular when guarantees on stability, robustness, and constraint satisfaction are desired. In this paper, we propose a data-driven min-max…

Systems and Control · Electrical Eng. & Systems 2023-10-02 Yifan Xie , Julian Berberich , Frank Allgower

In this paper, we consider the problem of optimizing the worst-case behavior of a partially observed system. All uncontrolled disturbances are modeled as finite-valued uncertain variables. Using the theory of cost distributions, we present…

Optimization and Control · Mathematics 2023-02-21 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

Addressing uncertainty is critical for autonomous systems to robustly adapt to the real world. We formulate the problem of model uncertainty as a continuous Bayes-Adaptive Markov Decision Process (BAMDP), where an agent maintains a…

Bounded agents are limited by intrinsic constraints on their ability to process information that is available in their sensors and memory and choose actions and memory updates. In this dissertation, we model these constraints as…

Machine Learning · Computer Science 2017-03-31 Roy Fox

Covert planning refers to a class of constrained planning problems where an agent aims to accomplish a task with minimal information leaked to a passive observer to avoid detection. However, existing methods of covert planning often…

Multiagent Systems · Computer Science 2023-11-02 Haoxiang Ma , Chongyang Shi , Shuo Han , Michael R. Dorothy , Jie Fu

The problem of interference management is considered in the context of a linear interference network that is subject to long term channel fluctuations due to shadow fading. The fading model used is one where each link in the network is…

Information Theory · Computer Science 2018-07-18 Tolunay Seyfi , Yasemin Karacora , Aly El Gamal