English
Related papers

Related papers: Worst-Case Control and Learning Using Partial Obse…

200 papers

A self-learning approach for optimal feedback gains for finite-horizon nonlinear continuous time control systems is proposed and analysed. It relies on parameter dependent approximations to the optimal value function obtained from a family…

Optimization and Control · Mathematics 2023-02-28 Karl Kunisch , Daniel Walter

We approach the fundamental problem of obstacle avoidance for robotic systems via the lens of online learning. In contrast to prior work that either assumes worst-case realizations of uncertainty in the environment or a stationary…

Robotics · Computer Science 2023-11-07 David Snyder , Meghan Booker , Nathaniel Simon , Wenhan Xia , Daniel Suo , Elad Hazan , Anirudha Majumdar

We propose an optimal control framework for persistent monitoring problems where the objective is to control the movement of mobile nodes to minimize an uncertainty metric in a given mission space. For multi agent in a one-dimensional…

Systems and Control · Computer Science 2012-02-29 Christos. G. Cassandras , Xuchao Lin , Xu Chu Ding

The problem of continuous inverse optimal control (over finite time horizon) is to learn the unknown cost function over the sequence of continuous control variables from expert demonstrations. In this article, we study this fundamental…

Machine Learning · Computer Science 2022-04-20 Yifei Xu , Jianwen Xie , Tianyang Zhao , Chris Baker , Yibiao Zhao , Ying Nian Wu

We consider control of uncertain linear time-varying stochastic systems from the perspective of regret minimization. Specifically, we focus on the problem of designing a feedback controller that minimizes the loss relative to a clairvoyant…

Systems and Control · Electrical Eng. & Systems 2024-07-04 Andrea Martin , Luca Furieri , Florian Dörfler , John Lygeros , Giancarlo Ferrari-Trecate

We present a novel data-driven distributionally robust Model Predictive Control formulation for unknown discrete-time linear time-invariant systems affected by unknown and possibly unbounded additive uncertainties. We use off-line collected…

Optimization and Control · Mathematics 2022-09-20 Francesco Micheli , Tyler Summers , John Lygeros

Assessing the systemic effects of uncertainty that arises from agents' partial observation of the true states of the world is critical for understanding a wide range of scenarios. Yet, previous modeling work on agent learning and…

Adaptation and Self-Organizing Systems · Physics 2022-04-15 Wolfram Barfuss , Richard P. Mann

We consider a continuous-time linear-quadratic Gaussian control problem with partial observations and costly information acquisition. More precisely, we assume the drift of the state process to be governed by an unobservable…

Optimization and Control · Mathematics 2024-08-20 Christoph Knochenhauer , Alexander Merkel , Yufei Zhang

Optimal control provides a principled framework for transforming dynamical system models into intelligent decision-making, yet classical computational approaches are often too expensive for real-time deployment in dynamic or uncertain…

Optimization and Control · Mathematics 2026-01-01 Wuzhe Xu , Jiequn Han , Rongjie Lai

This paper focuses on developing a strategy for control of systems whose dynamics are almost entirely unknown. This situation arises naturally in a scenario where a system undergoes a critical failure. In that case, it is imperative to…

Optimization and Control · Mathematics 2017-10-17 Melkior Ornik , Arie Israel , Ufuk Topcu

Inverse optimal control (IOC) aims to estimate the underlying cost that governs the observed behavior of an expert system. However, in practical scenarios, the collected data is often corrupted by noise, which poses significant challenges…

Optimization and Control · Mathematics 2026-02-10 Ziliang Wang , Axel Ringh , Han Zhang

Reactive (memoryless) policies are sufficient in completely observable Markov decision processes (MDPs), but some kind of memory is usually necessary for optimal control of a partially observable MDP. Policies with finite memory can be…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Leonid Peshkin , Kee-Eung Kim , Leslie Pack Kaelbling

Due to their relevance in systems analysis and (robust) controller design, we consider the problem of determining control-theoretic system properties of an a priori unknown system from data only. More specifically, we introduce a necessary…

Systems and Control · Electrical Eng. & Systems 2020-02-11 Anne Koch , Julian Berberich , Johannes Köhler , Frank Allgöwer

Computational approaches to PDE-constrained optimization under uncertainty may involve finite-dimensional approximations of control and state spaces, sample average approximations of measures of risk and reliability, smooth approximations…

Optimization and Control · Mathematics 2022-09-01 Peng Chen , Johannes O. Royset

Learning to control unknown nonlinear dynamical systems is a fundamental problem in reinforcement learning and control theory. A commonly applied approach is to first explore the environment (exploration), learn an accurate model of it…

Machine Learning · Computer Science 2023-06-16 Andrew Wagenmaker , Guanya Shi , Kevin Jamieson

This paper presents a new approach to Model Predictive Control for environments where essential, discrete variables are partially observed. Under this assumption, the belief state is a probability distribution over a finite number of…

Robotics · Computer Science 2023-02-02 Camille Phiquepal , Marc Toussaint

This paper considers linear discrete-time systems with additive disturbances, and designs a Model Predictive Control (MPC) law to minimise a quadratic cost function subject to a chance constraint. The chance constraint is defined as a…

Systems and Control · Computer Science 2020-07-15 Shuhao Yan , Paul Goulart , Mark Cannon

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

Optimal and safety-critical control are fundamental problems for stochastic systems, and are widely considered in real-world scenarios such as robotic manipulation and autonomous driving. In this paper, we consider the problem of…

Systems and Control · Electrical Eng. & Systems 2024-05-10 Zhuoyuan Wang , Reece Keller , Xiyu Deng , Kenta Hoshino , Takashi Tanaka , Yorie Nakahira

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli