English
Related papers

Related papers: Robustness to incorrect system models in stochasti…

200 papers

Stochastic policies (also known as relaxed controls) are widely used in continuous-time reinforcement learning algorithms. However, executing a stochastic policy and evaluating its performance in a continuous-time environment remain open…

Machine Learning · Computer Science 2025-10-03 Yanwei Jia , Du Ouyang , Yufei Zhang

We consider an average cost stochastic control problem with standard Borel spaces and an unknown transition kernel. We do not assume a parametric structure on the unknown kernel. We present topologies on kernels which lead to their…

Optimization and Control · Mathematics 2025-03-27 Omar Mrani-Zentar , Serdar Yüksel

We consider the problem of finite-horizon optimal control design under uncertainty for imperfectly observed discrete-time systems with convex costs and constraints. It is known that this problem can be cast as an infinite-dimensional convex…

Optimization and Control · Mathematics 2019-04-02 Kevin J. Kircher , K. Max Zhang

Control systems can show robustness to many events, like disturbances and model inaccuracies. It is natural to speculate that they are also robust to sporadic deadline misses when implemented as digital tasks on an embedded platform. This…

Optimization and Control · Mathematics 2022-08-31 Nils Vreman , Paolo Pazzaglia , Jie Wang , Victor Magron , Martina Maggio

In optimal control problems, disturbances are typically dealt with using robust solutions, such as H-infinity or tube model predictive control, that plan control actions feasible for the worst-case disturbance. Yet, planning for every…

Optimization and Control · Mathematics 2020-08-27 Luiz F. O. Chamon , Alexandre Amice , Santiago Paternain , Alejandro Ribeiro

Conformal risk control (CRC) provides distribution-free guarantees for controlling the expected loss at a user-specified level. Existing theory typically assumes that the loss decreases monotonically with a tuning parameter that governs the…

Machine Learning · Statistics 2026-04-21 Tareq Aldirawi , Yun Li , Wenge Guo

Model predictive control solves a constrained optimization problem online in order to compute an implicit closed-loop control policy. Recursive feasibility -- guaranteeing that the optimal control problem will have a solution at every time…

Optimization and Control · Mathematics 2024-10-16 Jacob W. Knaup , Panagiotis Tsiotras

A desirable property of control systems is to be robust to inputs, that is small perturbations of the inputs of a system will cause only small perturbations on its outputs. But it is not clear whether this property is maintained at the…

Software Engineering · Computer Science 2013-09-17 Eric Goubault , Sylvie Putot

We provide sufficient conditions that guarantee the existence of relaxed optimal controls in the weak formulation of stochastic control problems for stochastic Volterra equations (SVEs). Our study can be applied to rough processes that…

Optimization and Control · Mathematics 2024-03-18 Andrés Cárdenas , Sergio Pulido , Rafael Serrano

We study online control of an unknown nonlinear dynamical system that is approximated by a time-invariant linear system with model misspecification. Our study focuses on robustness, a measure of how much deviation from the assumed linear…

Optimization and Control · Mathematics 2022-04-06 Xinyi Chen , Udaya Ghai , Elad Hazan , Alexandre Megretski

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu

This paper proposes a robust regret control framework in which the performance baseline adapts to the realization of system uncertainty. The plant is modeled as a discrete-time, uncertain linear time-invariant system with real-parametric…

Optimization and Control · Mathematics 2025-10-27 Jietian Liu , Peter Seiler

While $\mathcal{H}_\infty$ methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastically reduced. Though this fundamental tradeoff between…

Systems and Control · Electrical Eng. & Systems 2023-05-29 Bruce D. Lee , Thomas T. C. K. Zhang , Hamed Hassani , Nikolai Matni

In this paper, we develop a unified framework for studying constrained robust optimal control problems with adjustable uncertainty sets. In contrast to standard constrained robust optimal control problems with known uncertainty sets, we…

Optimization and Control · Mathematics 2016-06-09 Xiaojing Zhang , Maryam Kamgarpour , Angelos Georghiou , Paul Goulart , John Lygeros

Control of multi-level quantum systems is sensitive to implementation errors in the control field and uncertainties associated with system Hamiltonian parameters. A small variation in the control field spectrum or the system Hamiltonian can…

Quantum Physics · Physics 2015-06-23 Andy Koswara , Raj Chakrabarti

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

Automated synthesis of correct-by-construction controllers for autonomous systems is crucial for their deployment in safety-critical scenarios. Such autonomous systems are naturally modeled as stochastic dynamical models. The general…

Systems and Control · Electrical Eng. & Systems 2023-11-17 Thom Badings , Nils Jansen , Licio Romao , Alessandro Abate

Discrete-time stochastic systems are an essential modelling tool for many engineering systems. We consider stochastic control systems that are evolving over continuous spaces. For this class of models, methods for the formal verification…

Systems and Control · Computer Science 2018-11-29 Sofie Haesaert , Sadegh Soudjani

This paper addresses a fundamental and important question in control: under what conditions does there fail to exist a robust control policy that keeps the state of a constrained linear system within a target set, despite bounded…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Paul Trodden , José M. Maestre , Hideaki Ishii