English
Related papers

Related papers: Stochastic viability and dynamic programming

200 papers

This paper presents the open-source stochastic model predictive control framework GRAMPC-S for nonlinear uncertain systems with chance constraints. It provides several uncertainty propagation methods to predict stochastic moments of the…

Systems and Control · Electrical Eng. & Systems 2025-07-25 Daniel Landgraf , Andreas Völz , Knut Graichen

In this paper we propose a stochastic model predictive control (MPC) algorithm for linear discrete-time systems affected by possibly unbounded additive disturbances and subject to probabilistic constraints. Constraints are treated in…

Systems and Control · Computer Science 2019-02-15 Lukas Hewing , Melanie N. Zeilinger

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

This paper considers the relaxed version of the transport problem for general nonlinear control systems, where the objective is to design time-varying feedback laws that transport a given initial probability measure to a target probability…

Systems and Control · Computer Science 2018-07-27 Karthik Elamvazhuthi , Piyush Grover , Spring Berman

We study discrete-time finite-horizon optimal control problems in probability spaces, whereby the state of the system is a probability measure. We show that, in many instances, the solution of dynamic programming in probability spaces…

Optimization and Control · Mathematics 2024-04-09 Antonio Terpin , Nicolas Lanzetti , Florian Dörfler

We present a stochastic predictive controller for discrete time linear time invariant systems under incomplete state information. Our approach is based on a suitable choice of control policies, stability constraints, and employment of a…

Optimization and Control · Mathematics 2018-02-27 Prabhat Kumar Mishra , Debasish Chatterjee , Daniel E. Quevedo

Designing spacecraft trajectories remains challenging in the presence of stochastic effects such as maneuver execution errors and observation uncertainties. Although covariance control and belief-space planning provide useful tools for…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Masahiro Fujiwara , Naoya Ozaki

The study of density-dependent stochastic population processes is important from a historical perspective as well as from the perspective of a number of existing and emerging applications today. In more recent applications of these…

Optimization and Control · Mathematics 2017-09-26 Yingdong Lu , Mark Squillante , Chai Wah Wu

We consider the problem of steering, via output feedback, the state distribution of a discrete-time, linear stochastic system from an initial Gaussian distribution to a terminal Gaussian distribution with prescribed mean and maximum…

Optimization and Control · Mathematics 2020-09-11 Jack Ridderhof , Kazuhide Okamoto , Panagiotis Tsiotras

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

We prove a general existence result in stochastic optimal control in discrete time where controls take values in conditional metric spaces, and depend on the current state and the information of past decisions through the evolution of a…

Optimization and Control · Mathematics 2018-12-19 Asgar Jamneshan , Michael Kupper , José Miguel Zapata

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

A properly designed controller can help improve the quality of experimental measurements or force a dynamical system to follow a completely new time-evolution path. Recent developments in deep reinforcement learning have made steep advances…

Statistical Mechanics · Physics 2025-02-26 Ruslan Mukhamadiarov

Stochastic feedback systems give rise to a variety of notions of stability. The conditions for the stability of the median, mean, and variance stability conditions differ. These conditions can be stated explicitly for scalar discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-19 Roy S. Smith , Bassam Bamieh

We compute probabilistic controlled invariant sets for nonlinear systems using Gaussian process state space models, which are data-driven models that account for unmodeled and unknown nonlinear dynamics. We propose a semidefinite…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Paul Griffioen , Bingzhuo Zhong , Murat Arcak , Majid Zamani , Marco Caccamo

Stochastic Model Predictive Control has proved to be an efficient method to plan trajectories in uncertain environments, e.g., for autonomous vehicles. Chance constraints ensure that the probability of collision is bounded by a predefined…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Tim Brüdigam , Fulvio di Luzio , Lucia Pallottino , Dirk Wollherr , Marion Leibold

Discrete-time stochastic systems with continuous spaces are hard to verify and control, even with MDP abstractions due to the curse of dimensionality. We propose an abstraction-based framework with robust dynamic programming mappings that…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Ruohan Wang , Siyuan Liu , Zhiyong Sun , Sofie Haesaert

The paper investigates dynamical systems for which the derivative of some positive-definite function along the solutions of this system depends on so-called density function. In turn, such dynamical systems are called density systems. The…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Igor Furtat

This paper develops a variational inference framework for control of infinite dimensional stochastic systems. We employ a measure theoretic approach which relies on the generalization of Girsanov's theorem, as well as the relation between…

Optimization and Control · Mathematics 2018-09-11 George I. Boutselis , Marcus Pereira , Evangelos A. Theodorou