English
Related papers

Related papers: The turnpike control in stochastic multi-agent dyn…

200 papers

Intersections pose critical challenges in traffic management, where maintaining operational constraints and ensuring safety are essential for efficient flow. This paper investigates the effect of intervention timing in management strategies…

Systems and Control · Electrical Eng. & Systems 2024-12-10 Salman Ghori , Ania Adil , Eric Feron

We analyze the stability of general nonlinear discrete-time stochastic systems controlled by optimal inputs that minimize an infinite-horizon discounted cost. Under a novel stochastic formulation of cost-controllability and detectability…

Optimization and Control · Mathematics 2025-04-30 Robert H. Moldenhauer , Dragan Nešić , Mathieu Granzotto , Romain Postoyan , Andrew R. Teel

We address the role of noise and the issue of efficient computation in stochastic optimal control problems. We consider a class of non-linear control problems that can be formulated as a path integral and where the noise plays the role of…

Computational Physics · Physics 2009-11-10 H. J. Kappen

In this paper we present an information theoretic approach to stochastic optimal control problems for systems with compound Poisson noise. We generalize previous work on information theoretic path integral control to discontinuous dynamics…

Optimization and Control · Mathematics 2019-07-03 Ziyi Wang , Grady Williams , Evangelos A. Theodorou

The paper addresses an existence problem for infinite horizon optimal control when the system under control is exponentially stabilizable or stable. Classes of nonlinear control systems for which infinite horizon optimal controls exist are…

Optimization and Control · Mathematics 2021-06-09 Noboru Sakamoto

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

There is a rising interest in Spatio-temporal systems described by Partial Differential Equations (PDEs) among the control community. Not only are these systems challenging to control, but the sizing and placement of their actuation is an…

Optimization and Control · Mathematics 2020-02-05 Ethan N. Evans , Andrew P. Kendall , George I. Boutselis , Evangelos A. Theodorou

Regularization of control policies using entropy can be instrumental in adjusting predictability of real-world systems. Applications benefiting from such approaches range from, e.g., cybersecurity, which aims at maximal unpredictability, to…

Systems and Control · Electrical Eng. & Systems 2026-02-18 Menno van Zutphen , Giannis Delimpaltadakis , Maurice Heemels , Duarte Antunes

In this paper, we present new types of exponential integrators for Stochastic Differential Equations (SDEs) that take the advantage of the exact solution of (generalised) geometric Brownian motion. We examine both Euler and Milstein…

Numerical Analysis · Mathematics 2016-09-29 Utku Erdoğan , Gabriel J. Lord

Under non-exponential discounting, we develop a dynamic theory for stopping problems in continuous time. Our framework covers discount functions that induce decreasing impatience. Due to the inherent time inconsistency, we look for…

Optimization and Control · Mathematics 2017-03-13 Yu-Jui Huang , Adrien Nguyen-Huu

The paper investigates the long-time behavior of zero-sum linear-quadratic stochastic differential games, aiming to demonstrate that, under appropriate conditions, both the saddle strategy and the optimal state process exhibit the…

Optimization and Control · Mathematics 2024-06-05 Jingrui Sun , Jiongmin Yong

The discrete-time implementation of the super-twisting sliding mode controller for a plant with disturbances with bounded slope, zero-order hold actuation, and actuator constraints is considered. Motivated by restrictions of existing…

Systems and Control · Electrical Eng. & Systems 2024-12-16 Richard Seeber , Benedikt Andritsch

We consider stochastic control with discretionary stopping for the drift of a diffusion process over an infinite time horizon. The objective is to choose a control process and a stopping time to minimize the expectation of a convex terminal…

Optimization and Control · Mathematics 2025-06-24 Václav E. Beneš , Georgy Gaitsgori , Ioannis Karatzas

This paper is concerned with the convergence rate of policy iteration for (deterministic) optimal control problems in continuous time. To overcome the problem of ill-posedness due to lack of regularity, we consider a semi-discrete scheme by…

Optimization and Control · Mathematics 2025-04-11 Wenpin Tang , Hung Vinh Tran , Yuming Paul Zhang

In this article we present a novel discrete-time design approach which reduces the deteriorating effects of sampling on stability and performance in digitally controlled nonlinear mechanical systems. The method is motivated by recent…

Systems and Control · Electrical Eng. & Systems 2021-04-30 Paul Kotyczka , Tobias Thoma

We establish a variety of results extending the well-known Pontryagin maximum principle of optimal control to discrete-time optimal control problems posed on smooth manifolds. These results are organized around a new theorem on critical and…

Optimization and Control · Mathematics 2017-07-14 Robert Kipka , Rohit Gupta

Many techniques originally developed in the context of deterministic control theory have been recently applied to the quest for optimal protocols in stochastic processes. Given a system subject to environmental fluctuations, one may ask…

Statistical Mechanics · Physics 2025-01-15 Dario Lucente , Alessandro Manacorda , Andrea Plati , Alessandro Sarracino , Marco Baldovin

We study a class of infinite-horizon impulse control problems with execution delay in discrete time. Using probabilistic methods, particularly the notion of the Snell envelope of processes, we construct an optimal strategy among all…

Optimization and Control · Mathematics 2025-01-22 Said Hamadène , Boualem Djehiche

Model Predictive Control (MPC) is well understood in the deterministic setting, yet rigorous stability and performance guarantees for stochastic MPC remain limited to the consideration of terminal constraints and penalties. In contrast,…

Optimization and Control · Mathematics 2025-10-24 Jonas Schießl , Hannah Selder , Ruchuan Ou , Michael Heinrich Baumann , Timm Faulwasser , Lars Grüne

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros