English
Related papers

Related papers: An Approximate Dynamic Programming Approach for Du…

200 papers

This paper presents two stochastic model predictive control methods for linear time-invariant systems subject to unbounded additive uncertainties. The new methods are developed by formulating the chance constraints into deterministic form,…

Systems and Control · Electrical Eng. & Systems 2021-04-22 Fei Li , Huiping Li , Yuyao He

Kernel embeddings of distributions have recently gained significant attention in the machine learning community as a data-driven technique for representing probability distributions. Broadly, these techniques enable efficient computation of…

Optimization and Control · Mathematics 2021-03-25 Adam J. Thorpe , Meeko M. K. Oishi

Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modeling errors.…

Systems and Control · Computer Science 2018-08-03 Patrick Slade , Zachary N. Sunberg , Mykel J. Kochenderfer

We present a multilevel stochastic gradient descent method for the optimal control of systems governed by partial differential equations under uncertain input data. The gradient descent method used to find the optimal control leverages a…

Optimization and Control · Mathematics 2025-06-04 Niklas Baumgarten , David Schneiderhan

We consider deterministic infinite horizon optimal control problems with nonnegative stage costs. We draw inspiration from learning model predictive control scheme designed for continuous dynamics and iterative tasks, and propose a rollout…

Optimization and Control · Mathematics 2021-09-30 Yuchao Li , Karl H. Johansson , Jonas Mårtensson , Dimitri P. Bertsekas

Numerically computing global policies to optimal control problems for complex dynamical systems is mostly intractable. In consequence, a number of approximation methods have been developed. However, none of the current methods can quantify…

Robotics · Computer Science 2021-03-05 Ashwin Khadke , Hartmut Geyer

The maximization of reach-avoid probabilities for stochastic systems is a central topic in the control literature. Yet, the available methods are either restricted to low-dimensional systems or suffer from conservative approximations. To…

Optimization and Control · Mathematics 2026-01-26 Niklas Schmid , Jaeyoun Choi , Oswin So , Chuchu Fan

In this paper, we investigate a worst-case-scenario control problem with a partially observed state. We consider a non-stochastic formulation, where noises and disturbances in our dynamics are uncertain variables which take values in finite…

Optimization and Control · Mathematics 2022-12-14 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

This paper deals with a family of stochastic control problems in Hilbert spaces which arises in typical applications (such as boundary control and control of delay equations with delay in the control) and for which is difficult to apply the…

Optimization and Control · Mathematics 2022-10-14 Federica Masiero , Fausto Gozzi

In this paper, a stochastic algorithm for the efficient simulation and optimal control of networked wave equations based on the random batch method is proposed and analyzed. The random approximation is constructed by dividing the time…

Optimization and Control · Mathematics 2025-12-16 Daniel Veldman , Yue Wang

One often encounters the curse of dimensionality in the application of dynamic programming to determine optimal policies for controlled Markov chains. In this paper, we provide a method to construct sub-optimal policies along with a bound…

Systems and Control · Computer Science 2011-08-17 Myoungkuk Park , Krishnamoorthy Kalyanam , Swaroop Darbha , Phil Chandler , Meir Pachter

Active inference has emerged as an alternative approach to control problems given its intuitive (probabilistic) formalism. However, despite its theoretical utility, computational implementations have largely been restricted to…

Machine Learning · Computer Science 2022-03-01 Aswin Paul , Noor Sajid , Manoj Gopalkrishnan , Adeel Razi

We consider the revenue management problem of finding profit-maximising prices for delivery time slots in the context of attended home delivery. This multi-stage optimal control problem admits a dynamic programming formulation that is…

Optimization and Control · Mathematics 2020-08-04 Denis Lebedev , Kostas Margellos , Paul Goulart

An open question in autonomous driving is how best to use simulation to validate the safety of autonomous vehicles. Existing techniques rely on simulated rollouts, which can be inefficient for finding rare failure events, while other…

Robotics · Computer Science 2020-06-29 Anthony Corso , Ritchie Lee , Mykel J. Kochenderfer

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

Rolling forecasts have been almost overlooked in the renewable energy storage literature. In this paper, we provide a new approach for handling uncertainty not just in the accuracy of a forecast, but in the evolution of forecasts over time.…

Optimization and Control · Mathematics 2022-04-18 Saeed Ghadimi , Warren B. Powell

We present an approximate dynamic programming framework for designing degradation-aware market participation policies for battery energy storage systems. The approach employs a tailored value function approximation that reduces the state…

Systems and Control · Electrical Eng. & Systems 2026-03-24 Flemming Holtorf , Sungho Shin

Sample average approximation--based stochastic dynamic programming (SDP) and model predictive control (MPC) are two different methods for approaching multistage stochastic optimization. In this paper we investigate the conditions under…

Optimization and Control · Mathematics 2026-02-10 Dominic S. T. Keehan , Andrew B. Philpott , Edward J. Anderson

This article addresses the challenge of adapting data-based models over time. We propose a novel two-fold modelling architecture designed to correct plant-model mismatch caused by two types of uncertainty. Out-of-domain uncertainty arises…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Laura Boca de Giuli , Alessio La Bella , Riccardo Scattolini