English
Related papers

Related papers: Series Solution of Discrete Time Stochastic Optima…

200 papers

This paper proposes a general formulation for temporal parallelisation of dynamic programming for optimal control problems. We derive the elements and associative operators to be able to use parallel scans to solve these problems with…

Optimization and Control · Mathematics 2022-01-25 Simo Särkkä , Ángel F. García-Fernández

We present a methodology for obtaining explicit solutions to infinite time horizon optimal stopping problems involving general, one-dimensional, It\^o diffusions, payoff functions that need not be smooth and state-dependent discounting.…

Computational Finance · Quantitative Finance 2012-10-10 Timothy C. Johnson

This work introduces a stochastic model predictive control scheme for dynamic chance constraints. We consider linear discrete-time systems affected by unbounded additive stochastic disturbance. To synthesize an optimal controller, we solve…

Systems and Control · Electrical Eng. & Systems 2023-07-26 Maico Hendrikus Wilhelmus Engelaar , Sofie Haesaert , Mircea Lazar

The paper is devoted to the study of a new class of optimal control problems governed by discontinuous constrained differential inclusions of the sweeping type with involving the duration of the dynamic process into optimization. We develop…

Optimization and Control · Mathematics 2023-10-18 Giovanni Colombo , Boris S. Mordukhovich , Dao Nguyen , Trang Nguyen

We consider the optimal control problem of a general nonlinear spatio-temporal system described by Partial Differential Equations (PDEs). Theory and algorithms for control of spatio-temporal systems are of rising interest among the…

Optimization and Control · Mathematics 2021-04-12 Ethan N. Evans , Oswin So , Andrew P. Kendall , Guan-Horng Liu , Evangelos A. Theodorou

In insurance mathematics optimal control problems over an infinite time horizon arise when computing risk measures. Their solutions correspond to solutions of deterministic semilinear (degenerate) elliptic partial differential equations. In…

Mathematical Finance · Quantitative Finance 2020-12-11 Stefan Kremsner , Alexander Steinicke , Michaela Szölgyenyi

A class of optimal control problems governed by linear fractional diffusion equation with control constraint is considered. We first establish some results on the existence of strong solution to the state equation and the existence of…

Optimization and Control · Mathematics 2022-11-24 Bui Trong Kien , Bui Ngoc Muoi , Ching-Feng Wen , Jen-Chih Yao

In this paper we extend dynamic programming techniques to the study of discrete-time infinite horizon optimal control problems on compact control invariant sets with state-independent best asymptotic average cost. To this end we analyse the…

Optimization and Control · Mathematics 2023-05-22 David Angeli , Lars Grüne

In this paper, we study the necessary and sufficient conditions for ensuring the well-posedness of the stochastic singular systems. Moreover, we investigate the stochastic singular linear-quadratic control problems, considering both finite…

Optimization and Control · Mathematics 2024-09-04 Mengzhen Li , Tianyang Nie , Zhen Wu

A time-inconsistent optimal control problem is formulated and studied for a controlled linear ordinary differential equation with quadratic cost functional. A notion of equilibrium control is introduced, which can be regarded as a…

Optimization and Control · Mathematics 2012-04-10 Jiongmin Yong

We revisit the linear programming approach to deterministic, continuous time, infinite horizon discounted optimal control problems. In the first part, we relax the original problem to an infinite-dimensional linear program over a measure…

Optimization and Control · Mathematics 2017-06-08 Angeliki Kamoutsi , Tobias Sutter , Peyman Mohajerin Esfahani , John Lygeros

We consider both discrete and continuous "uncertain horizon" deterministic control processes, for which the termination time is a random variable. We examine the dynamic programming equations for the value function of such processes,…

Optimization and Control · Mathematics 2016-01-06 June Andrews , Alexander Vladimirsky

This work presents a novel algorithm for impulsive optimal control of linear time-varying systems with the inclusion of input magnitude constraints. Impulsive optimal control problems, where the optimal input solution is a sum of delta…

Optimization and Control · Mathematics 2026-03-17 Ethan Foss , Simone D'Amico

This paper is concerned with a time-inconsistent stochastic optimal control problem in an infinite time horizon with a non-degenerate diffusion in the state equation. A major assumption is that people become rational after a large time.…

Optimization and Control · Mathematics 2025-09-19 Qingmeng Wei , Jiongmin Yong

We propose a machine learning algorithm for solving finite-horizon stochastic control problems based on a deep neural network representation of the optimal policy functions. The algorithm has three features: (1) It can solve…

General Economics · Economics 2024-12-09 Xianhua Peng , Steven Kou , Lekang Zhang

In this paper, we investigate dynamic optimization problems featuring both stochastic control and optimal stopping in a finite time horizon. The paper aims to develop new methodologies, which are significantly different from those of mixed…

Portfolio Management · Quantitative Finance 2014-06-27 Xiongfei Jian , Xun Li , Fahuai Yi

In this paper, we study asymptotic properties of problems of control of stochastic discrete time systems (also known as Markov decision processes) with time averaging and time discounting optimality criteria, and we establish that the…

Optimization and Control · Mathematics 2022-03-09 Konstantin Avrachenkov , Vladimir Gaitsgory , Lucas Gamertsfelder

This note is addressed to giving a short introduction to control theory of stochastic systems, governed by stochastic differential equations in both finite and infinite dimensions. We will mainly explain the new phenomenon and difficulties…

Optimization and Control · Mathematics 2016-12-09 Qi Lu , Xu Zhang

This paper is concerned with the distributed control and stabilization problems for linear discrete-time large scale systems with imposed constraints. The main contributions of this paper are: Firstly, by using the maximum principle…

Optimization and Control · Mathematics 2018-01-03 Qingyuan Qi , Huanshui Zhang , Peijun Ju

Discrete-time robust optimal control problems generally take a min-max structure over continuous variable spaces, which can be difficult to solve in practice. In this paper, we extend the class of such problems that can be solved through a…

Optimization and Control · Mathematics 2024-04-30 Jad Wehbeh , Eric C. Kerrigan