English
Related papers

Related papers: Discrete-time approximation for stochastic optimal…

200 papers

We study stochastic optimal control problems for (possibly degenerate) McKean-Vlasov controlled diffusions and obtain discrete-time as well as finite interacting particle approximations. (i) Under mild assumptions, we first prove the…

Optimization and Control · Mathematics 2025-10-27 Somnath Pradhan , Serdar Yuksel

This paper deals with partially-observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational…

Optimization and Control · Mathematics 2020-10-15 Shuaiqi Zhang , Xun Li , Jie Xiong

In this paper, we study the stochastic optimal control problem for control system with time-varying delay. The corresponding stochastic differential equation is a kind of stochastic differential delay equation. We prove the existence and…

Optimization and Control · Mathematics 2024-01-17 Yuhang Li , Yuecai Han

We study a class of infinite-horizon impulse control problems with execution delay in discrete time. Using probabilistic methods, particularly the notion of the Snell envelope of processes, we construct an optimal strategy among all…

Optimization and Control · Mathematics 2025-01-22 Said Hamadène , Boualem Djehiche

In this paper, we study the optimal control of a discrete-time stochastic differential equation (SDE) of mean-field type, where the coefficients can depend on both a function of the law and the state of the process. We establish a new…

Optimization and Control · Mathematics 2022-10-05 Arzu Ahmadova , Nazim I. Mahmudov

In this paper, we propose an efficient implementation of deep policy gradient method (PGM) for optimal control problems in continuous time. The proposed method has the ability to manage the allocation of computational resources, number of…

Optimization and Control · Mathematics 2025-02-25 Arash Fahim , Md. Arafatur Rahman

A numerical method is proposed for a class of stochastic control problems including singular behavior. This method solves an infinite-dimensional linear program equivalent to the stochastic control problem using a finite element type…

Probability · Mathematics 2018-06-11 Martin G. Vieten , Richard H. Stockbridge

In this paper, we consider optimal control problems derived by stochastic systems with delay, where control domains are non-convex and the diffusion coefficients depend on control variables. By an estimate of the integral of…

Optimization and Control · Mathematics 2022-10-25 Qixia Zhang

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry

We consider a class of stochastic optimal control problems for discrete-time stochastic linear systems which seek for control policies that will steer the probability distribution of the terminal state of the system close to a desired…

Optimization and Control · Mathematics 2020-10-01 Isin M. Balci , Efstathios Bakolas

We present discrete-time approximation of optimal control policies for infinite horizon discounted/ergodic control problems for controlled diffusions in $\Rd$\,. In particular, our objective is to show near optimality of optimal policies…

Optimization and Control · Mathematics 2025-02-11 Somnath Pradhan , Serdar Yuksel

In this paper, we study a stochastic optimal control problem under a type of consistent convex expectation dominated by G-expectation. By the separation theorem for convex sets, we get the representation theorems for this convex expectation…

Optimization and Control · Mathematics 2024-08-21 Xiaojuan Li , Mingshang Hu

The stochastic interpolant framework offers a powerful approach for constructing generative models based on ordinary differential equations (ODEs) or stochastic differential equations (SDEs) to transform arbitrary data distributions.…

Machine Learning · Computer Science 2025-07-29 Yuhao Liu , Yu Chen , Rui Hu , Longbo Huang

In this paper we consider discrete time stochastic optimal control problems over infinite and finite time horizons. We show that for a large class of such problems the Taylor polynomials of the solutions to the associated Dynamic…

Optimization and Control · Mathematics 2019-03-26 Arthur J Krener

This paper presents a rigorous finite element framework for solving an optimal control problem governed by the steady Navier-Stokes-Brinkman equations, focusing on identifying a scalar permeability parameter $\gamma$ from local velocity…

Numerical Analysis · Mathematics 2025-03-12 Jorge Aguayo Araneda , Julie Merten

We consider a semi-Lagrangian scheme for solving the minimum time problem, with a given target, and the associated eikonal type equation. We first use a discrete time deterministic optimal control problem interpretation of the time…

Optimization and Control · Mathematics 2024-07-10 Marianne Akian , Shanqing Liu

Piecewise constant control approximation provides a practical framework for designing numerical schemes of continuous-time control problems. We analyze the accuracy of such approximations for extended mean field control (MFC) problems,…

Optimization and Control · Mathematics 2025-09-03 Christoph Reisinger , Wolfgang Stockinger , Maria Olympia Tsianni , Yufei Zhang

We prove a general existence result in stochastic optimal control in discrete time where controls take values in conditional metric spaces, and depend on the current state and the information of past decisions through the evolution of a…

Optimization and Control · Mathematics 2018-12-19 Asgar Jamneshan , Michael Kupper , José Miguel Zapata

We consider a control constrained parabolic optimal control problem and use variational discretization for its time semi-discretization. The state equation is treated with a Petrov-Galerkin scheme using a piecewise constant Ansatz for the…

Optimization and Control · Mathematics 2015-03-09 Nikolaus von Daniels , Michael Hinze , Morten Vierling