English
Related papers

Related papers: Dynamic programming principle and Hamilton-Jacobi-…

200 papers

In this paper, we consider the functional It\^o calculus framework to find a path-dependent version of the Hamilton-Jacobi-Bellman equation for stochastic control problems that feature dynamics and running cost that depend on the path of…

Probability · Mathematics 2019-02-11 Yuri F. Saporito

Distributed-order fractional non-local operators have been introduced and studied by Caputo at the end of the 20th century. They generalize fractional order derivatives/integrals in the sense that such operators are defined by a weighted…

Optimization and Control · Mathematics 2020-10-27 Faical Ndairou , Delfim F. M. Torres

The paper deals with a zero-sum differential game in which the dynamical system is described by a fractional differential equation with the Caputo derivative of an order $\alpha \in (0, 1).$ The goal of the first (second) player is to…

Optimization and Control · Mathematics 2019-08-06 Mikhail Gomoyunov

Optimal control problem is typically solved by first finding the value function through Hamilton-Jacobi equation (HJE) and then taking the minimizer of the Hamiltonian to obtain the control. In this work, instead of focusing on the value…

Optimization and Control · Mathematics 2021-09-10 Alain Bensoussan , Jiayue Han , Sheung Chi Phillip Yam , Xiang Zhou

Autonomous systems have witnessed a rapid increase in their capabilities, but it remains a challenge for them to perform tasks both effectively and safely. The fact that performance and safety can sometimes be competing objectives renders…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Hao Wang , Adityaya Dhande , Somil Bansal

Within the framework of viscosity solution, we study the relationship between the maximum principle (MP) in [9] and the dynamic programming principle (DPP) in [10] for a fully coupled forward-backward stochastic controlled system (FBSCS)…

Optimization and Control · Mathematics 2018-05-17 Mingshang Hu , Shaolin Ji , Xiaole Xue

We investigate feedback control for infinite horizon optimal control problems for partial differential equations. The method is based on the coupling between Hamilton-Jacobi-Bellman (HJB) equations and model reduction techniques. It is…

Optimization and Control · Mathematics 2016-07-11 Alessandro Alla , Andreas Schmidt , Bernard Haasdonk

In this paper we consider the optimal control of Hilbert space-valued infinite-dimensional Piecewise Deterministic Markov Processes (PDMP) and we prove that the corresponding value function can be represented via a Feynman-Kac type formula…

Optimization and Control · Mathematics 2019-06-07 Elena Bandini , Michele Thieullen

An abstract framework guaranteeing the local continuous differentiability of the value function associated with optimal stabilization problems subject to abstract semilinear parabolic equations subject to a norm constraint on the controls…

Optimization and Control · Mathematics 2023-05-19 Karl Kunisch , Buddhika Priyasad

We revisit the linear programming approach to deterministic, continuous time, infinite horizon discounted optimal control problems. In the first part, we relax the original problem to an infinite-dimensional linear program over a measure…

Optimization and Control · Mathematics 2017-06-08 Angeliki Kamoutsi , Tobias Sutter , Peyman Mohajerin Esfahani , John Lygeros

We propose a parallel algorithm for the numerical solution of a class of second order semi-linear equations coming from stochastic optimal control problems, by means of a dynamic domain decomposition technique. The new method is an…

Numerical Analysis · Mathematics 2016-02-11 Simone Cacace , Maurizio Falcone

We show that the value function of a stochastic control problem is the unique solution of the associated Hamilton-Jacobi-Bellman (HJB) equation, completely avoiding the proof of the so-called dynamic programming principle (DPP). Using…

Probability · Mathematics 2013-09-25 Erhan Bayraktar , Mihai Sirbu

We characterize the value of swing contracts in continuous time as the unique viscosity solution of a Hamilton-Jacobi-Bellman equation with suitable boundary conditions. The case of contracts with penalties is straightforward, and in that…

Optimization and Control · Mathematics 2013-07-05 M. Basei , A. Cesaroni , T. Vargiolu

We consider a stochastic control problem with the assumption that the system is controlled until the state process breaks the fixed barrier. Assuming some general conditions, it is proved that the resulting Hamilton Jacobi Bellman equations…

Optimization and Control · Mathematics 2025-03-24 Dariusz Zawisza

Problem of time-optimal control of linear systems with fractional dynamics is treated in the paper from the convex-analytic standpoint. A linear system of fractional differential equations involving Riemann--Liouville derivatives is…

Optimization and Control · Mathematics 2020-07-02 Ivan Matychyn

This paper presents an efficient numerical method for solving fractional optimal control problems using an operational matrix for a fractional wavelet. Using well-known formulae such as Caputo and Riemann-Liouville operators to determine…

Optimization and Control · Mathematics 2023-10-11 S. Saha Ray , Akanksha Singh

We study an optimal control problem of McKean--Vlasov branching diffusion processes, in which the interaction term is determined by the marginal measure induced by all alive particles in the system. Accordingly, the value function is…

Optimization and Control · Mathematics 2025-12-02 Julien Claisse , Jiazhi Kang , Tianxu Lan , Xiaolu Tan

We obtain a maximum principle for stochastic control problem of general controlled stochastic differential systems driven by fractional Brownian motions (of Hurst parameter $H>1/2$). This maximum principle specifies a system of equations…

Optimization and Control · Mathematics 2012-03-15 Yuecai Han , Yaozhong Hu , Jian Song

A finite horizon linear quadratic(LQ) optimal control problem is studied for a class of discrete-time linear fractional systems (LFSs) affected by multiplicative, independent random perturbations. Based on the dynamic programming technique,…

Optimization and Control · Mathematics 2016-07-01 J. J. Trujillo , V. M. Ungureanu

This paper deals with a stochastic recursive optimal control problem, where the diffusion coefficient depends on the control variable and the control domain is not necessarily convex. We focus on the connection between the general maximum…

Optimization and Control · Mathematics 2016-12-21 Tianyang Nie , Jingtao Shi , Zhen Wu