English
Related papers

Related papers: Continuity of the Value Function for Deterministic…

200 papers

We address the crucial yet underexplored stability properties of the Hamilton--Jacobi--Bellman (HJB) equation in model-free reinforcement learning contexts, specifically for Lipschitz continuous optimal control problems. We bridge the gap…

Optimization and Control · Mathematics 2024-04-23 Namkyeong Cho , Yeoneung Kim

We study the optimal control of general stochastic McKean-Vlasov equation. Such problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field…

Probability · Mathematics 2017-01-06 Huyên Pham , Xiaoli Wei

We consider a jump-diffusion mean field control problem with regime switching in the state dynamics. The corresponding value function is characterized as the unique viscosity solution of a HJB master equation on the space of probability…

Optimization and Control · Mathematics 2022-09-20 Erhan Bayraktar , Alekos Cecchin , Prakash Chakraborty

In this paper, we study the delayed stochastic recursive optimal control problem with a non-Lipschitz generator, in which both the dynamics of the control system and the recursive cost functional depend on the past path segment of the state…

Optimization and Control · Mathematics 2023-12-27 Jiaqiang Wen , Zhen Wu , Qi Zhang

This article is the starting point of a series of works whose aim is the study of deterministic control problems where the dynamic and the running cost can be completely different in two (or more) complementary domains of the space $\R^N$.…

Analysis of PDEs · Mathematics 2012-09-12 Guy Barles , Ariela Briani , Emmanuel Chasseigne

Motion planning under uncertainty for an autonomous system can be formulated as a Markov Decision Process with a continuous state space. In this paper, we propose a novel solution to this decision-theoretic planning problem that directly…

Robotics · Computer Science 2020-07-02 Junhong Xu , Kai Yin , Lantao Liu

We consider an initial value problem for a Hamilton--Jacobi equation with a quadratic and degenerate Hamiltonian. Our Hamiltonian comes from the dynamics of $N$-peakon in the Camassa--Holm equation. It is given by a quadratic form with a…

Analysis of PDEs · Mathematics 2020-07-06 Tomasz Cieślak , Jakub Siemianowski , Andrzej Święch

In this paper, a characterization of the solution of impulse control problems in terms of superharmonic functions is given. In a general Markovian framework, the value function of the impulse control problem is shown to be the minimal…

Probability · Mathematics 2013-10-17 Sören Christensen

The goal of this thesis is to provide efficient and provably convergent numerical methods for solving partial differential equations (PDEs) coming from impulse control problems motivated by finance. Impulses, which are controlled jumps in a…

Numerical Analysis · Mathematics 2018-02-05 Parsiad Azimzadeh

We study optimal control problems for interacting branching diffusion processes, a class of measure-valued dynamics capturing both spatial motion and branching mechanisms. From the perspective of the dynamic programming principle, we…

Optimization and Control · Mathematics 2026-01-19 Antonio Ocello

This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…

Optimization and Control · Mathematics 2011-10-11 Luis Rodrigues , Didier Henrion , Mehdi Abedinpour Fallah

A large number of recent studies consider a compartmental SIR model to study optimal control policies aimed at containing the diffusion of COVID-19 while minimizing the economic costs of preventive measures. Such problems are non-convex and…

Optimization and Control · Mathematics 2022-12-21 Alessandro Calvia , Fausto Gozzi , Francesco Lippi , Giovanni Zanco

We provide a dynamic programming principle for stochastic optimal control problems with expectation constraints. A weak formulation, using test functions and a probabilistic relaxation of the constraint, avoids restrictions related to a…

Optimization and Control · Mathematics 2012-12-21 Bruno Bouchard , Marcel Nutz

We prove comparison principle for viscosity solutions of a Hamilton-Jacobi-Bellman equation in a strong coupling regime considering a stationary and a time-dependent version of the equation. We consider a Hamiltonian that has a…

Analysis of PDEs · Mathematics 2023-10-10 Serena Della Corte , Richard C. Kraaij

In this paper, we study a stochastic optimal control problem under degenerate G-expectation. By using implied partition method, we show that the approximation result for admissible controls still hold. Based on this result, we prove that…

Optimization and Control · Mathematics 2022-10-19 Xiaojuan Li

We study a multiscale stochastic optimal control problem subject to state constraints on the slow variable. To address this class of problems, we develop a rigorous theoretical framework based on singular perturbation analysis, tailored to…

Optimization and Control · Mathematics 2025-08-12 Anderson O. Calixto , Bernardo Freitas Paulo da Costa , Glauco Valle

We consider a stochastic optimal control problem in a market model with temporary and permanent price impact, which is related to an expected utility maximization problem under finite fuel constraint. We establish the initial condition…

Mathematical Finance · Quantitative Finance 2015-10-13 Mourad Lazgham

For a class of quasi-variational inequalities (QVIs) of obstacle-type the stability of its solution set and associated optimal control problems are considered. These optimal control problems are non-standard in the sense that they involve…

Optimization and Control · Mathematics 2020-08-25 Amal Alphonse , Michael Hintermüller , Carlos N. Rautenberg

This paper considers a new class of deterministic finite-time horizon, two-player, zero-sum differential games (DGs) in which the maximizing player is allowed to take continuous and impulse controls whereas the minimizing player is allowed…

Optimization and Control · Mathematics 2022-12-21 Brahim El Asri , Hafid Lalioui

We consider a two-player zero-sum game with integral payoff and with incomplete information on one side, where the payoff is chosen among a continuous set of possible payoffs. We prove that the value function of this game is solution of an…

Probability · Mathematics 2012-02-23 Pierre Cardaliaguet , Catherine Rainer