English
Related papers

Related papers: Equilibrium under Time-Inconsistency: A New Existe…

200 papers

This paper characterizes differentiable subgame perfect equilibria in a continuous time intertemporal decision optimization problem with non-constant discounting. The equilibrium equation takes two different forms, one of which is…

Optimization and Control · Mathematics 2007-05-23 Ivar Ekeland , Ali Lazrak

We show that necessary and sufficient conditions of optimality in periodic optimization problems can be stated in terms of a solution of the corresponding HJB inequality, the latter being equivalent to a max-min type variational problem…

Optimization and Control · Mathematics 2013-09-10 Vladimir Gaitsgory , Ludmila Manic

In this paper we establish periodic homogenization for Hamilton-Jacobi-Bellman (HJB) equations, associated to nonlocal operators of integro-differential type. We consider the case when the fractional diffusion has the same order as the…

Analysis of PDEs · Mathematics 2020-02-24 Adina Ciomaga , Daria Ghilli , Erwin Topp

The purpose of this article is to prove existence, uniqueness and uniform gradient estimates for unbounded classical solutions of a Hamilton-Jacobi-Bellman equation. Such an equation naturally arises in stochastic control problems. Contrary…

Analysis of PDEs · Mathematics 2023-09-26 Louis-Pierre Chaintron

This paper considers time-inconsistent problems when control and stopping strategies are required to be made simultaneously (called stopping control problems by us). We first formulate the timeinconsistent stopping control problems under…

Optimization and Control · Mathematics 2023-06-21 Zongxia Liang , Fengyi Yuan

The Hamilton-Jacobi-Bellman equation (HJB) associated with the time inhomogeneous singular control problem is a parabolic partial differential equation, and the existence of a classical solution is usually difficult to prove. In this paper,…

Optimization and Control · Mathematics 2014-10-14 Yipeng Yang

This paper introduces a notion of viscosity solutions for second order elliptic Hamilton-Jacobi-Bellman (HJB) equations with infinite delay associated with infinite-horizon optimal control problems for stochastic differential equations with…

Optimization and Control · Mathematics 2021-12-28 Jianjun Zhou

A classical problem in ergodic continuous time control consists of studying the limit behavior of the optimal value of a discounted cost functional with infinite horizon as the discount factor $\lambda$ tends to zero. In the literature,…

Optimization and Control · Mathematics 2024-01-23 Piermarco Cannarsa , Stephane Gaubert , Cristian Mendico , Marc Quincampoix

In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is…

Optimization and Control · Mathematics 2018-07-16 Jinniao Qiu

In this paper, we explore a new class of stochastic control problems characterized by specific control constraints. Specifically, the admissible controls are subject to the ratcheting constraint, meaning they must be non-decreasing over…

Optimization and Control · Mathematics 2024-12-17 Mingxin Guo , Zuo Quan Xu

The paper studies a system of first order Hamilton-Jacobi equations with discontinuous coefficients, arising from a model of deterministic optimal debt management in infinite time horizon, with exponential discount and currency devaluation.…

Optimization and Control · Mathematics 2021-02-09 Antonio Marigonda , Khai T. Nguyen

In this note, we demonstrate that a locally semiconvex viscosity supersolution to a possibly degenerate fully nonlinear elliptic Hamilton-Jacobi-Bellman (HJB) equation is differentiable along the directions spanned by the range of the…

Optimization and Control · Mathematics 2025-01-28 Salvatore Federico , Giorgio Ferrari , Mauro Rosestolato

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution…

Machine Learning · Computer Science 2022-06-20 Harley Wiltzer , David Meger , Marc G. Bellemare

We study the approximation of parabolic Hamilton-Jacobi-Bellman (HJB) equations in bounded domains with strong Dirichlet boundary conditions. We work under the assumption of the existence of a sufficiently regular barrier function for the…

Numerical Analysis · Mathematics 2019-07-16 Athena Picarelli , Christoph Reisinger , Julen Rotaetxe Arto

We investigate the long time behavior of weakly dissipative semilinear Hamilton-Jacobi-Bellman (HJB) equations and the turnpike property for the corresponding stochastic control problems. To this aim, we develop a probabilistic approach…

Probability · Mathematics 2023-03-17 Giovanni Conforti

We propose a new probabilistic numerical scheme for fully nonlinear equation of Hamilton-Jacobi-Bellman (HJB) type associated to stochastic control problem, which is based on the Feynman-Kac representation in [12] by means of control…

Probability · Mathematics 2019-06-28 Idris Kharroubi , Nicolas Langrené , Huyên Pham

Stochastic optimal control problems governed by delay equations with delay in the control are usually more difficult to study than the the ones when the delay appears only in the state. This is particularly true when we look at the…

Probability · Mathematics 2021-03-22 F. Gozzi , F. Masiero

In this work we investigate regularity properties of a large class of Hamilton-Jacobi-Bellman (HJB) equations with or without obstacles, which can be stochastically interpreted in form of a stochastic control system which nonlinear cost…

Probability · Mathematics 2012-02-08 Rainer Buckdahn , Jianhui Huang , Juan Li

The ergodic control problem for a non-degenerate controlled diffusion controlled through its drift is considered under a uniform stability condition that ensures the well-posedness of the associated Hamilton-Jacobi-Bellman (HJB) equation. A…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Vivek S. Borkar

Optimal control and the associated second-order Hamilton-Jacobi-Bellman (HJB) equation are studied for unbounded stochastic evolution systems in Hilbert spaces. A new notion of viscosity solution, featured by absence of B-continuity, is…

Optimization and Control · Mathematics 2026-02-10 Shanjian Tang , Jianjun Zhou