English
Related papers

Related papers: A stochastic recursive optimal control problem und…

200 papers

In this paper, we adapt stochastic Perron's method to analyze a stochastic target problem with unbounded controls in a jump diffusion set-up. With this method, we construct a viscosity sub-solution and super-solution to the associated…

Optimization and Control · Mathematics 2016-05-18 Erhan Bayraktar , Jiaqi Li

This paper introduces a notion of viscosity solutions for second order elliptic Hamilton-Jacobi-Bellman (HJB) equations with infinite delay associated with infinite-horizon optimal control problems for stochastic differential equations with…

Optimization and Control · Mathematics 2021-12-28 Jianjun Zhou

In this paper we study a class of stochastic control problems in which the control of the jump size is essential. Such a model is a generalized version for various applied problems ranging from optimal reinsurance selections for general…

Probability · Mathematics 2008-04-04 Rainer Buckdahn , Jin Ma , Catherine Rainer

In this paper, we study a stochastic optimal control problem under a type of consistent convex expectation dominated by G-expectation. By the separation theorem for convex sets, we get the representation theorems for this convex expectation…

Optimization and Control · Mathematics 2024-08-21 Xiaojuan Li , Mingshang Hu

We study a family of optimal control problems under a set of controlled-loss constraints holding at different deterministic dates. The characterization of the associated value function by a Hamilton-Jacobi-Bellman equation usually calls for…

Optimization and Control · Mathematics 2020-07-27 Geraldine Bouveret , Athena Picarelli

In this paper, we consider a stochastic recursive optimal control problem under model uncertainty. In this framework, the cost function is described by solutions of a family of backward stochastic differential equations. With the help of…

Probability · Mathematics 2020-04-16 Mingshang Hu , Falei Wang

For continuous systems modeled by dynamical equations such as ODEs and SDEs, Bellman's Principle of Optimality takes the form of the Hamilton-Jacobi-Bellman (HJB) equation, which provides the theoretical target of reinforcement learning…

Machine Learning · Computer Science 2025-10-28 Haruki Settai , Naoya Takeishi , Takehisa Yairi

We consider a general class of dynamic resource allocation problems within a stochastic optimal control framework. This class of problems arises in a wide variety of applications, each of which intrinsically involves resources of different…

Optimization and Control · Mathematics 2018-01-08 Xuefeng Gao , Yingdong Lu , Mayank Sharma , Mark S. Squillante , Joost W. Bosman

In this paper, we study an optimal stopping problem in the presence of model uncertainty and regime switching. The max-min formulation for robust control and the dynamic programming approach are adopted to establish a general theoretical…

Optimization and Control · Mathematics 2025-09-04 Siyu Lv , Zhen Wu , Jie Xiong , Xin Zhang

In this paper, we study the relationship between general maximum principle and dynamic programming principle for risk-sensitive stochastic optimal control problems, where the control domain is not necessarily convex. The original problem is…

Optimization and Control · Mathematics 2026-02-06 Huanqing Dong , Jingtao Shi

In this note, we demonstrate that a locally semiconvex viscosity supersolution to a possibly degenerate fully nonlinear elliptic Hamilton-Jacobi-Bellman (HJB) equation is differentiable along the directions spanned by the range of the…

Optimization and Control · Mathematics 2025-01-28 Salvatore Federico , Giorgio Ferrari , Mauro Rosestolato

We study optimal stochastic control problems of general coupled systems of forward-backward stochastic differential equations with jumps. By means of the It\^o-Ventzell formula the system is transformed to a controlled backward stochastic…

Optimization and Control · Mathematics 2017-01-12 Bernt Øksendal , Agnès Sulem , Tusheng Zhang

This paper considers consumption and portfolio optimization problems with recursive preferences in both infinite and finite time regions. Specially, the financial market consists of a risk-free asset and a risky asset that follows a general…

Optimization and Control · Mathematics 2024-12-30 Jian-hao Kang , Zhun Gou , Nan-jing Huang

This paper first describes a class of uncertain stochastic control systems with Markovian switching, and derives an It\^o-Liu formula for Markov-modulated processes. And we characterize an optimal control law, which satisfies the…

Optimization and Control · Mathematics 2014-01-14 Weiyin Fei

We consider a problem of stochastic optimal control with separable drift uncertainty in strong formulation on a finite horizon. The drift coefficient of the state $Y^{u}$ is multiplicatively influenced by an unknown random variable…

Optimization and Control · Mathematics 2023-11-13 Samuel N. Cohen , Christoph Knochenhauer , Alexander Merkel

We study the Hamilton-Jacobi equation for undiscounted exit time control problems with general nonnegative Lagrangians using the dynamic programming approach. We prove theorems characterizing the value function as the unique…

Optimization and Control · Mathematics 2007-05-23 Michael Malisoff

This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…

Robotics · Computer Science 2014-09-23 Matanya B. Horowitz , Joel W. Burdick

We study optimal stochastic control problem for non-Markovian stochastic differential equations (SDEs) where the drift, diffusion coefficients, and gain functionals are path-dependent, and importantly we do not make any ellipticity…

Probability · Mathematics 2013-11-04 Marco Fuhrman , Huyên Pham

In this paper we propose a dynamic model of Limit Order Book (LOB). The main feature of our model is that the shape of the LOB is determined endogenously by an expected utility function via a competitive equilibrium argument. Assuming zero…

Optimization and Control · Mathematics 2014-01-23 Jin Ma , Xinyang Wang , Jianfeng Zhang

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia