English
Related papers

Related papers: Deep Learning for Constrained Utility Maximisation

200 papers

In this paper, we propose a deep forward-backward stochastic differential equation (FBSDE) based control algorithm for locomotion tasks. We also include state constraints in the FBSDE formulation to impose stable walking solutions or other…

Robotics · Computer Science 2021-07-19 Bolun Dai , Virinchi Roy Surabhi , Prashanth Krishnamurthy , Farshad Khorrami

Stochastic control problems in high dimensions are notoriously difficult to solve due to the curse of dimensionality. An alternative to traditional dynamic programming is Pontryagin's Maximum Principle (PMP), which recasts the problem as a…

Machine Learning · Computer Science 2025-07-03 Qian Qi

This paper develops algorithms for high-dimensional stochastic control problems based on deep learning and dynamic programming. Unlike classical approximate dynamic programming approaches, we first approximate the optimal policy by means of…

Probability · Mathematics 2021-09-21 Côme Huré , Huyên Pham , Achref Bachouch , Nicolas Langrené

This paper presents a new methodology to craft navigation functions for nonlinear systems with stochastic uncertainty. The method relies on the transformation of the Hamilton-Jacobi-Bellman (HJB) equation into a linear partial differential…

Robotics · Computer Science 2014-09-23 Matanya B. Horowitz , Joel W. Burdick

We study a robust utility maximization problem in the unbounded case with a general penalty term and information including jumps. We focus on time consistent penalties and we prove that there exists an optimal probability measure solution…

Optimization and Control · Mathematics 2022-12-07 Sarah Kaakai , Anis Matoussi , Achraf Tamtalini

In this paper we study backward stochastic differential equations (BSDEs) driven by the compensated random measure associated to a given pure jump Markov process X on a general state space K. We apply these results to prove well-posedness…

Probability · Mathematics 2013-02-05 Fulvia Confortola , Marco Fuhrman

We study singular perturbations of a class of two-scale stochastic control systems with unbounded data. The assumptions are designed to cover some relaxation problems for deep neural networks. We construct effective Hamiltonian and initial…

Optimization and Control · Mathematics 2023-03-29 Martino Bardi , Hicham Kouhkouh

This paper addresses a distributed optimization problem in a communication network where nodes are active sporadically. Each active node applies some learning method to control its action to maximize the global utility function, which is…

Optimization and Control · Mathematics 2021-04-20 Wenjie Li , Mohamad Assaad , Shiqi Zheng

This paper is concerned with a kind of linear-quadratic (LQ) optimal control problem of backward stochastic differential equation (BSDE) with partial information. The cost functional includes cross terms between the state and control, and…

Optimization and Control · Mathematics 2025-09-03 Jialong Li , Zhiyong Yu , Wanying Yue

We consider an optimal control problem for a linear stochastic integro-diffe\-rential equation with conic constraints on the phase variable and the control of singular-regular type. Our setting includes consumption-investment problems for…

Optimization and Control · Mathematics 2015-01-20 Dimitri De Vallière , Yuri Kabanov , Emmanuel Lépinette

In this paper, we propose a new approach for stochastic control problems arising from utility maximization. The main idea is to directly start from the dynamical programming equation and compute the conditional expectation using a novel…

Mathematical Finance · Quantitative Finance 2022-02-28 Jingtang Ma , Zhengyang Lu , Zhenyu Cui

This paper presents a partial differential equation framework for deep residual neural networks and for the associated learning problem. This is done by carrying out the continuum limits of neural networks with respect to width and depth.…

Analysis of PDEs · Mathematics 2020-08-25 Hailiang Liu , Peter Markowich

This paper studies the utility maximization problem of an agent with non-trivial endowment, and whose preferences are modeled by the maximal subsolution of a BSDE. We prove existence of an optimal trading strategy and relate our existence…

Optimization and Control · Mathematics 2015-04-16 Gregor Heyne , Michael Kupper , Ludovic Tangpi

This paper presents an inverse optimality method to solve the Hamilton-Jacobi-Bellman equation for a class of nonlinear problems for which the cost is quadratic and the dynamics are affine in the input. The method is inverse optimal because…

Optimization and Control · Mathematics 2011-10-11 Luis Rodrigues , Didier Henrion , Mehdi Abedinpour Fallah

Devising optimal interventions for diffusive systems often requires the solution of the Hamilton-Jacobi-Bellman (HJB) equation, a nonlinear backward partial differential equation (PDE), that is, in general, nontrivial to solve. Existing…

Statistical Mechanics · Physics 2022-10-18 Dimitra Maoutsa , Manfred Opper

We present an accelerated algorithm for the solution of static Hamilton-Jacobi-Bellman equations related to optimal control problems. Our scheme is based on a classic policy iteration procedure, which is known to have superlinear…

Optimization and Control · Mathematics 2016-02-22 Alessandro Alla , Maurizio Falcone , Dante Kalise

We study the stochastic control-stopping problem when the data are of polynomial growth. The approach is based on backward stochastic dierential equations (BSDEs for short). The problem turns into the study of a specic reected BSDE with a…

Optimization and Control · Mathematics 2020-05-15 Brahim Asri , Said Hamadène , Khalid Oufdil

We address two major challenges in scientific machine learning (SciML): interpretability and computational efficiency. We increase the interpretability of certain learning processes by establishing a new theoretical connection between…

Machine Learning · Computer Science 2024-05-08 Paula Chen , Tingwei Meng , Zongren Zou , Jérôme Darbon , George Em Karniadakis

To sidestep the curse of dimensionality when computing solutions to Hamilton-Jacobi-Bellman partial differential equations (HJB PDE), we propose an algorithm that leverages a neural network to approximate the value function. We show that…

Machine Learning · Computer Science 2017-03-28 Frank Jiang , Glen Chou , Mo Chen , Claire J. Tomlin

Optimal control problem is typically solved by first finding the value function through Hamilton-Jacobi equation (HJE) and then taking the minimizer of the Hamiltonian to obtain the control. In this work, instead of focusing on the value…

Optimization and Control · Mathematics 2021-09-10 Alain Bensoussan , Jiayue Han , Sheung Chi Phillip Yam , Xiang Zhou