English
Related papers

Related papers: Learning Locomotion Controllers for Walking Using …

200 papers

We propose a deep learning approach to compute mean field control problems with individual noises. The problem consists of the Fokker-Planck (FP) equation and the Hamilton-Jacobi-Bellman (HJB) equation. Using the differential of the…

Optimization and Control · Mathematics 2025-05-20 Mo Zhou , Stanley Osher , Wuchen Li

Generating robust locomotion for a humanoid robot in the presence of disturbances is difficult because of its high number of degrees of freedom and its unstable nature. In this paper, we used the concept of Divergent Component of…

Robotics · Computer Science 2021-12-23 Mohammadreza Kasaei , Nuno Lau , Artur Pereira

This paper addresses the numerical solution of backward stochastic differential equations (BSDEs) arising in stochastic optimal control. Specifically, we investigate two BSDEs: one derived from the Hamilton-Jacobi-Bellman equation and the…

Optimization and Control · Mathematics 2025-03-12 Yuhang Mei , Amirhossein Taghvaei

Two novel numerical estimators are proposed for solving forward-backward stochastic differential equations (FBSDEs) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. In contrast to the…

Optimization and Control · Mathematics 2021-10-01 Kelsey P. Hawkins , Ali Pakniyat , Panagiotis Tsiotras

We aim to provide a Feynman-Kac type representation for Hamilton-Jacobi-Bellman equation, in terms of forward backward stochastic differential equation (FBSDE) with a simulatable forward process. For this purpose, we introduce a class of…

Probability · Mathematics 2015-09-10 Idris Kharroubi , Huyên Pham

We propose a new deep learning algorithm for solving high-dimensional parabolic integro-differential equations (PIDEs) and forward-backward stochastic differential equations with jumps (FBSDEJs). This novel algorithm can be viewed as an…

Numerical Analysis · Mathematics 2025-10-28 Wansheng Wang , Jiangtao Pan , Jie Wang , Zaijun Ye

In this work, we present a novel forward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs). Motivated by the fact that differential deep learning can…

Numerical Analysis · Mathematics 2024-08-13 Lorenc Kapllani , Long Teng

We propose a probabilistic numerical algorithm to solve Backward Stochastic Differential Equations (BSDEs) with nonnegative jumps, a class of BSDEs introduced in [9] for representing fully nonlinear HJB equations. In particular, this allows…

Probability · Mathematics 2019-07-11 Idris Kharroubi , Nicolas Langrené , Huyên Pham

In this paper, we study a stochastic recursive optimal control problem in which the system is governed by a functional forward-backward stochastic differential equation. Under standard assumptions, we establish the dynamic programming…

Probability · Mathematics 2013-01-03 Shaolin Ji , Shuzhen Yang

We propose a new probabilistic numerical scheme for fully nonlinear equation of Hamilton-Jacobi-Bellman (HJB) type associated to stochastic control problem, which is based on the Feynman-Kac representation in [12] by means of control…

Probability · Mathematics 2019-06-28 Idris Kharroubi , Nicolas Langrené , Huyên Pham

In this paper, we study an optimal control problem of linear backward stochastic differential equation (BSDE) with quadratic cost functional under partial information. This problem is solved completely and explicitly by using a stochastic…

Optimization and Control · Mathematics 2020-12-16 Guangchen Wang , Wencan Wang , Zhiguo Yan

This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation.…

Computational Finance · Quantitative Finance 2024-10-15 Ashley Davey , Harry Zheng

It is well-known that decision-making problems from stochastic control can be formulated by means of a forward-backward stochastic differential equation (FBSDE). Recently, the authors of Ji et al. 2022 proposed an efficient deep learning…

Optimization and Control · Mathematics 2024-08-01 Zhipeng Huang , Balint Negyesi , Cornelis W. Oosterlee

In this paper, we propose a deep learning based numerical scheme for strongly coupled FBSDEs, stemming from stochastic control. It is a modification of the deep BSDE method in which the initial value to the backward equation is not a free…

Optimization and Control · Mathematics 2023-02-10 Kristoffer Andersson , Adam Andersson , Cornelis W. Oosterlee

This paper is devoted to a stochastic differential game of functional forward-backward stochastic differential equation (FBSDE, for short). The associated upper and lower value functions of the stochastic differential game are defined by…

Optimization and Control · Mathematics 2013-01-03 Shaolin Ji , Qingmeng Wei

This paper addresses the optimal control problem of finite-horizon discrete-time nonlinear systems under state and control constraints. A novel numerical algorithm based on optimal control theory is proposed to achieve superior…

Optimization and Control · Mathematics 2025-03-21 Chuanzhi Lv , Hongdan Li , Huanshui Zhang

In this paper, we study a kind of optimal control problem for forward-backward stochastic differential equations (FBSDEs for short) of McKean--Vlasov type via the dynamic programming principle (DPP for short) motivated by studying the…

Optimization and Control · Mathematics 2024-07-09 Liangquan Zhang

This work proposed an efficient learning-based framework to learn feedback control policies from human teleoperated demonstrations, which achieved obstacle negotiation, staircase traversal, slipping control and parcel delivery for a tracked…

Robotics · Computer Science 2021-08-11 Jiacheng Gu , Zhibin Li

Learning policies for bipedal locomotion can be difficult, as experiments are expensive and simulation does not usually transfer well to hardware. To counter this, we need al- gorithms that are sample efficient and inherently safe. Bayesian…

Robotics · Computer Science 2018-10-11 Rika Antonova , Akshara Rai , Christopher G. Atkeson

In this paper we investigate a kind of optimal control problem of coupled forward-backward stochastic system with jumps whose cost functional is defined through a coupled forward-backward stochastic differential equation with Brownian…

Probability · Mathematics 2020-09-15 Qian Lin