English
Related papers

Related papers: Value Function Estimators for Feynman-Kac Forward-…

200 papers

We study the well-posedness of a system of forward-backward stochastic differential equations (FBSDEs) corresponding to a degenerate mean field type control problem, when the diffusion coefficient depends on the state together with its…

Probability · Mathematics 2023-11-16 Alain Bensoussan , Ziyu Huang , Shanjian Tang , Sheung Chi Phillip Yam

In this paper, stochastic optimal control problems in continuous time and space are considered. In recent years, such problems have received renewed attention from the lens of reinforcement learning (RL) which is also one of our motivation.…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Anant A. Joshi , Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

This paper presents a rigorous finite element framework for solving an optimal control problem governed by the steady Navier-Stokes-Brinkman equations, focusing on identifying a scalar permeability parameter $\gamma$ from local velocity…

Numerical Analysis · Mathematics 2025-03-12 Jorge Aguayo Araneda , Julie Merten

Interactive fixed effects are routinely controlled for in linear panel models. While an analogous fixed effects (FE) estimator for nonlinear models has been available in the literature (Chen, Fernandez-Val and Weidner, 2021), it sees much…

Econometrics · Economics 2026-03-25 Andrei Zeleneev , Weisheng Zhang

We study stochastic differential equations (SDEs) whose drift and diffusion coefficients are path-dependent and controlled. We construct a value process on the canonical path space, considered simultaneously under a family of singular…

Probability · Mathematics 2012-05-08 Marcel Nutz

We propose a new class of physics-informed neural networks, called physics-informed Variational Autoencoder (PI-VAE), to solve stochastic differential equations (SDEs) or inverse problems involving SDEs. In these problems the governing…

Machine Learning · Statistics 2022-11-09 Weiheng Zhong , Hadi Meidani

Treatment effect estimation in continuous time is crucial for personalized medicine. However, existing methods for this task are limited to point estimates of the potential outcomes, whereas uncertainty estimates have been ignored. Needless…

Machine Learning · Computer Science 2024-04-04 Konstantin Hess , Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Deep learning has been proposed as an efficient alternative for the numerical approximation of PDE solutions, offering fast, iterative simulation of PDEs through the approximation of solution operators. However, deep learning solutions have…

Machine Learning · Computer Science 2026-02-02 Sean Current , Chandan Kumar , Datta Gaitonde , Srinivasan Parthasarathy

Reinforcement learning algorithms can solve dynamic decision-making and optimal control problems. With continuous-valued state and input variables, reinforcement learning algorithms must rely on function approximators to represent the value…

Machine Learning · Computer Science 2021-11-16 Jiří Kubalík , Erik Derner , Jan Žegklitz , Robert Babuška

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

We consider a system of Forward Backward Stochastic Differential Equations (FBSDEs), with time delayed generator and driven by L\`evy-type noise. We establish a non linear Feynman Kac representation formula associating the solution given by…

Probability · Mathematics 2025-11-27 Luca Di Persio , Matteo Garbelli , Adrian Zălinescu

We study an inverse problem of the stochastic optimal control of general diffusions with performance index having the quadratic penalty term of the control process. Under mild conditions on the system dynamics, the cost functions, and the…

Optimization and Control · Mathematics 2022-11-17 Yumiharu Nakano

This paper is concerned with the decoupling of delayed linear forward-backward stochastic differential equations (D-FBSDEs), which is much more involved than the delay-free case due to the infinite dimension caused by the delay. A new…

Optimization and Control · Mathematics 2020-09-23 Tianfu Ma , Juanjuan Xu , Huanshui Zhang

We present a method for approximating solutions of Stochastic Differential Equations (SDEs) with arbitrary rates. This approximation is derived for bounded and measurable test functions. Specifically, we demonstrate that, leveraging the…

Probability · Mathematics 2024-03-27 Clément Rey

We study an optimal control problem on infinite time horizon with semimartingale strategies, random coefficients and regime switching. The value function and the optimal strategy can be characterized in terms of three systems of backward…

Optimization and Control · Mathematics 2026-02-27 Xinman Cheng , Guanxing Fu , Xiaonyu Xia

Overparameterized stochastic differential equation (SDE) models have achieved remarkable success in various complex environments, such as PDE-constrained optimization, stochastic control and reinforcement learning, financial engineering,…

Optimization and Control · Mathematics 2024-09-27 Shengbo Wang , Jose Blanchet , Peter Glynn

So-called functional error estimators provide a valuable tool for reliably estimating the discretization error for a sum of two convex functions. We apply this concept to Tikhonov regularization for the solution of inverse problems for…

Numerical Analysis · Mathematics 2017-02-13 Christian Clason , Barbara Kaltenbacher , Daniel Wachsmuth

We study a stochastic optimal control problem for forward-backward control systems with quadratic generators. In order to establish the first and second-order variational and adjoint equations, we obtain a new estimate for one-dimensional…

Optimization and Control · Mathematics 2021-07-06 Mingshang Hu , Shaolin Ji , Rundong Xu

Stochastic differential equations (SDEs) offer powerful and accessible mathematical models for capturing both deterministic and probabilistic aspects of dynamic behavior across a wide range of physical, financial, and social systems.…

Statistics Theory · Mathematics 2026-02-17 Paromita Banerjee , Anirban Mondal

In this paper, the stochastic verification theorems for stochastic control problems of reflected forward-backward stochastic differential equations are studied. We carry out the work within the frameworks of classical and viscosity…

Optimization and Control · Mathematics 2023-06-07 Lu Liu , Xinlei Hu , Qingmeng Wei