English
Related papers

Related papers: On Minimum-Dispersion Control of Nonlinear Diffusi…

200 papers

The solution to a stochastic optimal control problem can be determined by computing the value function from a discretization of the associated Hamilton-Jacobi-Bellman equation. Alternatively, the problem can be reformulated in terms of a…

Optimization and Control · Mathematics 2024-02-29 Sebastian Reich

Over the recent past data-driven algorithms for solving stochastic optimal control problems in face of model uncertainty have become an increasingly active area of research. However, for singular controls and underlying diffusion dynamics…

Optimization and Control · Mathematics 2024-10-15 Sören Christensen , Asbjørn Holk Thomsen , Lukas Trottner

In neuroscience, the distribution of a decision time is modelled by means of a one-dimensional Fokker--Planck equation with time-dependent boundaries and space-time-dependent drift. Efficient approximation of the solution to this equation…

Numerical Analysis · Mathematics 2023-02-08 Udo Boehm , Sonja Cox , Gregor Gantner , Rob Stevenson

The Fokker-Planck equation is a partial differential equation that describes the evolution of a probability distribution over time. It is used to model a wide range of physical and biological phenomena, such as diffusion, chemical…

Computational Physics · Physics 2023-11-29 Wisit Mangthas , Waipot Ngamsaad

The Fokker-Planck equation with diffusion coefficient quadratic in space variable, linear drift coefficient, and nonlocal nonlinearity term is considered in the framework of a model of analysis of asset returns at financial markets. For…

Computational Finance · Quantitative Finance 2008-12-10 Alexander Shapovalov , Andrey Trifonov , Elena Masalova

In this study, we develop a stochastic optimal control approach with reinforcement learning structure to learn the unknown parameters appeared in the drift and diffusion terms of the stochastic differential equation. By choosing an…

Optimization and Control · Mathematics 2023-08-22 Shuzhen Yang

We develop a recursive method for perturbative solutions of the Fokker-Planck equation with nonlinear drift. The series expansion of the time-dependent probability density in terms of powers of the coupling constant is obtained by solving a…

Statistical Mechanics · Physics 2009-12-06 Jens Dreger , Axel Pelster , Bodo Hamprecht

This work is aimed at the derivation of reliable and efficient a posteriori error estimates for convection-dominated diffusion problems motivated by a linear Fokker-Planck problem appearing in computational neuroscience. We obtain…

Numerical Analysis · Computer Science 2018-05-16 Svetlana Matculevich , Monika Wolfmayr

We derive the dual variational principle (principle of minimal complementary energy) for the nonlocal nonlinear scalar diffusion problem, which may be viewed as the nonlocal version of the $p$-Laplacian operator. We establish existence and…

Analysis of PDEs · Mathematics 2024-01-10 Marcus Schytt , Anton Evgrafov

We study the numerical solution of nonlinear partially observed optimal stopping problems. The system state is taken to be a multi-dimensional diffusion and drives the drift of the observation process, which is another multi-dimensional…

Optimization and Control · Mathematics 2010-01-20 Mike Ludkovski

This article gives an overview of the developments in controlled diffusion processes, emphasizing key results regarding existence of optimal controls and their characterization via dynamic programming for a variety of cost criteria and…

Probability · Mathematics 2007-05-23 Vivek S. Borkar

Reflected diffusions in polyhedral domains are commonly used as approximate models for stochastic processing networks in heavy traffic. Stationary distributions of such models give useful information on the steady state performance of the…

Probability · Mathematics 2012-05-24 Amarjit Budhiraja , Jiang Chen , Sylvain Rubenthaler

The smoothing distribution is the conditional distribution of the diffusion process in the space of trajectories given noisy observations made continuously in time. It is generally difficult to sample from this distribution. We use the…

Probability · Mathematics 2025-03-07 Oskar Eklund , Annika Lang , Moritz Schauer

We consider stochastic impulse control problems where the process is driven by a general one-dimensional diffusion. We shall show a new mathematical characterization of the value function as a linear function in a certain transformed space.…

Optimization and Control · Mathematics 2007-05-23 Masahiko Egami

We present a novel simulation-free framework for training continuous-time diffusion processes over very general objective functions. Existing methods typically involve either prescribing the optimal diffusion process -- which only works for…

Machine Learning · Computer Science 2025-06-24 Mengjian Hua , Eric Vanden-Eijnden , Ricky T. Q. Chen

We explore the diffusion process in the non-Markovian spatio-temporal noise.%the escape rate problem in the non-Markovian spatio-temporal random noise. There is a non-trivial short memory regime, i.e., the Markovian limit characterized by a…

Statistical Mechanics · Physics 2009-11-13 Takaaki Monnai , Ayumu Sugita , Katsuhiro Nakamura

We consider the existence and first order conditions of optimality for a stochastic optimal control problem inspired by the celebrated FitzHugh-Nagumo model, with nonlinear diffusion term, perturbed by a linear multiplicative Brownian-type…

Optimization and Control · Mathematics 2019-12-03 Francesco Cordoni , Luca Di Persio

We propose a novel non-parametric learning paradigm for the identification of drift and diffusion coefficients of multi-dimensional non-linear stochastic differential equations, which relies upon discrete-time observations of the state. The…

Machine Learning · Computer Science 2025-03-11 Riccardo Bonalli , Alessandro Rudi

This paper focuses on finding approximate solutions to stochastic optimal control problems with control domains being not necessarily convex, where the state trajectory is subject to controlled stochastic differential equations. The…

Optimization and Control · Mathematics 2025-07-15 Shaolin Ji , Rundong Xu

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel