English
Related papers

Related papers: Estimating reducible stochastic differential equat…

200 papers

We develop a new continuous-time stochastic gradient descent method for optimizing over the stationary distribution of stochastic differential equation (SDE) models. The algorithm continuously updates the SDE model's parameters using an…

Machine Learning · Computer Science 2023-08-29 Ziheng Wang , Justin Sirignano

Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation-specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by…

Numerical Analysis · Mathematics 2022-03-09 Ke Chen , Shi Chen , Qin Li , Jianfeng Lu , Stephen J. Wright

Stochastic differential equations (SDEs), which models uncertain phenomena as the time evolution of random variables, are exploited in various fields of natural and social sciences such as finance. Since SDEs rarely admit analytical…

Quantum Physics · Physics 2021-05-26 Kenji Kubo , Yuya O. Nakagawa , Suguru Endo , Shota Nagayama

A framework previously introduced in [3] for solving a sequence of stochastic optimization problems with bounded changes in the minimizers is extended and applied to machine learning problems such as regression and classification. The…

Machine Learning · Computer Science 2019-04-08 Craig Wilson , Yuheng Bu , Venugopal Veeravalli

We consider the problem of inferring latent stochastic differential equations (SDEs) with a time and memory cost that scales independently with the amount of data, the total length of the time series, and the stiffness of the approximate…

Machine Learning · Computer Science 2023-12-19 Kevin Course , Prasanth B. Nair

Stochastic differential equations provide a powerful tool for modelling dynamic phenomena affected by random noise. In case of repeated observations of time series for several experimental units, it is often the case that some of the…

Methodology · Statistics 2024-09-06 Fernando Baltazar-Larios , Mogens Bladt , Michael Sørensen

The distribution-dependent stochastic differential equations (DDSDEs) describe stochastic systems whose evolution is determined by both the microcosmic site and the macrocosmic distribution of the particle. The density function associated…

Probability · Mathematics 2017-04-18 Feng-Yu Wang

Approximating Stochastic Gradient Descent (SGD) as a Stochastic Differential Equation (SDE) has allowed researchers to enjoy the benefits of studying a continuous optimization trajectory while carefully preserving the stochasticity of SGD.…

Machine Learning · Computer Science 2024-11-04 Sadhika Malladi , Kaifeng Lyu , Abhishek Panigrahi , Sanjeev Arora

Probabilistic ordinary differential equation (ODE) solvers have been introduced over the past decade as uncertainty-aware numerical integrators. They typically proceed by assuming a functional prior to the ODE solution, which is then…

Numerical Analysis · Mathematics 2025-03-25 Yvann Le Fay , Simo Särkkä , Adrien Corenflos

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

Machine Learning · Computer Science 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

Applications in quantitative finance such as optimal trade execution, risk management of options, and optimal asset allocation involve the solution of high dimensional and nonlinear Partial Differential Equations (PDEs). The connection…

Machine Learning · Statistics 2019-10-28 Batuhan Güler , Alexis Laignelet , Panos Parpas

We introduce a novel numerical approach for a class of stochastic dynamic programs which arise as discretizations of backward stochastic differential equations or semi-linear partial differential equations. Solving such dynamic programs…

Numerical Analysis · Mathematics 2016-06-24 Christian Bender , Christian Gaertner , Nikolaus Schweizer

To study the nonlinear properties of complex natural phenomena, the evolution of the quantity of interest can be often represented by systems of coupled nonlinear stochastic differential equations (SDEs). These SDEs typically contain…

Optimization and Control · Mathematics 2024-10-22 Jan Bartsch , Robert Denk , Stefan Volkwein

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Methodology · Statistics 2018-04-10 German A. Schnaidt Grez , Brani Vidakovic

Ordinary Differential Equations are widespread tools to model chemical, physical, biological process but they usually rely on parameters which are of critical importance in terms of dynamic and need to be estimated directly from the data.…

Methodology · Statistics 2014-10-29 Nicolas Brunel , Quentin Clairon

The R software package rSPDE contains methods for approximating Gaussian random fields based on fractional-order stochastic partial differential equations (SPDEs). A common example of such fields are Whittle-Mat\'ern fields on bounded…

Computation · Statistics 2025-02-28 David Bolin , Alexandre B. Simas

Models incorporating uncertain inputs, such as random forces or material parameters, have been of increasing interest in PDE-constrained optimization. In this paper, we focus on the efficient numerical minimization of a convex and smooth…

Optimization and Control · Mathematics 2021-06-18 Caroline Geiersbach , Winnifried Wollner

A systematic Bayesian framework is developed for physics constrained parameter inference ofstochastic differential equations (SDE) from partial observations. The physical constraints arederived for stochastic climate models but are…

Data Analysis, Statistics and Probability · Physics 2016-11-25 Daniel Peavoy , Christian L. E. Franzke , Gareth O. Roberts

Partial differential equation (PDE) models are widely used in engineering and natural sciences to describe spatio-temporal processes. The parameters of the considered processes are often unknown and have to be estimated from experimental…

Numerical Analysis · Mathematics 2016-12-21 Romana Boiger , Jan Hasenauer , Sabrina Hross , Barbara Kaltenbacher