English
Related papers

Related papers: A Kernel Learning Method for Backward SDE Filter

200 papers

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

We use statistical learning methods to construct an adaptive state estimator for nonlinear stochastic systems. Optimal state estimation, in the form of a Kalman filter, requires knowledge of the system's process and measurement uncertainty.…

Machine Learning · Statistics 2014-11-05 Michael Busch , Jeff Moehlis

We propose a novel method for density estimation that leverages an estimated score function to debias kernel density estimation (SD-KDE). In our approach, each data point is adjusted by taking a single step along the score function with a…

Machine Learning · Computer Science 2025-06-24 Elliot L. Epstein , Rajat Dwaraknath , Thanawat Sornwanee , John Winnicki , Jerry Weihong Liu

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

We present a numerical method to learn an accurate predictive model for an unknown stochastic dynamical system from its trajectory data. The method seeks to approximate the unknown flow map of the underlying system. It employs the idea of…

Machine Learning · Computer Science 2024-12-24 Zhongshu Xu , Yuan Chen , Qifan Chen , Dongbin Xiu

In this work, we study the numerical approximation of a class of singular fully coupled forward backward stochastic differential equations. These equations have a degenerate forward component and non-smooth terminal condition. They are…

Numerical Analysis · Mathematics 2022-08-17 Jean-François Chassagneux , Mohan Yang

Stochastic configuration networks (SCNs), as a class of randomized learner models, are featured by its way of random parameters assignment in the light of a supervisory mechanism, resulting in the universal approximation property at…

Machine Learning · Computer Science 2024-12-17 Yongxuan Chen , Dianhui Wang

In this paper we develop a dynamic form of Bayesian optimization for machine learning models with the goal of rapidly finding good hyperparameter settings. Our method uses the partial information gained during the training of a machine…

Machine Learning · Statistics 2014-06-17 Kevin Swersky , Jasper Snoek , Ryan Prescott Adams

Latent stochastic differential equation (SDE) models are important tools for the unsupervised discovery of dynamical systems from data, with applications ranging from engineering to neuroscience. In these complex domains, exact posterior…

Machine Learning · Computer Science 2025-11-25 Amber Hu , Henry Smith , Scott Linderman

We propose a novel numerical approach for nonlocal diffusion equations [8] with integrable kernels, based on the relationship between the backward Kolmogorov equation and backward stochastic differential equations (BSDEs) driven by L\`{e}vy…

Numerical Analysis · Mathematics 2015-07-28 Guannan Zhang , Weidong Zhao , Clayton Webster , Max Gunzburger

Although stochastic approximation learning methods have been widely used in the machine learning literature for over 50 years, formal theoretical analyses of specific machine learning algorithms are less common because stochastic…

Machine Learning · Statistics 2017-04-21 Richard M. Golden

This work proposes stochastic partial differential equations (SPDEs) as a practical tool to replicate clustering effects of more detailed particle-based dynamics. Inspired by membrane-mediated receptor dynamics on cell surfaces, we…

Quantitative Methods · Quantitative Biology 2025-01-22 Nathalie Wehlitz , Mohsen Sadeghi , Alberto Montefusco , Christof Schütte , Grigorios A. Pavliotis , Stefanie Winkelmann

In this work, we propose a new deep learning-based scheme for solving high dimensional nonlinear backward stochastic differential equations (BSDEs). The idea is to reformulate the problem as a global optimization, where the local loss…

Numerical Analysis · Mathematics 2024-04-18 Lorenc Kapllani , Long Teng

In the co-sparse analysis model a set of filters is applied to a signal out of the signal class of interest yielding sparse filter responses. As such, it may serve as a prior in inverse problems, or for structural analysis of signals that…

Machine Learning · Computer Science 2015-10-07 Matthias Seibert , Julian Wörmann , Rémi Gribonval , Martin Kleinsteuber

We identify effective stochastic differential equations (SDE) for coarse observables of fine-grained particle- or agent-based simulations; these SDE then provide useful coarse surrogate models of the fine scale dynamics. We approximate the…

We consider a unifying framework for stochastic control problem including the following features: partial observation, path-dependence (both with respect to the state and the control), and without any non-degeneracy condition on the…

Probability · Mathematics 2016-09-14 Elena Bandini , Andrea Cosso , Marco Fuhrman , Huyên Pham

We introduce Neural Dynamical Systems (NDS), a method of learning dynamical models in various gray-box settings which incorporates prior knowledge in the form of systems of ordinary differential equations. NDS uses neural networks to…

This tutorial provides a gentle introduction to kernel density estimation (KDE) and recent advances regarding confidence bands and geometric/topological features. We begin with a discussion of basic properties of KDE: the convergence rate…

Methodology · Statistics 2017-09-13 Yen-Chi Chen

A crucial task in predictive maintenance is estimating the remaining useful life of physical systems. In the last decade, deep learning has improved considerably upon traditional model-based and statistical approaches in terms of predictive…

Machine Learning · Computer Science 2024-02-05 Luca Della Libera , Jacopo Andreoli , Davide Dalle Pezze , Mirco Ravanelli , Gian Antonio Susto

Accurate kinodynamic models play a crucial role in many robotics applications such as off-road navigation and high-speed driving. Many state-of-the-art approaches in learning stochastic kinodynamic models, however, require precise…

Robotics · Computer Science 2022-09-26 Jiayi Wei , Jarrett Holtz , Isil Dillig , Joydeep Biswas