English
Related papers

Related papers: A Kernel Learning Method for Backward SDE Filter

200 papers

Kernel learning forward backward SDE filter is an iterative and adaptive meshfree approach to solve the nonlinear filtering problem. It builds from forward backward SDE for Fokker-Planker equation, which defines evolving density for the…

Machine Learning · Computer Science 2024-07-02 Yunzheng Lyu , Feng Bao

In this paper, we introduce an adaptive kernel method for solving the optimal filtering problem. The computational framework that we adopt is the Bayesian filter, in which we recursively generate an optimal estimate for the state of a…

Numerical Analysis · Mathematics 2022-03-11 Zezhong Zhang , Richard Archibald , Feng Bao

This work proposes a Stochastic Variational Deep Kernel Learning method for the data-driven discovery of low-dimensional dynamical models from high-dimensional noisy data. The framework is composed of an encoder that compresses…

Machine Learning · Computer Science 2023-06-28 Nicolò Botteghi , Mengwu Guo , Christoph Brune

This article presents a three-step framework for learning and solving partial differential equations (PDEs) using kernel methods. Given a training set consisting of pairs of noisy PDE solutions and source/boundary terms on a mesh, kernel…

Machine Learning · Statistics 2023-04-03 Da Long , Nicole Mrvaljevic , Shandian Zhe , Bamdad Hosseini

In this paper, we carry out numerical analysis to prove convergence of a novel sample-wise back-propagation method for training a class of stochastic neural networks (SNNs). The structure of the SNN is formulated as discretization of a…

Numerical Analysis · Mathematics 2022-12-20 Richard Archibald , Feng Bao , Yanzhao Cao , Hui Sun

In this paper we propose a new methodology for decision-making under uncertainty using recent advancements in the areas of nonlinear stochastic optimal control theory, applied mathematics, and machine learning. Grounded on the fundamental…

Robotics · Computer Science 2021-07-12 Marcus Pereira , Ziyi Wang , Ioannis Exarchos , Evangelos A. Theodorou

We develop a probabilistic machine learning method, which formulates a class of stochastic neural networks by a stochastic optimal control problem. An efficient stochastic gradient descent algorithm is introduced under the stochastic…

Machine Learning · Computer Science 2021-04-06 Richard Archibald , Feng Bao , Yanzhao Cao , He Zhang

In this article, we introduce a novel backward method to model stochastic gene expression and protein level dynamics. The protein amount is regarded as a diffusion process and is described by a backward stochastic differential equation…

Biological Physics · Physics 2017-04-05 Evelina Shamarova , Roman Chertovskih , Alexandre F. Ramos , Paulo Aguiar

Deep kernel learning combines the non-parametric flexibility of kernel methods with the inductive biases of deep learning architectures. We propose a novel deep kernel learning model and stochastic variational inference procedure which…

Machine Learning · Statistics 2016-11-03 Andrew Gordon Wilson , Zhiting Hu , Ruslan Salakhutdinov , Eric P. Xing

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at…

Machine Learning · Computer Science 2024-06-28 Peter Halmos , Jonathan Pillow , David A. Knowles

The reconstruction and inference of stochastic dynamical systems from data is a fundamental task in inverse problems and statistical learning. While surrogate modeling advances computational methods to approximate these dynamics, standard…

Optimization and Control · Mathematics 2026-04-14 Nicole Tianjiao Yang

Bayesian filtering deals with computing the posterior distribution of the state of a stochastic dynamic system given noisy observations. In this paper, motivated by applications in counter-adversarial systems, we consider the following…

Systems and Control · Electrical Eng. & Systems 2020-10-28 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

A novel approximate Bayesian filter based on backward stochastic differential equations is introduced. It uses a nonlinear Feynman--Kac representation of the filtering problem and the approximation of an unnormalized filtering density using…

Numerical Analysis · Mathematics 2026-04-21 Kasper Bågmark , Adam Andersson , Stig Larsson

Latent neural stochastic differential equations (SDEs) have recently emerged as a promising approach for learning generative models from stochastic time series data. However, they systematically underestimate the noise level inherent in…

Machine Learning · Computer Science 2025-06-11 Linus Heck , Maximilian Gelbrecht , Michael T. Schaub , Niklas Boers

Neural networks have been widely used as predictive models to fit data distribution, and they could be implemented through learning a collection of samples. In many applications, however, the given dataset may contain noisy samples or…

Neural and Evolutionary Computing · Computer Science 2017-05-30 Dianhui Wang , Ming Li

In this paper we develop a kernel density estimation (KDE) approach to modeling and forecasting recurrent trajectories on a compact manifold. For the purposes of this paper, a trajectory is a sequence of coordinates in a phase space defined…

Machine Learning · Computer Science 2019-11-06 Trevor K. Karn , Steven Petrone , Christopher Griffin

This work studies distributed (probability) density estimation of large-scale systems. Such problems are motivated by many density-based distributed control tasks in which the real-time density of the swarm is used as feedback information,…

Systems and Control · Electrical Eng. & Systems 2021-06-03 Tongjia Zheng , Hai Lin

Regressing the vector field of a dynamical system from a finite number of observed states is a natural way to learn surrogate models for such systems. A simple and interpretable way to learn a dynamical system from data is to interpolate…

Machine Learning · Statistics 2023-02-28 Lu Yang , Xiuwen Sun , Boumediene Hamzi , Houman Owhadi , Naiming Xie

We investigate neural ordinary and stochastic differential equations (neural ODEs and SDEs) to model stochastic dynamics in fully and partially observed environments within a model-based reinforcement learning (RL) framework. Through a…

Machine Learning · Computer Science 2026-03-25 Chao Han , Stefanos Ioannou , Luca Manneschi , T. J. Hayward , Michael Mangan , Aditya Gilra , Eleni Vasilaki

In this paper, we consider the problem of learning prediction models for spatiotemporal physical processes driven by unknown partial differential equations (PDEs). We propose a deep learning framework that learns the underlying dynamics and…

Machine Learning · Statistics 2021-05-04 Priyabrata Saha , Saibal Mukhopadhyay
‹ Prev 1 2 3 10 Next ›