English
Related papers

Related papers: Deep Signature FBSDE Algorithm

200 papers

Binary Neural Networks (BNNs) have garnered significant attention due to their immense potential for deployment on edge devices. However, the non-differentiability of the quantization function poses a challenge for the optimization of BNNs,…

Machine Learning · Computer Science 2024-12-17 Xinquan Chen , Junqi Gao , Biqing Qi , Dong Li , Yiang Luo , Fangyuan Li , Pengfei Li

This is one of our series papers on multistep schemes for solving forward backward stochastic differential equations (FBSDEs) and related problems. Here we extend (with non-trivial updates) our multistep schemes in [W. Zhao, Y. Fu and T.…

Numerical Analysis · Mathematics 2015-02-12 Kong Tao , Weidong Zhao , Tao Zhou

Training neural networks with back-propagation (BP) requires a sequential passing of activations and gradients, which forces the network modules to work in a synchronous fashion. This has been recognized as the lockings (i.e., the forward,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Huiping Zhuang , Yi Wang , Qinglai Liu , Shuai Zhang , Zhiping Lin

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

This paper introduces a novel two-stream deep model based on graph convolutional network (GCN) architecture and feed-forward neural networks (FFNN) for learning the solution of nonlinear partial differential equations (PDEs). The model aims…

Machine Learning · Computer Science 2022-05-02 Onur Bilgin , Thomas Vergutz , Siamak Mehrkanoon

The theory of Forward-Backward Stochastic Differential Equations (FBSDEs) paves a way to probabilistic numerical methods for nonlinear parabolic PDEs. The majority of the results on the numerical methods for FBSDEs relies on the global…

Probability · Mathematics 2016-07-25 Arnaud Lionnet , Gonçalo dos Reis , Lukasz Szpruch

We present a multidimensional deep learning implementation of a stochastic branching algorithm for the numerical solution of fully nonlinear PDEs. This approach is designed to tackle functional nonlinearities involving gradient terms of any…

Numerical Analysis · Mathematics 2023-09-12 Jiang Yu Nguwi , Guillaume Penent , Nicolas Privault

In this paper, an analytic approximation method for highly nonlinear equations, namely the homotopy analysis method (HAM), is employed to solve some backward stochastic differential equations (BSDEs) and forward-backward stochastic…

Numerical Analysis · Mathematics 2018-01-25 Xiaoxu Zhong , Shijun Liao

As a representative continuous-depth neural network approach, stochastic differential equation (SDE)-based Bayesian neural networks (BNNs) have attracted considerable attention due to their solid theoretical foundations and strong potential…

Machine Learning · Statistics 2026-03-27 Chenxu Yu , Wenqi Fang

Transfer learning is often used to decrease the computational cost of model training, as fine-tuning a model allows a downstream task to leverage the features learned from the pre-training dataset and quickly adapt them to a new task. This…

Machine Learning · Computer Science 2025-07-01 Joshua C. Zhao , Saurabh Bagchi

In this paper, we introduce a new kind of reflected backward stochastic differential equations (RBSDEs) driven by a martingale, in a Markov chain model, but not driven by Brownian motion, and give existence and uniqueness results for the…

Probability · Mathematics 2015-05-14 Dimbinirina Ramarimbahoaka , Zhe Yang , Robert J. Elliott

This paper is concerned with the decoupling of delayed linear forward-backward stochastic differential equations (D-FBSDEs), which is much more involved than the delay-free case due to the infinite dimension caused by the delay. A new…

Optimization and Control · Mathematics 2020-09-23 Tianfu Ma , Juanjuan Xu , Huanshui Zhang

Bayesian flow networks (BFNs) iteratively refine the parameters, instead of the samples in diffusion models (DMs), of distributions at various noise levels through Bayesian inference. Owing to its differentiable nature, BFNs are promising…

Machine Learning · Computer Science 2024-06-04 Kaiwen Xue , Yuhao Zhou , Shen Nie , Xu Min , Xiaolu Zhang , Jun Zhou , Chongxuan Li

This paper aims to build a probabilistic framework for Howard's policy iteration algorithm using the language of forward-backward stochastic differential equations (FBSDEs). As opposed to conventional formulations based on partial…

Optimization and Control · Mathematics 2024-10-28 Yutian Wang , Yuan-Hua Ni , Zengqiang Chen , Ji-Feng Zhang

Data-driven machine learning approaches are being increasingly used to solve partial differential equations (PDEs). They have shown particularly striking successes when training an operator, which takes as input a PDE in some family, and…

Machine Learning · Computer Science 2023-12-04 Tanya Marwah , Ashwini Pokle , J. Zico Kolter , Zachary C. Lipton , Jianfeng Lu , Andrej Risteski

In this paper we introduce a model, the stochastic fractional delay differential equation (SFDDE), which is based on the linear stochastic delay differential equation and produces stationary processes with hyperbolically decaying…

Probability · Mathematics 2018-06-21 Richard A. Davis , Mikkel Slot Nielsen , Victor Rohde

We introduce a mathematically rigorous framework based on rough path theory to model stochastic spiking neural networks (SSNNs) as stochastic differential equations with event discontinuities (Event SDEs) and driven by c\`adl\`ag rough…

Machine Learning · Statistics 2024-05-24 Christian Holberg , Cristopher Salvi

We propose a numerical method for solving high dimensional fully nonlinear partial differential equations (PDEs). Our algorithm estimates simultaneously by backward time induction the solution and its gradient by multi-layer neural…

Optimization and Control · Mathematics 2021-01-27 Huyen Pham , Xavier Warin , Maximilien Germain

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

Machine Learning · Computer Science 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

This work studies quantum algorithms to solve high-dimensional stochastic differential equations (SDEs) $\mathrm{d} \mathbf{X}_t = A(t) \mathbf{X}_t \mathrm{d} t + B(t) \mathrm{d} \mathbf{W}_t$. Aiming for a speed-up in the dimension $N$ of…

Quantum Physics · Physics 2026-04-28 Koichi Miyamoto