English
Related papers

Related papers: A forward scheme with machine learning for forward…

200 papers

The Forward-Forward (FF) Algorithm has been recently proposed to alleviate the issues of backpropagation (BP) commonly used to train deep neural networks. However, its current formulation exhibits limitations such as the generation of…

Machine Learning · Computer Science 2024-03-29 Andreas Papachristodoulou , Christos Kyrkou , Stelios Timotheou , Theocharis Theocharides

Most deep learning models are based on deep neural networks with multiple layers between input and output. The parameters defining these layers are initialized using random values and are "learned" from data, typically using stochastic…

Machine Learning · Computer Science 2019-03-05 Prakash Mohan , Marc T. Henry de Frahan , Ryan King , Ray W. Grout

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

We propose a new method for the numerical solution of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. Using Girsanov's…

Optimization and Control · Mathematics 2022-10-20 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

This paper is dedicated to solving high-dimensional coupled FBSDEs with non-Lipschitz diffusion coefficients numerically. Under mild conditions, we provided a posterior estimate of the numerical solution that holds for any time duration.…

Probability · Mathematics 2022-01-19 Yifan Jiang , Jinfeng Li

We propose the predictive forward-forward (PFF) algorithm for conducting credit assignment in neural systems. Specifically, we design a novel, dynamic recurrent neural system that learns a directed generative circuit jointly and…

Machine Learning · Computer Science 2023-04-04 Alexander Ororbia , Ankur Mali

In complex physical systems, conventional differential equations often fall short in capturing non-local and memory effects, as they are limited to local dynamics and integer-order interactions. This study introduces a stepwise data-driven…

Computational Physics · Physics 2025-05-30 Xiangnan Yu , Hao Xu , Zhiping Mao , HongGuang Sun , Yong Zhang , Dongxiao Zhang , Yuntian Chen

We propose an accurate data-driven numerical scheme to solve Stochastic Differential Equations (SDEs), by taking large time steps. The SDE discretization is built up by means of a polynomial chaos expansion method, on the basis of…

Numerical Analysis · Mathematics 2021-09-24 Shuaiqiang Liu , Lech A. Grzelak , Cornelis W. Oosterlee

Diffusion models with continuous stochastic differential equations (SDEs) have shown superior performances in image generation. It can serve as a deep generative prior to solving the inverse problem in magnetic resonance (MR)…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Chentao Cao , Zhuo-Xu Cui , Yue Wang , Shaonan Liu , Taijin Chen , Hairong Zheng , Dong Liang , Yanjie Zhu

In this paper, we study the mean reflected backward stochastic differential equations with jump (BSDEJs). We extend the work of Briand and Hibon on the propagation of chaos for mean reflected BSDEs \cite{briand2021particles} to the jump…

Probability · Mathematics 2024-06-19 Yiqing Lin , Kun Xu

We propose a numerical method for the computation of the forward-backward stochastic differential equations (FBSDE) appearing in the Feynman-Kac representation of the value function in stochastic optimal control problems. By the use of the…

Optimization and Control · Mathematics 2021-03-29 Kelsey P. Hawkins , Ali Pakniyat , Evangelos Theodorou , Panagiotis Tsiotras

Machine learning for scientific applications faces the challenge of limited data. We propose a framework that leverages a priori known physics to reduce overfitting when training on relatively small datasets. A deep neural network is…

Machine Learning · Computer Science 2019-11-22 Jonathan B. Freund , Jonathan F. MacArt , Justin Sirignano

We introduce a discrete time reflected scheme to solve doubly reflected Backward Stochastic Differential Equations with jumps (in short DRBSDEs), driven by a Brownian motion and an independent compensated Poisson process. As in…

Probability · Mathematics 2015-11-11 Roxana Dumitrescu , Céline Labart

In [5] the authors obtained Mean-Field backward stochastic differential equations (BSDE) associated with a Mean-field stochastic differential equation (SDE) in a natural way as limit of some highly dimensional system of forward and backward…

Probability · Mathematics 2007-11-21 Rainer Buckdahn , Juan Li , Shige Peng

Forward regression is a statistical model selection and estimation procedure which inductively selects covariates that add predictive power into a working statistical regression model. Once a model is selected, unknown regression parameters…

Machine Learning · Statistics 2018-04-12 Damian Kozbur

Artificial intelligence (AI) for fluid mechanics has become attractive topic. High-fidelity data is one of most critical issues for the successful applications of AI in fluid mechanics, however, it is expensively obtained or even…

Machine Learning · Computer Science 2025-09-03 Ruilin Chen

In this work we consider a stochastic differential equation (SDEs) with jump. We prove the existence and the uniqueness of solution of this equation in the strong sense under global Lipschitz condition. Generally, exact solutions of SDEs…

Numerical Analysis · Mathematics 2015-10-09 Jean Daniel Mukam

In this paper, we study the existence and uniqueness of solution to a system of nonlinear fully coupled forward-backward doubly stochastic differential equations with Poisson jumps. Our work is established in infinite dimensional separable…

Probability · Mathematics 2024-07-12 AbdulRahman Al-Hussein

We introduce a new approach in distributed deep learning, utilizing Geoffrey Hinton's Forward-Forward (FF) algorithm to speed up the training of neural networks in distributed computing environments. Unlike traditional methods that rely on…

Machine Learning · Computer Science 2024-05-10 Ege Aktemur , Ege Zorlutuna , Kaan Bilgili , Tacettin Emre Bok , Berrin Yanikoglu , Suha Orhun Mutluergil

Deep feedforward neural networks (DFNNs) are a powerful tool for functional approximation. We describe flexible versions of generalized linear and generalized linear mixed models incorporating basis functions formed by a DFNN. The…

Computation · Statistics 2018-05-28 Minh-Ngoc Tran , Nghia Nguyen , David Nott , Robert Kohn
‹ Prev 1 8 9 10 Next ›