English
Related papers

Related papers: Forward-Backward Stochastic Neural Networks: Deep …

200 papers

In many areas, such as the physical sciences, life sciences, and finance, control approaches are used to achieve a desired goal in complex dynamical systems governed by differential equations. In this work we formulate the problem of…

Machine Learning · Computer Science 2021-12-09 Erfan Pirmorad , Faraz Khoshbakhtian , Farnam Mansouri , Amir-massoud Farahmand

Recent works in deep learning have shown that integrating differentiable physics simulators into the training process can greatly improve the quality of results. Although this combination represents a more complex optimization task than…

Machine Learning · Computer Science 2022-03-22 Patrick Schnell , Philipp Holl , Nils Thuerey

Deep neural networks work well at approximating complicated functions when provided with data and trained by gradient descent methods. At the same time, there is a vast amount of existing functions that programmatically solve different…

Machine Learning · Computer Science 2019-01-15 Alon Jacovi , Guy Hadash , Einat Kermany , Boaz Carmeli , Ofer Lavi , George Kour , Jonathan Berant

Providing fast and accurate solutions to partial differential equations is a problem of continuous interest to the fields of applied mathematics and physics. With the recent advances in machine learning, the adoption learning techniques in…

Computational Physics · Physics 2019-04-16 S. Mohammad H. Hashemi , Demetri Psaltis

Deep neural networks are susceptible to learn biased models with entangled feature representations, which may lead to subpar performances on various downstream tasks. This is particularly true for under-represented classes, where a lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Sanghyeok Chu , Dongwan Kim , Bohyung Han

In this paper we consider the numerical approximation of nonlocal integro differential parabolic equations via neural networks. These equations appear in many recent applications, including finance, biology and others, and have been…

Probability · Mathematics 2021-03-30 Javier Castro

Deep quantum neural networks may provide a promising way to achieve quantum learning advantage with noisy intermediate scale quantum devices. Here, we use deep quantum feedforward neural networks capable of universal quantum computation to…

Quantum Physics · Physics 2020-08-14 Zidu Liu , L. -M. Duan , Dong-Ling Deng

This paper proposes two algorithms for solving stochastic control problems with deep learning, with a focus on the utility maximisation problem. The first algorithm solves Markovian problems via the Hamilton Jacobi Bellman (HJB) equation.…

Computational Finance · Quantitative Finance 2024-10-15 Ashley Davey , Harry Zheng

The probability density function of stochastic differential equations is governed by the Fokker-Planck (FP) equation. A novel machine learning method is developed to solve the general FP equations based on deep neural networks. The proposed…

Computational Physics · Physics 2020-02-19 Yong Xu , Hao Zhang , Yongge Li , Kuang Zhou , Qi Liu , Jürgen Kurths

Over the past few years, deep learning has risen to the foreground as a topic of massive interest, mainly as a result of successes obtained in solving large-scale image processing tasks. There are multiple challenging mathematical problems…

We propose and study a scheme combining the finite element method and machine learning techniques for the numerical approximations of coupled nonlinear forward-backward stochastic partial differential equations (FBSPDEs) with homogeneous…

Numerical Analysis · Mathematics 2020-12-16 Hasib Uddin Molla , Jinniao Qiu

Spatial prediction problems often use Gaussian process models, which can be computationally burdensome in high dimensions. Specification of an appropriate covariance function for the model can be challenging when complex non-stationarities…

Methodology · Statistics 2024-09-13 Qi Wang , Paul A. Parker , Robert B. Lund

This paper presents several numerical applications of deep learning-based algorithms that have been introduced in [HPBL18]. Numerical and comparative tests using TensorFlow illustrate the performance of our different algorithms, namely…

Optimization and Control · Mathematics 2022-03-08 Achref Bachouch , Côme Huré , Nicolas Langrené , Huyen Pham

Solving differential equations efficiently and accurately sits at the heart of progress in many areas of scientific research, from classical dynamical systems to quantum mechanics. There is a surge of interest in using Physics-Informed…

Machine Learning · Computer Science 2022-07-06 Shaan Desai , Marios Mattheakis , Hayden Joy , Pavlos Protopapas , Stephen Roberts

The ability to train Deep Neural Networks (DNNs) with constraints is instrumental in improving the fairness of modern machine-learning models. Many algorithms have been analysed in recent years, and yet there is no standard, widely accepted…

Machine Learning · Computer Science 2026-02-19 Andrii Kliachkin , Jana Lepšová , Gilles Bareilles , Jakub Mareček

Solving partial differential equations (PDE) is an indispensable part of many branches of science as many processes can be modelled in terms of PDEs. However, recent numerical solvers require manual discretization of the underlying equation…

Approximating the solutions of boundary value problems governed by partial differential equations with neural networks is challenging, largely due to the difficult training process. This difficulty can be partly explained by the spectral…

Numerical Analysis · Mathematics 2025-11-03 Alexander Heinlein , Taniya Kapoor

We present a deep recurrent neural network architecture to solve a class of stochastic optimal control problems described by fully nonlinear Hamilton Jacobi Bellmanpartial differential equations. Such PDEs arise when one considers…

Machine Learning · Computer Science 2019-12-24 Marcus A Pereira , Ziyi Wang , Tianrong Chen , Emily Reed , Evangelos A Theodorou

Physics-informed deep learning has emerged as a promising alternative for solving partial differential equations. However, for complex problems, training these networks can still be challenging, often resulting in unsatisfactory accuracy…

Machine Learning · Computer Science 2025-09-18 Wenqian Chen , Amanda A. Howard , Panos Stinis

We employ constraints to control the parameter space of deep neural networks throughout training. The use of customized, appropriately designed constraints can reduce the vanishing/exploding gradients problem, improve smoothness of…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Tiffany Vlaar , Timothée Pouchon , Amos Storkey