English
Related papers

Related papers: Unbiased and Second-Order-Free Training for High-D…

200 papers

We study a fundamental class of regression models called the second order linear model (SLM). The SLM extends the linear model to high order functional space and has attracted considerable research interest recently. Yet how to efficiently…

Machine Learning · Statistics 2017-06-26 Ming Lin , Shuang Qiu , Bin Hong , Jieping Ye

In this paper we propose a new kind of high order numerical scheme for backward stochastic differential equations(BSDEs). Unlike the traditional $\theta$-scheme, we reduce truncation errors by taking $\theta$ carefully for every subinterval…

Numerical Analysis · Mathematics 2018-08-08 Chol-Kyu Pak , Mun-Chol Kim , Chang-Ho Rim

In this paper, a highly parallel and derivative-free martingale neural network learning method is proposed to solve Hamilton-Jacobi-Bellman (HJB) equations arising from stochastic optimal control problems (SOCPs), as well as general…

Optimization and Control · Mathematics 2024-12-23 Wei Cai , Shuixin Fang , Wenzhong Zhang , Tao Zhou

This is one of our series papers on multistep schemes for solving forward backward stochastic differential equations (FBSDEs) and related problems. Here we extend (with non-trivial updates) our multistep schemes in [W. Zhao, Y. Fu and T.…

Numerical Analysis · Mathematics 2015-02-12 Kong Tao , Weidong Zhao , Tao Zhou

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

Machine Learning · Computer Science 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

Numerical Analysis · Mathematics 2021-11-30 Christophe Bonneville , Christopher J. Earls

Backward stochastic differential equations (BSDEs) appear in numeruous applications. Classical approximation methods suffer from the curse of dimensionality and deep learning-based approximation methods are not known to converge to the BSDE…

Probability · Mathematics 2022-04-20 Martin Hutzenthaler , Tuan Anh Nguyen

While the superior performance of second-order optimization methods such as Newton's method is well known, they are hardly used in practice for deep learning because neither assembling the Hessian matrix nor calculating its inverse is…

Machine Learning · Computer Science 2020-09-16 Siyuan Shen , Tianjia Shao , Kun Zhou , Chenfanfu Jiang , Feng Luo , Yin Yang

Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and…

Machine Learning · Computer Science 2023-05-23 Chengping Rao , Hao Sun , Yang Liu

Physics-informed Neural Networks (PINNs) have recently achieved remarkable progress in solving Partial Differential Equations (PDEs) in various fields by minimizing a weighted sum of PDE loss and boundary loss. However, there are several…

Machine Learning · Computer Science 2023-06-06 Jiachen Yao , Chang Su , Zhongkai Hao , Songming Liu , Hang Su , Jun Zhu

In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design…

Machine Learning · Computer Science 2023-10-17 Woojin Cho , Kookjin Lee , Donsub Rim , Noseong Park

Physics-informed neural networks (PINNs) provide a promising machine learning framework for solving partial differential equations, but their training often breaks down on challenging problems, sometimes converging to physically incorrect…

Machine Learning · Computer Science 2026-04-28 Sifan Wang , Shawn Koohy , Yiping Lu , Paris Perdikaris

In this paper, we develop new high-order numerical methods for hyperbolic systems of nonlinear partial differential equations (PDEs) with uncertainties. The new approach is realized in the semi-discrete finite-volume framework and is based…

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

Physics-informed Neural Networks (PINNs) have recently emerged as a principled way to include prior physical knowledge in form of partial differential equations (PDEs) into neural networks. Although PINNs are generally viewed as mesh-free,…

Machine Learning · Computer Science 2022-10-04 Fabricio Arend Torres , Marcello Massimo Negri , Monika Nagy-Huber , Maxim Samarin , Volker Roth

Machine learning for partial differential equations (PDEs) is a hot topic. In this paper we introduce and analyse a Deep BSDE scheme for nonlinear integro-PDEs with unbounded nonlocal operators -problems arising in e.g. stochastic control…

Analysis of PDEs · Mathematics 2024-07-15 Espen Robstad Jakobsen , Sehail Mazid

Partial Differential Equations (PDEs) are central to modeling complex systems across physical, biological, and engineering domains, yet traditional numerical methods often struggle with high-dimensional or complex problems. Physics-Informed…

Machine Learning · Computer Science 2026-02-11 Chenggong Zhang

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a…

Numerical Analysis · Mathematics 2023-03-21 Ruimeng Hu , Quyuan Lin , Alan Raydan , Sui Tang

Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even…

Machine Learning · Statistics 2019-09-10 Constantin Grigo , Phaedon-Stelios Koutsourelakis