中文
相关论文

相关论文: Unbiased and Second-Order-Free Training for High-D…

200 篇论文

We study a fundamental class of regression models called the second order linear model (SLM). The SLM extends the linear model to high order functional space and has attracted considerable research interest recently. Yet how to efficiently…

机器学习 · 统计学 2017-06-26 Ming Lin , Shuang Qiu , Bin Hong , Jieping Ye

In this paper we propose a new kind of high order numerical scheme for backward stochastic differential equations(BSDEs). Unlike the traditional $\theta$-scheme, we reduce truncation errors by taking $\theta$ carefully for every subinterval…

数值分析 · 数学 2018-08-08 Chol-Kyu Pak , Mun-Chol Kim , Chang-Ho Rim

In this paper, a highly parallel and derivative-free martingale neural network learning method is proposed to solve Hamilton-Jacobi-Bellman (HJB) equations arising from stochastic optimal control problems (SOCPs), as well as general…

最优化与控制 · 数学 2024-12-23 Wei Cai , Shuixin Fang , Wenzhong Zhang , Tao Zhou

This is one of our series papers on multistep schemes for solving forward backward stochastic differential equations (FBSDEs) and related problems. Here we extend (with non-trivial updates) our multistep schemes in [W. Zhao, Y. Fu and T.…

数值分析 · 数学 2015-02-12 Kong Tao , Weidong Zhao , Tao Zhou

Partial differential equations (PDEs) serve as the cornerstone of mathematical physics. In recent years, Physics-Informed Neural Networks (PINNs) have significantly reduced the dependence on large datasets by embedding physical laws…

机器学习 · 计算机科学 2025-06-09 Wenxuan Huo , Qiang He , Gang Zhu , Weifeng Huang

Scientific machine learning has been successfully applied to inverse problems and PDE discovery in computational physics. One caveat concerning current methods is the need for large amounts of ("clean") data, in order to characterize the…

数值分析 · 数学 2021-11-30 Christophe Bonneville , Christopher J. Earls

Backward stochastic differential equations (BSDEs) appear in numeruous applications. Classical approximation methods suffer from the curse of dimensionality and deep learning-based approximation methods are not known to converge to the BSDE…

概率论 · 数学 2022-04-20 Martin Hutzenthaler , Tuan Anh Nguyen

While the superior performance of second-order optimization methods such as Newton's method is well known, they are hardly used in practice for deep learning because neither assembling the Hessian matrix nor calculating its inverse is…

机器学习 · 计算机科学 2020-09-16 Siyuan Shen , Tianjia Shao , Kun Zhou , Chenfanfu Jiang , Feng Luo , Yin Yang

Modeling nonlinear spatiotemporal dynamical systems has primarily relied on partial differential equations (PDEs). However, the explicit formulation of PDEs for many underexplored processes, such as climate systems, biochemical reaction and…

机器学习 · 计算机科学 2023-05-23 Chengping Rao , Hao Sun , Yang Liu

Physics-informed Neural Networks (PINNs) have recently achieved remarkable progress in solving Partial Differential Equations (PDEs) in various fields by minimizing a weighted sum of PDE loss and boundary loss. However, there are several…

机器学习 · 计算机科学 2023-06-06 Jiachen Yao , Chang Su , Zhongkai Hao , Songming Liu , Hang Su , Jun Zhu

In various engineering and applied science applications, repetitive numerical simulations of partial differential equations (PDEs) for varying input parameters are often required (e.g., aircraft shape optimization over many design…

机器学习 · 计算机科学 2023-10-17 Woojin Cho , Kookjin Lee , Donsub Rim , Noseong Park

Physics-informed neural networks (PINNs) provide a promising machine learning framework for solving partial differential equations, but their training often breaks down on challenging problems, sometimes converging to physically incorrect…

机器学习 · 计算机科学 2026-04-28 Sifan Wang , Shawn Koohy , Yiping Lu , Paris Perdikaris

In this paper, we develop new high-order numerical methods for hyperbolic systems of nonlinear partial differential equations (PDEs) with uncertainties. The new approach is realized in the semi-discrete finite-volume framework and is based…

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

数值分析 · 数学 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

Physics-informed Neural Networks (PINNs) have recently emerged as a principled way to include prior physical knowledge in form of partial differential equations (PDEs) into neural networks. Although PINNs are generally viewed as mesh-free,…

机器学习 · 计算机科学 2022-10-04 Fabricio Arend Torres , Marcello Massimo Negri , Monika Nagy-Huber , Maxim Samarin , Volker Roth

Machine learning for partial differential equations (PDEs) is a hot topic. In this paper we introduce and analyse a Deep BSDE scheme for nonlinear integro-PDEs with unbounded nonlocal operators -problems arising in e.g. stochastic control…

偏微分方程分析 · 数学 2024-07-15 Espen Robstad Jakobsen , Sehail Mazid

Partial Differential Equations (PDEs) are central to modeling complex systems across physical, biological, and engineering domains, yet traditional numerical methods often struggle with high-dimensional or complex problems. Physics-Informed…

机器学习 · 计算机科学 2026-02-11 Chenggong Zhang

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

最优化与控制 · 数学 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Large-scale dynamics of the oceans and the atmosphere are governed by primitive equations (PEs). Due to the nonlinearity and nonlocality, the numerical study of the PEs is generally challenging. Neural networks have been shown to be a…

数值分析 · 数学 2023-03-21 Ruimeng Hu , Quyuan Lin , Alan Raydan , Sui Tang

Well-established methods for the solution of stochastic partial differential equations (SPDEs) typically struggle in problems with high-dimensional inputs/outputs. Such difficulties are only amplified in large-scale applications where even…

机器学习 · 统计学 2019-09-10 Constantin Grigo , Phaedon-Stelios Koutsourelakis