English
Related papers

Related papers: Inverse Evolution Data Augmentation for Neural PDE…

200 papers

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, current NO-based…

Machine Learning · Computer Science 2024-03-18 Ashutosh Singh , Ricardo Augusto Borsoi , Deniz Erdogmus , Tales Imbiriba

Neural Ordinary Differential Equations replace the right-hand side of a conventional ODE with a neural net, which by virtue of the universal approximation theorem, can be trained to the representation of any function. When we do not know…

Neurons and Cognition · Quantitative Biology 2020-08-25 Robert Strauss

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Finding accurate solutions to partial differential equations (PDEs) is a crucial task in all scientific and engineering disciplines. It has recently been shown that machine learning methods can improve the solution accuracy by correcting…

Computational Physics · Physics 2021-01-06 Kiwon Um , Robert Brand , Yun , Fei , Philipp Holl , Nils Thuerey

Deep operator network (DeepONet) has demonstrated great success in various learning tasks, including learning solution operators of partial differential equations. In particular, it provides an efficient approach to predict the evolution…

Machine Learning · Computer Science 2022-12-12 Wuzhe Xu , Yulong Lu , Li Wang

Deep neural networks (DNN) have been used to model nonlinear relations between physical quantities. Those DNNs are embedded in physical systems described by partial differential equations (PDE) and trained by minimizing a loss function that…

Numerical Analysis · Mathematics 2020-02-26 Kailai Xu , Eric Darve

This study investigates the application of machine learning, specifically Fourier Neural Operator (FNO) and Convolutional Neural Network (CNN), to learn time-advancement operators for parametric partial differential equations (PDEs). Our…

Machine Learning · Computer Science 2024-02-19 Rixin Yu , Erdzan Hodzic

Deep artificial neural networks require a large corpus of training data in order to effectively learn, where collection of such training data is often expensive and laborious. Data augmentation overcomes this issue by artificially inflating…

Machine Learning · Computer Science 2017-08-22 Luke Taylor , Geoff Nitschke

In this paper we show how to augment classical methods for inverse problems with artificial neural networks. The neural network acts as a prior for the coefficient to be estimated from noisy data. Neural networks are global, smooth function…

Machine Learning · Statistics 2018-09-17 Jens Berg , Kaj Nyström

Inverse problems involving partial differential equations (PDEs) can be seen as discovering a mapping from measurement data to unknown quantities, often framed within an operator learning approach. However, existing methods typically rely…

Numerical Analysis · Mathematics 2025-02-10 Sung Woong Cho , Hwijae Son

Data-driven discovery of partial differential equations (PDEs) has attracted increasing attention in recent years. Although significant progress has been made, certain unresolved issues remain. For example, for PDEs with high-order…

Machine Learning · Computer Science 2021-09-14 Hao Xu , Dongxiao Zhang , Nanzhe Wang

Recently, researchers have utilized neural networks to accurately solve partial differential equations (PDEs), enabling the mesh-free method for scientific computation. Unfortunately, the network performance drops when encountering a high…

Machine Learning · Computer Science 2021-09-29 Pongpisit Thanasutives , Masayuki Numao , Ken-ichi Fukui

Numerical simulation of ordinary differential equations (ODEs) can be challenging when the system exhibits high accelerations and rapidly changing dynamics. Under these conditions the ODE solver often needs to take very small time steps in…

Numerical Analysis · Mathematics 2026-05-11 Andrew Tagg , Andrew Frandsen , Andrew Ning

There has recently been increasing attention towards developing foundational neural Partial Differential Equation (PDE) solvers and neural operators through large-scale pretraining. However, unlike vision and language models that make use…

Machine Learning · Computer Science 2024-11-21 AmirPouya Hemmasian , Amir Barati Farimani

Neural networks have emerged as powerful surrogates for solving partial differential equations (PDEs), offering significant computational speedups over traditional methods. However, these models suffer from a critical limitation: error…

Machine Learning · Computer Science 2025-12-29 Xinquan Huang , Paris Perdikaris

In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two…

Numerical Analysis · Mathematics 2018-01-03 Zichao Long , Yiping Lu , Xianzhong Ma , Bin Dong

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

The task of simultaneously reconstructing multiple physical coefficients in partial differential equations (PDEs) from observed data is ubiquitous in applications. In this work, we propose an integrated data-driven and model-based iterative…

Numerical Analysis · Mathematics 2025-07-04 Kui Ren , Lu Zhang

In recent years, deep learning has proven to be a viable methodology for surrogate modeling and uncertainty quantification for a vast number of physical systems. However, in their traditional form, such models can require a large amount of…

Computational Physics · Physics 2019-12-04 Nicholas Geneva , Nicholas Zabaras

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu