English
Related papers

Related papers: Generating synthetic data for neural operators

200 papers

Neural operators (NOs) provide a new paradigm for efficiently solving partial differential equations (PDEs), but their training depends on costly high-fidelity data from numerical solvers, limiting applications in complex systems. We…

Computational Physics · Physics 2026-05-18 Wen You , Shaoqian Zhou , Xuhui Meng

Many important problems in science and engineering require solving the so-called parametric partial differential equations (PDEs), i.e., PDEs with different physical parameters, boundary conditions, shapes of computation domains, etc.…

Machine Learning · Computer Science 2022-11-22 Xiang Huang , Zhanhong Ye , Hongsheng Liu , Beiji Shi , Zidong Wang , Kang Yang , Yang Li , Bingya Weng , Min Wang , Haotian Chu , Fan Yu , Bei Hua , Lei Chen , Bin Dong

The numerical solution of high dimensional partial differential equations (PDEs) is severely constrained by the curse of dimensionality (CoD), rendering classical grid--based methods impractical beyond a few dimensions. In recent years,…

Numerical Analysis · Mathematics 2026-01-27 Wenzhong Zhang , Zheyuan Hu , Wei Cai , George EM Karniadakis

Neural operators are a popular technique in scientific machine learning to learn a mathematical model of the behavior of unknown physical systems from data. Neural operators are especially useful to learn solution operators associated with…

Numerical Analysis · Mathematics 2022-08-05 Nicolas Boullé , Seick Kim , Tianyi Shi , Alex Townsend

Synthetic data generation is of great interest in diverse applications, such as for privacy protection. Deep generative models, such as variational autoencoders (VAEs), are a popular approach for creating such synthetic datasets from…

Machine Learning · Statistics 2021-05-17 Kiana Farhadyar , Federico Bonofiglio , Daniela Zoeller , Harald Binder

The data-driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data-driven partial differential…

Numerical Analysis · Mathematics 2020-11-10 Hassan Arbabi , Judith E. Bunder , Giovanni Samaey , Anthony J. Roberts , Ioannis G. Kevrekidis

Generating synthetic data through generative models is gaining interest in the ML community and beyond, promising a future where datasets can be tailored to individual needs. Unfortunately, synthetic data is usually not perfect, resulting…

Machine Learning · Computer Science 2023-07-11 Boris van Breugel , Zhaozhi Qian , Mihaela van der Schaar

Many problems in science and engineering can be represented by a set of partial differential equations (PDEs) through mathematical modeling. Mechanism-based computation following PDEs has long been an essential paradigm for studying topics…

Machine Learning · Computer Science 2022-11-21 Shudong Huang , Wentao Feng , Chenwei Tang , Jiancheng Lv

Recent progress in scientific machine learning (SciML) has opened up the possibility of training novel neural network architectures that solve complex partial differential equations (PDEs). Several (nearly data free) approaches have been…

Data-driven deep learning methods like neural operators have advanced in solving nonlinear temporal partial differential equations (PDEs). However, these methods require large quantities of solution pairs\u2014the solution functions and…

Machine Learning · Computer Science 2026-03-03 Lei Liu , Zhenxin Huang , Hong Wang , huanshuo dong , Haiyang Xin , Hongwei Zhao , Bin Li

Partial Differential Equations (PDEs) describe phenomena ranging from turbulence and epidemics to quantum mechanics and financial markets. Despite recent advances in computational science, solving such PDEs for real-world applications…

Machine Learning · Computer Science 2025-05-19 Lothar Heimbach , Sebastian Kaltenbach , Petr Karnakov , Francis J. Alexander , Petros Koumoutsakos

(Partial) differential equations (PDEs) are fundamental tools for describing natural phenomena, making their solution crucial in science and engineering. While traditional methods, such as the finite element method, provide reliable…

Machine Learning · Computer Science 2025-03-11 Viggo Moro , Luiz F. O. Chamon

At present, deep learning based methods are being employed to resolve the computational challenges of high-dimensional partial differential equations (PDEs). But the computation of the high order derivatives of neural networks is costly,…

Numerical Analysis · Mathematics 2021-03-17 Quanhui Zhu , Jiang Yang

Inverse problems are important mathematical problems that seek to recover model parameters from noisy data. Since inverse problems are often ill-posed, they require regularization or incorporation of prior information about the underlying…

Numerical Analysis · Mathematics 2026-02-09 Oluwatosin Akande , Gabriel P. Langlois , Akwum Onwunta

In recent years, data-driven methods have been developed to learn dynamical systems and partial differential equations (PDE). The goal of such work is discovering unknown physics and the corresponding equations. However, prior to achieving…

Machine Learning · Statistics 2021-02-17 Hao Xu , Haibin Chang , Dongxiao Zhang

In this paper, we present an initial attempt to learn evolution PDEs from data. Inspired by the latest development of neural network designs in deep learning, we propose a new feed-forward deep network, called PDE-Net, to fulfill two…

Numerical Analysis · Mathematics 2018-01-03 Zichao Long , Yiping Lu , Xianzhong Ma , Bin Dong

In this paper we establish a connection between non-convex optimization methods for training deep neural networks and nonlinear partial differential equations (PDEs). Relaxation techniques arising in statistical physics which have already…

Machine Learning · Computer Science 2017-06-05 Pratik Chaudhari , Adam Oberman , Stanley Osher , Stefano Soatto , Guillaume Carlier

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad

A kernel-based approach for the learning of the solution operator of general nonhomogeneous partial differential equations (PDEs) is proposed. The method incorporates physical priors, typically encoded through the PDE operator, into a…

Numerical Analysis · Mathematics 2026-05-12 Jianyu Hu , Juan-Pablo Ortega

We present a framework for recovering/approximating unknown time-dependent partial differential equation (PDE) using its solution data. Instead of identifying the terms in the underlying PDE, we seek to approximate the evolution operator of…

Numerical Analysis · Mathematics 2020-05-05 Kailiang Wu , Dongbin Xiu