English
Related papers

Related papers: Monte Carlo-Type Neural Operator for Differential …

200 papers

We introduce a novel kernel learning framework toward efficiently solving nonlinear partial differential equations (PDEs). In contrast to the state-of-the-art kernel solver that embeds differential operators within kernels, posing…

Machine Learning · Computer Science 2025-06-09 Zhitong Xu , Da Long , Yiming Xu , Guang Yang , Shandian Zhe , Houman Owhadi

Learning PDE dynamics from limited data with unknown physics is challenging. Existing neural PDE solvers either require large datasets or rely on known physics (e.g., PDE residuals or handcrafted stencils), leading to limited applicability.…

Machine Learning · Computer Science 2026-05-25 Han Wan , Rui Zhang , Hao Sun

Fourier Neural Operator (FNO) is a powerful and popular operator learning method. However, FNO is mainly used in forward prediction, yet a great many applications rely on solving inverse problems. In this paper, we propose an invertible…

Machine Learning · Computer Science 2025-05-07 Da Long , Zhitong Xu , Qiwei Yuan , Yin Yang , Shandian Zhe

Unsupervised learning with functional data is an emerging paradigm of machine learning research with applications to computer vision, climate modeling and physical systems. A natural way of modeling functional data is by learning operators…

Machine Learning · Computer Science 2023-02-22 Jacob H. Seidman , Georgios Kissas , George J. Pappas , Paris Perdikaris

The operator learning has received significant attention in recent years, with the aim of learning a mapping between function spaces. Prior works have proposed deep neural networks (DNNs) for learning such a mapping, enabling the learning…

Machine Learning · Statistics 2024-02-15 Yusuke Tanaka , Takaharu Yaguchi , Tomoharu Iwata , Naonori Ueda

We introduce MENO (''Matrix Exponential-based Neural Operator''), a hybrid surrogate modeling framework for efficiently solving stiff systems of ordinary differential equations (ODEs) that exhibit a sparse nonlinear structure. In such…

Computational Physics · Physics 2025-07-22 Ivan Zanardi , Simone Venturi , Marco Panesi

We propose an operator learning approach to accelerate geometric Markov chain Monte Carlo (MCMC) for solving infinite-dimensional Bayesian inverse problems (BIPs). While geometric MCMC employs high-quality proposals that adapt to posterior…

Numerical Analysis · Mathematics 2024-05-21 Lianghao Cao , Thomas O'Leary-Roseberry , Omar Ghattas

Efficient onboard multi-field sparse reconstruction is essential for the autonomous operation of aerospace vehicles. While existing deep learning models exhibit promise for single-field reconstruction, deploying multiple independent models…

Machine Learning · Computer Science 2026-05-27 Siyu Ye , Shihang Li , Zhiqiang Gong , Benrong Zhang , Weien Zhou , Yiyong Huang , Wen Yao

We consider solving partial differential equations (PDEs) with Fourier neural operators (FNOs), which operate in the frequency domain. Since the laws of physics do not depend on the coordinate system used to describe them, it is desirable…

Machine Learning · Computer Science 2023-07-28 Jacob Helwig , Xuan Zhang , Cong Fu , Jerry Kurtin , Stephan Wojtowytsch , Shuiwang Ji

In this paper, we propose a general framework for solving high-dimensional partial differential equations with tensor networks. Our approach uses Monte-Carlo simulations to update the solution and re-estimates the new solution from samples…

Numerical Analysis · Mathematics 2025-12-12 Yian Chen , Yuehaw Khoo , Ziang Yu

Inferring parameters of high-dimensional partial differential equations (PDEs) poses significant computational and inferential challenges, primarily due to the curse of dimensionality and the inherent limitations of traditional numerical…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Weihao Yan , Christoph Brune , Mengwu Guo

Neural PDE solvers are increasingly used as learned surrogates for families of partial differential equations, where the key machine learning challenge is not only interpolation on a fixed benchmark distribution but generalization under…

Machine Learning · Computer Science 2026-05-26 Lennon Shikhman

In this work, we describe a novel approach to building a neural PDE solver leveraging recent advances in transformer based neural network architectures. Our model can provide solutions for different values of PDE parameters without any need…

Machine Learning · Computer Science 2024-07-10 Varun Madhavan , Amal S Sebastian , Bharath Ramsundar , Venkatasubramanian Viswanathan

We propose a framework for training neural networks that are coupled with partial differential equations (PDEs) in a parallel computing environment. Unlike most distributed computing frameworks for deep neural networks, our focus is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-25 Kailai Xu , Weiqiang Zhu , Eric Darve

Many problems require to approximate an expected value by some kind of Monte Carlo (MC) sampling, e.g. molecular dynamics (MD) or simulation of stochastic reaction models (also termed kinetic Monte Carlo (kMC)). Often, we are furthermore…

Numerical Analysis · Mathematics 2019-02-18 Sandra Döpking , Sebastian Matera

Neural operators effectively solve PDE problems from data without knowing the explicit equations, which learn the map from the input sequences of observed samples to the predicted values. Most existing works build the model in the original…

Machine Learning · Computer Science 2024-12-23 Tian Wang , Chuang Wang

Solving cell problems in homogenization is hard, and available deep-learning frameworks fail to match the speed and generality of traditional computational frameworks. More to the point, it is generally unclear what to expect of…

Computational Engineering, Finance, and Science · Computer Science 2025-11-07 Binh Huy Nguyen , Matti Schneider

Neural operators (NOs) struggle with high-contrast multiscale partial differential equations (PDEs), where fine-scale heterogeneities cause large errors. To address this, we use the Generalized Multiscale Finite Element Method (GMsFEM) that…

In recent years, tremendous progress has been made on numerical algorithms for solving partial differential equations (PDEs) in a very high dimension, using ideas from either nonlinear (multilevel) Monte Carlo or deep learning. They are…

Numerical Analysis · Mathematics 2021-12-13 Weinan E , Jiequn Han , Arnulf Jentzen

Deep learning methods have access to be employed for solving physical systems governed by parametric partial differential equations (PDEs) due to massive scientific data. It has been refined to operator learning that focuses on learning…

Machine Learning · Computer Science 2024-03-06 Chu Wang , Jinhong Wu , Yanzhi Wang , Zhijian Zha , Qi Zhou