English
Related papers

Related papers: Solving High-Dimensional PDEs with Latent Spectral…

200 papers

We introduce a physics-driven deep latent variable model (PDDLVM) to learn simultaneously parameter-to-solution (forward) and solution-to-parameter (inverse) maps of parametric partial differential equations (PDEs). Our formulation…

Machine Learning · Statistics 2023-08-09 Arnaud Vadeboncoeur , Ömer Deniz Akyildiz , Ieva Kazlauskaite , Mark Girolami , Fehmi Cirak

Diffusion models (DMs) are one of the most widely used generative models for producing high quality images. However, a flurry of recent papers points out that DMs are least private forms of image generators, by extracting a significant…

Machine Learning · Statistics 2025-03-06 Michael F. Liu , Saiyue Lyu , Margarita Vinaroz , Mijung Park

Numerical simulation of non-linear partial differential equations plays a crucial role in modeling physical science and engineering phenomena, such as weather, climate, and aerodynamics. Recent Machine Learning (ML) models trained on…

Machine Learning · Computer Science 2023-02-17 Zhiqing Sun , Yiming Yang , Shinjae Yoo

In this paper, we consider the problem of learning prediction models for spatiotemporal physical processes driven by unknown partial differential equations (PDEs). We propose a deep learning framework that learns the underlying dynamics and…

Machine Learning · Statistics 2021-05-04 Priyabrata Saha , Saibal Mukhopadhyay

We present Mechanistic PDE Networks -- a model for discovery of governing partial differential equations from data. Mechanistic PDE Networks represent spatiotemporal data as space-time dependent linear partial differential equations in…

Machine Learning · Computer Science 2025-06-12 Adeel Pervez , Efstratios Gavves , Francesco Locatello

Deriving governing equations in Electromagnetic (EM) environment based on first principles can be quite tough when there are some unknown sources of noise and other uncertainties in the system. For nonlinear multiple-physics electromagnetic…

Computational Physics · Physics 2019-10-31 Bing Xiong , Haiyang Fu , Feng Xu , Yaqiu Jin

We develop interacting particle algorithms for learning latent variable models with energy-based priors. To do so, we leverage recent developments in particle-based methods for solving maximum marginal likelihood estimation (MMLE) problems.…

Machine Learning · Statistics 2025-10-15 Joanna Marks , Tim Y. J. Wang , O. Deniz Akyildiz

Partial differential equations (PDEs) are among the most universal and parsimonious descriptions of natural physical laws, capturing a rich variety of phenomenology and multi-scale physics in a compact and symbolic representation. This…

Machine Learning · Computer Science 2023-03-31 Steven L. Brunton , J. Nathan Kutz

We use elliptic partial differential equations (PDEs) as examples to show various properties and behaviors when shallow neural networks (SNNs) are used to represent the solutions. In particular, we study the numerical ill-conditioning,…

Numerical Analysis · Mathematics 2025-11-04 Roy Y. He , Ying Liang , Hongkai Zhao , Yimin Zhong

Solving high-frequency oscillatory partial differential equations (PDEs) is a critical challenge in scientific computing, with applications in fluid mechanics, quantum mechanics, and electromagnetic wave propagation. Traditional…

Machine Learning · Computer Science 2025-08-04 Xiong Xiong , Zhuo Zhang , Rongchun Hu , Chen Gao , Zichen Deng

In recent years, the researches about solving partial differential equations (PDEs) based on artificial neural network have attracted considerable attention. In these researches, the neural network models are usually designed depend on…

Neural and Evolutionary Computing · Computer Science 2024-05-21 Bo Zhang , Chao Yang

We present a new solver for coupled nonlinear elliptic partial differential equations (PDEs). The solver is based on pseudo-spectral collocation with domain decomposition and can handle one- to three-dimensional problems. It has three…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Harald P. Pfeiffer , Lawrence E. Kidder , Mark A. Scheel , Saul A. Teukolsky

Deep learning-based methods have shown remarkable effectiveness in solving PDEs, largely due to their ability to enable fast simulations once trained. However, despite the availability of high-performance computing infrastructure, many…

Machine Learning · Computer Science 2026-02-23 Pietro Sittoni , Emanuele Zangrando , Angelo A. Casulli , Nicola Guglielmi , Francesco Tudisco

Pretraining methods gain increasing attraction recently for solving PDEs with neural operators. It alleviates the data scarcity problem encountered by neural operator learning when solving single PDE via training on large-scale datasets…

Machine Learning · Computer Science 2024-11-28 Tian Wang , Chuang Wang

Uncertainty quantification appears today as a crucial point in numerous branches of science and engineering. In the past two decades, a growing interest has been devoted to stochastic finite element method (SFEM) for the propagation of…

Numerical Analysis · Mathematics 2020-08-11 Zhibao Zheng

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

We introduce a novel grid-independent model for learning partial differential equations (PDEs) from noisy and partial observations on irregular spatiotemporal grids. We propose a space-time continuous latent neural PDE model with an…

Machine Learning · Computer Science 2023-10-27 Valerii Iakovlev , Markus Heinonen , Harri Lähdesmäki

Neural operators, as a powerful approximation to the non-linear operators between infinite-dimensional function spaces, have proved to be promising in accelerating the solution of partial differential equations (PDE). However, it requires a…

Machine Learning · Computer Science 2024-05-08 Xinquan Huang , Wenlei Shi , Xiaotian Gao , Xinran Wei , Jia Zhang , Jiang Bian , Mao Yang , Tie-Yan Liu

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

Partial Differential Equations (PDE) are fundamental to model different phenomena in science and engineering mathematically. Solving them is a crucial step towards a precise knowledge of the behaviour of natural and engineered systems. In…