English
Related papers

Related papers: Tensor Gaussian Processes: Efficient Solvers for N…

200 papers

Partial differential equations (PDEs) are widely used across the physical and computational sciences. Decades of research and engineering went into designing fast iterative solution methods. Existing solvers are general purpose, but may be…

Numerical Analysis · Mathematics 2024-09-23 Jun-Ting Hsieh , Shengjia Zhao , Stephan Eismann , Lucia Mirabella , Stefano Ermon

Machine learning based solvers have garnered much attention in physical simulation and scientific computing, with a prominent example, physics-informed neural networks (PINNs). However, PINNs often struggle to solve high-frequency and…

Machine Learning · Computer Science 2024-03-20 Shikai Fang , Madison Cooley , Da Long , Shibo Li , Robert Kirby , Shandian Zhe

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered…

Numerical Analysis · Mathematics 2024-03-12 Yifan Chen , Houman Owhadi , Florian Schäfer

Numerically solving partial differential equations (PDEs) can be challenging and computationally expensive. This has led to the development of reduced-order models (ROMs) that are accurate but faster than full order models (FOMs). Recently,…

Computational Engineering, Finance, and Science · Computer Science 2024-05-30 Christophe Bonneville , Youngsoo Choi , Debojyoti Ghosh , Jonathan L. Belof

Gaussian processes (GPs) are versatile tools that have been successfully employed to solve nonlinear estimation problems in machine learning, but that are rarely used in signal processing. In this tutorial, we present GPs for regression as…

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

High-dimensional partial differential equations (PDEs) are ubiquitous in economics, science and engineering. However, their numerical treatment poses formidable challenges since traditional grid-based methods tend to be frustrated by the…

Machine Learning · Statistics 2021-07-20 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

In this manuscript, we introduce the tensor-train reduced basis method, a novel projection-based reduced-order model designed for the efficient solution of parameterized partial differential equations. While reduced-order models are widely…

Numerical Analysis · Mathematics 2025-05-06 Nicholas Mueller , Yiran Zhao , Santiago Badia , Tiangang Cui

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

Machine Learning · Statistics 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

We introduce a new class of spatially stochastic physics and data informed deep latent models for parametric partial differential equations (PDEs) which operate through scalable variational neural processes. We achieve this by assigning…

Machine Learning · Computer Science 2023-06-08 Arnaud Vadeboncoeur , Ieva Kazlauskaite , Yanni Papandreou , Fehmi Cirak , Mark Girolami , Ömer Deniz Akyildiz

Scientific problems require resolving multi-scale phenomena across different resolutions and learning solution operators in infinite-dimensional function spaces. Neural operators provide a powerful framework for this, using…

Parametric partial differential equations (PDEs) serve as fundamental mathematical tools for modeling complex physical phenomena, yet repeated high-fidelity numerical simulations across parameter spaces remain computationally prohibitive.…

Machine Learning · Statistics 2026-04-08 Pucheng Tang , Hongqiao Wang , Wenzhou Lin , Qian Chen , Heng Yong

Solving parametric partial differential equations (PDEs) presents significant challenges for data-driven methods due to the sensitivity of spatio-temporal dynamics to variations in PDE parameters. Machine learning approaches often struggle…

Machine Learning · Computer Science 2024-11-11 Armand Kassaï Koupaï , Jorge Mifsut Benet , Yuan Yin , Jean-Noël Vittaut , Patrick Gallinari

The numerical approximation of partial differential equations (PDEs) poses formidable challenges in high dimensions since classical grid-based methods suffer from the so-called curse of dimensionality. Recent attempts rely on a combination…

Machine Learning · Computer Science 2023-07-31 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

Partial differential equations (PDEs) are widely used for the description of physical and engineering phenomena. Some key parameters involved in PDEs, which represent certain physical properties with important scientific interpretations,…

Numerical Analysis · Mathematics 2024-02-02 Zhaohui Li , Shihao Yang , Jeff Wu

We introduce a novel kernel learning framework toward efficiently solving nonlinear partial differential equations (PDEs). In contrast to the state-of-the-art kernel solver that embeds differential operators within kernels, posing…

Machine Learning · Computer Science 2025-06-09 Zhitong Xu , Da Long , Yiming Xu , Guang Yang , Shandian Zhe , Houman Owhadi

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…