English
Related papers

Related papers: Solving Functional PDEs with Gaussian Processes an…

200 papers

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

Methodology · Statistics 2020-12-22 Matthias Katzfuss , Wenlong Gong

Gaussian processes appear as building blocks in various stochastic models and have been found instrumental to account for imprecisely known, latent functions. It is often the case that such functions may be directly or indirectly evaluated,…

Statistics Theory · Mathematics 2022-07-28 Cédric Travelletti , David Ginsbourger

Differential equations are important mechanistic models that are integral to many scientific and engineering applications. With the abundance of available data there has been a growing interest in data-driven physics-informed models.…

Machine Learning · Computer Science 2025-02-04 Oliver Hamelijnck , Arno Solin , Theodoros Damoulas

Gaussian processes (GPs) are nonparametric priors over functions. Fitting a GP implies computing a posterior distribution of functions consistent with the observed data. Similarly, deep Gaussian processes (DGPs) should allow us to compute a…

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs. Our key idea is to leverage the prior of ``translational similarity'' of numerical PDE differential…

Machine Learning · Computer Science 2023-03-14 Ziqian Wu , Xingzhe He , Yijun Li , Cheng Yang , Rui Liu , Shiying Xiong , Bo Zhu

Gaussian processes (GPs) based methods for solving partial differential equations (PDEs) demonstrate great promise by bridging the gap between the theoretical rigor of traditional numerical algorithms and the flexible design of machine…

Numerical Analysis · Mathematics 2024-02-02 Xianjin Yang , Houman Owhadi

Learning underlying dynamics from data is important and challenging in many real-world scenarios. Incorporating differential equations (DEs) to design continuous networks has drawn much attention recently, however, most prior works make…

Machine Learning · Computer Science 2023-02-03 Yesom Park , Jaemoo Choi , Changyeon Yoon , Chang hoon Song , Myungjoo Kang

Solving partial differential equations (PDEs) is a required step in the simulation of natural and engineering systems. The associated computational costs significantly increase when exploring various scenarios, such as changes in initial or…

In this work, we employ the Bayesian inference framework to solve the problem of estimating the solution and particularly, its derivatives, which satisfy a known differential equation, from the given noisy and scarce observations of the…

Computation · Statistics 2020-10-09 Hongqiao Wang , Xiang Zhou

In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered…

Numerical Analysis · Mathematics 2024-03-12 Yifan Chen , Houman Owhadi , Florian Schäfer

Fast and accurate solutions of time-dependent partial differential equations (PDEs) are of pivotal interest to many research fields, including physics, engineering, and biology. Generally, implicit/semi-implicit schemes are preferred over…

Foundation models, such as large language models, have demonstrated success in addressing various language and image processing tasks. In this work, we introduce a multi-modal foundation model for scientific problems, named PROSE-PDE. Our…

Machine Learning · Computer Science 2025-02-04 Jingmin Sun , Yuxuan Liu , Zecheng Zhang , Hayden Schaeffer

Modeling the dynamics of flexible objects has become an emerging topic in the community as these objects become more present in many applications, e.g., soft robotics. Due to the properties of flexible materials, the movements of soft…

Machine Learning · Computer Science 2024-06-18 Kaiyuan Tan , Peilun Li , Thomas Beckers

Inverse problems involving partial differential equations (PDEs) can be seen as discovering a mapping from measurement data to unknown quantities, often framed within an operator learning approach. However, existing methods typically rely…

Numerical Analysis · Mathematics 2025-02-10 Sung Woong Cho , Hwijae Son

We formulate meta learning using information theoretic concepts; namely, mutual information and the information bottleneck. The idea is to learn a stochastic representation or encoding of the task description, given by a training set, that…

Machine Learning · Computer Science 2021-07-06 Michalis K. Titsias , Francisco J. R. Ruiz , Sotirios Nikoloutsopoulos , Alexandre Galashov

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

The joint problem of reconstruction / feature extraction is a challenging task in image processing. It consists in performing, in a joint manner, the restoration of an image and the extraction of its features. In this work, we firstly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Gabriele Scrivanti

We introduce a scalable Gaussian process (GP) framework with deep product kernels for data-driven learning of parametrized spatio-temporal fields over fixed or parameter-dependent domains. The proposed framework learns a continuous…

Machine Learning · Computer Science 2026-03-03 Srinath Dama , Prasanth B. Nair

We introduce a method that combines neural operators, physics-informed machine learning, and standard numerical methods for solving PDEs. The proposed approach extends each of the aforementioned methods and unifies them within a single…

Computational Engineering, Finance, and Science · Computer Science 2025-12-02 Shahed Rezaei , Reza Najian Asl , Kianoosh Taghikhani , Ahmad Moeineddin , Michael Kaliske , Markus Apel

Machine learning based partial differential equations (PDEs) solvers have received great attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and…

Numerical Analysis · Mathematics 2025-09-23 Chunyang Liao