English
Related papers

Related papers: Conditional Gaussian Nonlinear System: a Fast Prec…

200 papers

This article presents a rigorous analysis for efficient statistically accurate algorithms for solving the Fokker-Planck equations associated with high-dimensional nonlinear turbulent dynamical systems with conditional Gaussian structures.…

Statistics Theory · Mathematics 2017-09-19 Nan Chen , Andrew J. Majda , Xin T. Tong

Gaussian process (GP) surrogates are the default tool for emulating expensive computer experiments, but cubic cost, stationarity assumptions, and Gaussian predictive distributions limit their reach. We propose Generative Bayesian…

Machine Learning · Computer Science 2026-02-26 Nick Polson , Vadim Sokolov

We explore a scaled spectral preconditioner for the efficient solution of sequences of symmetric and positive-definite linear systems. We design the scaled preconditioner not only as an approximation of the inverse of the linear system but…

Numerical Analysis · Mathematics 2024-10-04 Youssef Diouane , Selime Gürol , Oussama Mouhtal , Dominique Orban

Modern design, control, and optimization often requires simulation of highly nonlinear models, leading to prohibitive computational costs. These costs can be amortized by evaluating a cheap surrogate of the full model. Here we present a…

Machine Learning · Computer Science 2021-03-25 Ranjan Anantharaman , Yingbo Ma , Shashi Gowda , Chris Laughman , Viral Shah , Alan Edelman , Chris Rackauckas

Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide…

This paper presents a method for building a preconditioner for a kernel ridge regression problem, where the preconditioner is not only effective in its ability to reduce the condition number substantially, but also efficient in its…

Numerical Analysis · Mathematics 2021-04-07 Gil Shabat , Era Choshen , Dvir Ben Or , Nadav Carmel

Non linear regression models are a standard tool for modeling real phenomena, with several applications in machine learning, ecology, econometry... Estimating the parameters of the model has garnered a lot of attention during many years. We…

Statistics Theory · Mathematics 2020-09-17 Peggy Cénac , Antoine Godichon-Baggioni , Bruno Portier

With the significant advancement in quantum computation in the past couple of decades, the exploration of machine-learning subroutines using quantum strategies has become increasingly popular. Gaussian process regression is a widely used…

Quantum Physics · Physics 2018-03-07 Siddhartha Das , George Siopsis , Christian Weedbrook

The Gaussian process state space model (GPSSM) is a non-linear dynamical system, where unknown transition and/or measurement mappings are described by GPs. Most research in GPSSMs has focussed on the state estimation problem, i.e.,…

Machine Learning · Statistics 2017-11-08 Stefanos Eleftheriadis , Thomas F. W. Nicholson , Marc Peter Deisenroth , James Hensman

Nonlinear interference is modeled by a time-varying conditionally Gaussian channel. It is shown that approximating this channel with a time-invariant channel imposes considerable loss in the performance of channel decoding. An adaptive…

Information Theory · Computer Science 2021-02-02 Reza Rafie Borujeny , Frank R. Kschischang

Current tests for nonlinearity compare a time series to the null hypothesis of a Gaussian linear stochastic process. For this restricted null assumption, random surrogates can be constructed which are constrained by the linear properties of…

chao-dyn · Physics 2009-10-31 Thomas Schreiber , Andreas Schmitz

This paper introduces a surrogate modeling scheme based on Grassmannian manifold learning to be used for cost-efficient predictions of high-dimensional stochastic systems. The method exploits subspace-structured features of each solution by…

Numerical Analysis · Mathematics 2020-08-26 Dimitris G. Giovanis , Michael D. Shields

Lagrangian data assimilation aims to recover hidden Eulerian flow fields from sparse, indirect observations of moving tracers. This problem is challenging because tracer trajectories are nonlinearly coupled with the underlying flow, making…

Computational Engineering, Finance, and Science · Computer Science 2026-03-17 Zhongrui Wang , Chuanqi Chen , Jin-Long Wu , Nan Chen

The Gauss-Newton (GN) matrix plays an important role in machine learning, most evident in its use as a preconditioning matrix for a wide family of popular adaptive methods to speed up optimization. Besides, it can also provide key insights…

Machine Learning · Computer Science 2025-02-28 Jim Zhao , Sidak Pal Singh , Aurelien Lucchi

Subsurface simulations use computational models to predict the flow of fluids (e.g., oil, water, gas) through porous media. These simulations are pivotal in industrial applications such as petroleum production, where fast and accurate…

Machine Learning · Computer Science 2022-06-16 Tailin Wu , Qinchen Wang , Yinan Zhang , Rex Ying , Kaidi Cao , Rok Sosič , Ridwan Jalali , Hassan Hamam , Marko Maucec , Jure Leskovec

In a task where many similar inverse problems must be solved, evaluating costly simulations is impractical. Therefore, replacing the model $y$ with a surrogate model $y_s$ that can be evaluated quickly leads to a significant speedup. The…

Numerical Analysis · Mathematics 2024-05-15 Phillip Semler , Martin Weiser

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Linear systems occur throughout engineering and the sciences, most notably as differential equations. In many cases the forcing function for the system is unknown, and interest lies in using noisy observations of the system to infer the…

Causal graphs (CGs) are compact representations of the knowledge of the data generating processes behind the data distributions. When a CG is available, e.g., from the domain knowledge, we can infer the conditional independence (CI)…

Machine Learning · Computer Science 2021-08-18 Takeshi Teshima , Masashi Sugiyama

Surrogate models have shown to be an extremely efficient aid in solving engineering problems that require repeated evaluations of an expensive computational model. They are built by sparsely evaluating the costly original model and have…

Machine Learning · Statistics 2022-12-01 M. Moustapha , B. Sudret