English
Related papers

Related papers: Exploiting Hankel-Toeplitz Structures for Fast Com…

200 papers

Gaussian processes (GPs) are widely used as surrogate models for complicated functions in scientific and engineering applications. In many cases, prior knowledge about the function to be approximated, such as monotonicity, is available and…

Machine Learning · Statistics 2025-07-10 Chao Zhang , Jasper M. Everink , Jakob Sauer Jørgensen

Gaussian stochastic process (GaSP) has been widely used as a prior over functions due to its flexibility and tractability in modeling. However, the computational cost in evaluating the likelihood is $O(n^3)$, where $n$ is the number of…

Methodology · Statistics 2025-02-13 Mengyang Gu , Yanxun Xu

Given a stable SISO LTI system $G$, we investigate the problem of estimating the $\mathcal{H}_\infty$-norm of $G$, denoted $||G||_\infty$, when $G$ is only accessible via noisy observations. Wahlberg et al. recently proposed a nonparametric…

Optimization and Control · Mathematics 2017-10-02 Stephen Tu , Ross Boczar , Benjamin Recht

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model…

Machine Learning · Statistics 2019-07-15 Gonzalo Rios , Felipe Tobar

We provide in this work an algorithm for approximating a very broad class of symmetric Toeplitz matrices to machine precision in $\mathcal{O}(n \log n)$ time with applications to fitting time series models. In particular, for a symmetric…

Numerical Analysis · Mathematics 2024-11-22 Christopher J. Geoga

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

Solving and visualizing the potential roots of complex functions is essential in both theoretical and applied domains, yet often computationally intensive. We present a hardware-accelerated algorithm for complex function roots density graph…

Mathematical Software · Computer Science 2025-12-04 Ruibai Tang , Chengbin Quan

We present an approach to construct appropriate and efficient emulators for Hamiltonian flow maps. Intended future applications are long-term tracing of fast charged particles in accelerators and magnetic plasma confinement configurations.…

Computational Physics · Physics 2021-06-02 Katharina Rath , Christopher G. Albert , Bernd Bischl , Udo von Toussaint

We propose a flexible procedure for large-scale image search by hash functions with kernels. Our method treats binary codes and pairwise semantic similarity as latent and observed variables, respectively, in a probabilistic model based on…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Bahadir Ozdemir , Larry S. Davis

Gaussian processes (GPs) are nonparametric priors over functions. Fitting a GP implies computing a posterior distribution of functions consistent with the observed data. Similarly, deep Gaussian processes (DGPs) should allow us to compute a…

Variational approximations to Gaussian processes (GPs) typically use a small set of inducing points to form a low-rank approximation to the covariance matrix. In this work, we instead exploit a sparse approximation of the precision matrix.…

Machine Learning · Computer Science 2024-11-22 Luhuan Wu , Geoff Pleiss , John Cunningham

Excellent variational approximations to Gaussian process posteriors have been developed which avoid the $\mathcal{O}\left(N^3\right)$ scaling with dataset size $N$. They reduce the computational cost to $\mathcal{O}\left(NM^2\right)$, with…

Machine Learning · Statistics 2019-09-05 David R. Burt , Carl E. Rasmussen , Mark van der Wilk

We present a fast algorithm that constructs a data-sparse approximation of matrices arising in the context of integral equation methods for elliptic partial differential equations. The new algorithm uses Green's representation formula in…

Numerical Analysis · Mathematics 2015-10-27 Steffen Börm , Sven Christophersen

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

Machine Learning · Statistics 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

Strong gravitational lensing is a powerful probe of cosmology and the dark matter distribution. Efficient lensing software is already a necessity to fully use its potential and the performance demands will only increase with the upcoming…

Instrumentation and Methods for Astrophysics · Physics 2019-02-12 Markus Rexroth , Christoph Schäfer , Gilles Fourestey , Jean-Paul Kneib

We introduce a new scalable variational Gaussian process approximation which provides a high fidelity approximation while retaining general applicability. We propose the harmonic kernel decomposition (HKD), which uses Fourier series to…

Machine Learning · Computer Science 2021-06-14 Shengyang Sun , Jiaxin Shi , Andrew Gordon Wilson , Roger Grosse

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Variational Gaussian process (GP) approximations have become a standard tool in fast GP inference. This technique requires a user to select variational features to increase efficiency. So far the common choices in the literature are…

Machine Learning · Statistics 2021-10-26 Veit Wild , George Wynne

The large-scale three-dimensional inversion of surface gravity / tensor gravity data is a very challenging numerical and practical problem, which is a highly physical memory usage, time-consuming computation and high precision for…

Geophysics · Physics 2020-05-21 Shu-jin Cao