English
Related papers

Related papers: Fast spatial Gaussian process maximum likelihood e…

200 papers

Decision making under uncertainty is at the heart of any autonomous system acting with imperfect information. The cost of solving the decision making problem is exponential in the action and observation spaces, thus rendering it unfeasible…

Artificial Intelligence · Computer Science 2024-06-18 Tom Yotam , Vadim Indelman

We present a new paradigm for speeding up randomized computations of several frequently used functions in machine learning. In particular, our paradigm can be applied for improving computations of kernels based on random embeddings. Above…

Machine Learning · Statistics 2016-04-26 Krzysztof Choromanski , Francois Fagan

Bayesian optimization is an effective technique for black-box optimization, but its applicability is typically limited to low-dimensional and small-budget problems due to the cubic complexity of computing the Gaussian process (GP)…

Machine Learning · Computer Science 2025-12-18 Yunyue Wei , Vincent Zhuang , Saraswati Soedarmadji , Yanan Sui

Filtering and parameter estimation under partial information for multiscale problems is studied in this paper. After proving mean square convergence of the nonlinear filter to a filter of reduced dimension, we establish that the conditional…

Probability · Mathematics 2014-09-09 Andrew Papanicolaou , Konstantinos Spiliopoulos

We introduce a fast algorithm for Gaussian process regression in low dimensions, applicable to a widely-used family of non-stationary kernels. The non-stationarity of these kernels is induced by arbitrary spatially-varying vertical and…

Numerical Analysis · Mathematics 2025-03-28 P. Michael Kielstra , Michael Lindsey

In many statistical problems, the data distribution is specified through a generative process for which the likelihood function is analytically intractable, yet inference on the associated model parameters remains of primary interest. We…

Methodology · Statistics 2026-04-01 Haoyu Jiang , Yuexi Wang , Yun Yang

Stochastic Differential Equations (SDEs) are used as statistical models in many disciplines. However, intractable likelihood functions for SDEs make inference challenging, and we need to resort to simulation-based techniques to estimate and…

Methodology · Statistics 2014-08-12 Grant Schneider , Peter F. Craigmile , Radu Herbei

Deep learning algorithms have recently shown to be a successful tool in estimating parameters of statistical models for which simulation is easy, but likelihood computation is challenging. But the success of these approaches depends on…

Machine Learning · Statistics 2024-02-20 Amanda Lenzi , Haavard Rue

Nonstationary Gaussian process models can capture complex spatially varying dependence structures in spatial datasets. However, the large number of observations in modern datasets makes fitting such models computationally intractable with…

Computation · Statistics 2022-06-13 Paul G. Beckman , Christopher J. Geoga , Michael L. Stein , Mihai Anitescu

We propose an efficient way to sample from a class of structured multivariate Gaussian distributions which routinely arise as conditional posteriors of model parameters that are assigned a conditionally Gaussian prior. The proposed…

Computation · Statistics 2016-06-28 Anirban Bhattacharya , Antik Chakraborty , Bani K. Mallick

Extreme environmental events frequently exhibit spatial and temporal dependence. These data are often modeled using max stable processes (MSPs). MSPs are computationally prohibitive to fit for as few as a dozen observations, with supposed…

Methodology · Statistics 2022-05-02 Emily C. Hector , Brian J. Reich

In this paper, we consider the sigmoid Gaussian Hawkes process model: the baseline intensity and triggering kernel of Hawkes process are both modeled as the sigmoid transformation of random trajectories drawn from Gaussian processes (GP).…

Machine Learning · Computer Science 2019-10-30 Feng Zhou , Zhidong Li , Xuhui Fan , Yang Wang , Arcot Sowmya , Fang Chen

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

We present a novel approach to Bayesian inference and general Bayesian computation that is defined through a sequential decision loop. Our method defines a recursive partitioning of the sample space. It neither relies on gradients nor…

Machine Learning · Statistics 2021-06-10 Erik Bodin , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

Gaussian process (GP) based Bayesian optimization (BO) is a powerful method for optimizing black-box functions efficiently. The practical performance and theoretical guarantees of this approach depend on having the correct GP hyperparameter…

Machine Learning · Statistics 2024-06-07 Huong Ha , Vu Nguyen , Hung Tran-The , Hongyu Zhang , Xiuzhen Zhang , Anton van den Hengel

Sparse structure learning in high-dimensional Gaussian graphical models is an important problem in multivariate statistical signal processing; since the sparsity pattern naturally encodes the conditional independence relationship among…

Methodology · Statistics 2023-09-26 Ksheera Sagar , Jyotishka Datta , Sayantan Banerjee , Anindya Bhadra

We propose a Gaussian variational inference framework for the motion planning problem. In this framework, motion planning is formulated as an optimization over the distribution of the trajectories to approximate the desired trajectory…

Robotics · Computer Science 2023-03-27 Hongzhe Yu , Yongxin Chen

We present a method to transform multivariate unimodal non-Gaussian posterior probability densities into approximately Gaussian ones via non-linear mappings, such as Box--Cox transformations and generalisations thereof. This permits an…

Cosmology and Nongalactic Astrophysics · Physics 2016-06-14 Robert L. Schuhmann , Benjamin Joachimi , Hiranya V. Peiris

Gaussian Process (GP) models are popular statistical surrogates used for emulating computationally expensive computer simulators. The quality of a GP model fit can be assessed by a goodness of fit measure based on optimized likelihood.…

Computation · Statistics 2013-09-27 Andrew Butler , Thomas D. Humphries , Pritam Ranjan , Ronald D. Haynes

Gaussian process is an indispensable tool in clustering functional data, owing to it's flexibility and inherent uncertainty quantification. However, when the functional data is observed over a large grid (say, of length $p$), Gaussian…

Computation · Statistics 2023-09-15 Anirban Chakraborty , Abhisek Chakraborty