English
Related papers

Related papers: Scalable Model-Based Gaussian Process Clustering

200 papers

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

Machine Learning · Computer Science 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

Computer models or simulators are widely used across scientific fields, but are computationally expensive limiting their use to explore possible scenarios/outcomes. Gaussian process emulators are statistical surrogates that can rapidly…

Computation · Statistics 2025-08-27 Josh Seidman , Elaine T. Spiller

The Expectation-Maximization (EM) algorithm is a commonly used method for finding the maximum likelihood estimates of the parameters in a mixture model via coordinate ascent. A serious pitfall with the algorithm is that in the case of…

Computation · Statistics 2018-08-31 Adrian O'Hagan , Arthur White

Recent years have seen a huge development in spatial modelling and prediction methodology, driven by the increased availability of remote-sensing data and the reduced cost of distributed-processing technology. It is well known that…

Computation · Statistics 2020-02-18 Andrew Zammit-Mangion , Jonathan Rougier

We consider the problem of clustering with $K$-means and Gaussian mixture models with a constraint on the separation between the centers in the context of real-valued data. We first propose a dynamic programming approach to solving the…

Computation · Statistics 2023-01-24 He Jiang , Ery Arias-Castro

The importance-sampling Monte Carlo algorithm appears to be the universally optimal solution to the problem of sampling the state space of statistical mechanical systems according to the relative importance of configurations for the…

Statistical Mechanics · Physics 2010-06-22 Martin Weigel

We derive a single pass algorithm for computing the gradient and Fisher information of Vecchia's Gaussian process loglikelihood approximation, which provides a computationally efficient means for applying the Fisher scoring algorithm for…

Computation · Statistics 2019-05-22 Joseph Guinness

Gaussian mixture model is very useful in many practical problems. Nevertheless, it cannot be directly generalized to non Euclidean spaces. To overcome this problem we present a spherical Gaussian-based clustering approach for partitioning…

Machine Learning · Computer Science 2017-05-08 Marek Śmieja , Jacek Tabor

Clustering is one of the main tasks in exploratory data analysis and descriptive statistics where the main objective is partitioning observations in groups. Clustering has a broad range of application in varied domains like climate,…

Databases · Computer Science 2012-03-20 Saptarsi Goswami , Amlan Chakrabarti

Vecchia's approximate likelihood for Gaussian process parameters depends on how the observations are ordered, which can be viewed as a deficiency because the exact likelihood is permutation-invariant. This article takes the alternative…

Computation · Statistics 2018-02-20 Joseph Guinness

We consider the problem of inferring a latent function in a probabilistic model of data. When dependencies of the latent function are specified by a Gaussian process and the data likelihood is complex, efficient computation often involve…

Machine Learning · Statistics 2018-07-23 Martin Tegner , Benjamin Bloem-Reddy , Stephen Roberts

We consider the problem of Gaussian mixture clustering in the high-dimensional limit where the data consists of $m$ points in $n$ dimensions, $n,m \rightarrow \infty$ and $\alpha = m/n$ stays finite. Using exact but non-rigorous methods…

Machine Learning · Statistics 2017-03-24 Thibault Lesieur , Caterina De Bacco , Jess Banks , Florent Krzakala , Cris Moore , Lenka Zdeborová

Clustering has become an indispensable tool in the presence of increasingly large and complex data sets. Most clustering algorithms depend, either explicitly or implicitly, on the sampled density. However, estimated densities are fragile…

Chemical Physics · Physics 2023-08-21 Moritz Thürlemann , Sereina Riniker

Variable selection in cluster analysis is important yet challenging. It can be achieved by regularization methods, which realize a trade-off between the clustering accuracy and the number of selected variables by using a lasso-type penalty.…

Methodology · Statistics 2016-12-23 Marbac Matthieu , Sedki Mohammed

Gaussian processes (GPs) are flexible non-parametric models, with a capacity that grows with the available data. However, computational constraints with standard inference procedures have limited exact GPs to problems with fewer than about…

Real-world applications may be affected by outlying values. In the model-based clustering literature, several methodologies have been proposed to detect units that deviate from the majority of the data (rowwise outliers) and trim them from…

Recent work on overfitting Bayesian mixtures of distributions offers a powerful framework for clustering multivariate data using a latent Gaussian model which resembles the factor analysis model. The flexibility provided by overfitting…

Methodology · Statistics 2019-08-29 Panagiotis Papastamoulis

High-precision measurements require optimal setups and analysis tools to achieve continuous improvements. Systematic corrections need to be modeled with high accuracy and known uncertainty to reconstruct underlying physical phenomena. To…

Data Analysis, Statistics and Probability · Physics 2022-05-31 Max Lamparth , Mattis Bestehorn , Bastian Märkisch

Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction…

Machine Learning · Computer Science 2022-11-03 Killian Wood , Alec M. Dunton , Amanda Muyskens , Benjamin W. Priest

The problem of data clustering is one of the most important in data analysis. It can be problematic when dealing with experimental data characterized by measurement uncertainties and errors. Our paper proposes a recursive scheme for…

Machine Learning · Computer Science 2024-01-12 Alicja Miniak-Górecka , Krzysztof Podlaski , Tomasz Gwizdałła