English
Related papers

Related papers: Optimal change point detection in Gaussian process…

200 papers

Gaussian processes (GPs) have been proven to be powerful tools in various areas of machine learning. However, there are very few applications of GPs in the scenario of multi-view learning. In this paper, we present a new GP model for…

Machine Learning · Statistics 2017-01-18 Qiuyang Liu , Shiliang Sun

Learning of low dimensional structure in multidimensional data is a canonical problem in machine learning. One common approach is to suppose that the observed data are close to a lower-dimensional smooth manifold. There are a rich variety…

Machine Learning · Statistics 2015-06-12 Ye Wang , David B. Dunson

Reliable spatial uncertainty evaluation of object detection models is of special interest and has been subject of recent work. In this work, we review the existing definitions for uncertainty calibration of probabilistic regression tasks.…

Machine Learning · Computer Science 2022-08-22 Fabian Küppers , Jonas Schneider , Anselm Haselhoff

We study the detection of a change in the covariance matrix of $n$ independent sub-Gaussian random variables of dimension $p$. Our first contribution is to show that $\log\log(8n)$ is the exact minimax testing rate for a change in variance…

Statistics Theory · Mathematics 2025-02-11 Per August Jarval Moen

In recent literature, the Gaussian Graphical model (GGM; Lauritzen, 1996),a network of partial correlation coefficients, has been used to capture potential dynamic relationships between observed variables. The GGM can be estimated using…

Methodology · Statistics 2017-09-25 Sacha Epskamp

In the classic measurement error framework, covariates are contaminated by independent additive noise. This paper considers parameter estimation in such a linear errors-in-variables model where the unknown measurement error distribution is…

Methodology · Statistics 2023-10-24 Linh H. Nghiem , Cornelis J. Potgieter

Gaussian process ($GP$) regression is a widely used non-parametric modeling tool, but its cubic complexity in the training size limits its use on massive data sets. A practical remedy is to predict using only the nearest neighbours of each…

Machine Learning · Statistics 2026-04-09 Robert Allison , Tomasz Maciazek , Anthony Stephenson

We study estimation in the low signal-to-noise ratio (SNR) regime for a broad class of Gaussian latent-variable models, including Gaussian mixtures and orbit recovery problems. We show that, in this regime, the generalized method-of-moments…

Statistics Theory · Mathematics 2026-05-29 Amnon Balanov , Tamir Bendory , Dan Edidin

Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction…

Machine Learning · Computer Science 2022-11-03 Killian Wood , Alec M. Dunton , Amanda Muyskens , Benjamin W. Priest

We introduce a novel Bayesian method that can detect multiple structural breaks in the mean and variance of a length $T$ time-series. Our method quantifies uncertainty by returning $\alpha$-level credible sets around the estimated locations…

Methodology · Statistics 2025-07-14 Davis Berlind , Lorenzo Cappello , Oscar Hernan Madrid Padilla

In this paper, the Gaussian quasi likelihood ratio test (GQLRT) for non-Bayesian binary hypothesis testing is generalized by applying a transform to the probability distribution of the data. The proposed generalization, called…

Methodology · Statistics 2017-11-22 Nir Halay , Koby Todros , Alfred O. Hero

We consider the sequential change-point detection problem of detecting changes that are characterized by a subspace structure. Such changes are frequent in high-dimensional streaming data altering the form of the corresponding covariance…

Statistics Theory · Mathematics 2018-06-29 Liyan Xie , George V. Moustakides , Yao Xie

Gaussian processes (GPs) are non-parametric probabilistic regression models that are popular due to their flexibility, data efficiency, and well-calibrated uncertainty estimates. However, standard GP models assume homoskedastic Gaussian…

Machine Learning · Computer Science 2025-01-08 Sebastian Ament , Elizabeth Santorella , David Eriksson , Ben Letham , Maximilian Balandat , Eytan Bakshy

A weakly dependent time series regression model with multivariate covariates and univariate observations is considered, for which we develop a procedure to detect whether the nonparametric conditional mean function is stable in time against…

Statistics Theory · Mathematics 2019-01-25 Maria Mohr , Natalie Neumeyer

Gaussian Processes (GPs) are a generic modelling tool for supervised learning. While they have been successfully applied on large datasets, their use in safety-critical applications is hindered by the lack of good performance guarantees. To…

Machine Learning · Statistics 2019-08-27 David Reeb , Andreas Doerr , Sebastian Gerwinn , Barbara Rakitsch

Hyper-parameter optimization remains as the core issue of Gaussian process (GP) for machine learning nowadays. The benchmark method using maximum likelihood (ML) estimation and gradient descent (GD) is impractical for processing big data…

Machine Learning · Statistics 2019-06-10 Linning Xu , Feng Yin , Jiawei Zhang , Zhi-Quan Luo , Shuguang Cui

We study a plug in least squares estimator for the change point parameter where change is in the mean of a high dimensional random vector under subgaussian or subexponential distributions. We obtain sufficient conditions under which this…

Inspired by graph-based methodologies, we introduce a novel graph-spanning algorithm designed to identify changes in both offline and online data across low to high dimensions. This versatile approach is applicable to Euclidean and…

Machine Learning · Statistics 2026-01-09 Yang-Wen Sun , Katerina Papagiannouli , Vladimir Spokoiny

Online change detection involves monitoring a stream of data for changes in the statistical properties of incoming observations. A good change detector will detect any changes shortly after they occur, while raising few false alarms.…

Statistics Theory · Mathematics 2020-03-03 Thomas Flynn , Shinjae Yoo

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

Machine Learning · Computer Science 2023-05-03 Cheng Chang , Tieyong Zeng