English
Related papers

Related papers: Optimal change point detection in Gaussian process…

200 papers

Model change detection is studied, in which there are two sets of samples that are independently and identically distributed (i.i.d.) according to a pre-change probabilistic model with parameter $\theta$, and a post-change model with…

Machine Learning · Statistics 2018-11-21 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

Statistical models incorporating change points are common in practice, especially in the area of biomedicine. This approach is appealing in that a specific parameter is introduced to account for the abrupt change in the response variable…

Statistics Theory · Mathematics 2008-12-18 Hongling Zhou , Kung-Yee Liang

The Gaussian process (GP) regression can be severely biased when the data are contaminated by outliers. This paper presents a new robust GP regression algorithm that iteratively trims the most extreme data points. While the new algorithm…

Machine Learning · Computer Science 2021-06-15 Zhao-Zhou Li , Lu Li , Zhengyi Shao

In this paper we analyze the asymptotic properties of l1 penalized maximum likelihood estimation of signals with piece-wise constant mean values and/or variances. The focus is on segmentation of a non-stationary time series with respect to…

Statistics Theory · Mathematics 2014-01-22 Cristian R. Rojas , Bo Wahlberg

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

The correlation length-scale next to the noise variance are the most used hyperparameters for the Gaussian processes. Typically, stationary covariance functions are used, which are only dependent on the distances between input points and…

Machine Learning · Computer Science 2017-10-30 Kevin Cremanns , Dirk Roos

Parton distribution functions (PDFs) form an essential part of particle physics calculations. Currently, the most precise predictions for these non-perturbative functions are generated through fits to global data. A problem that several PDF…

High Energy Physics - Phenomenology · Physics 2025-09-04 Mengshi Yan , Tie-Jiun Hou , Zhao Li , Kirtimaan Mohan , C. -P. Yuan

With the significant advancement in quantum computation in the past couple of decades, the exploration of machine-learning subroutines using quantum strategies has become increasingly popular. Gaussian process regression is a widely used…

Quantum Physics · Physics 2018-03-07 Siddhartha Das , George Siopsis , Christian Weedbrook

In many machine learning applications, one wants to learn the unknown objective and constraint functions of an optimization problem from available data and then apply some technique to attain a local optimizer of the learned model. This…

Systems and Control · Electrical Eng. & Systems 2020-10-05 Harsh A. Shukla , Tafarel de Avila Ferreira , Timm Faulwasser , Dominique Bonvin , Colin N. Jones

We consider the problem of detecting a change in mean in a sequence of Gaussian vectors. Under the alternative hypothesis, the change occurs only in some subset of the components of the vector. We propose a test of the presence of a…

Statistics Theory · Mathematics 2014-02-28 Farida Enikeeva , Zaid Harchaoui

A number of problems in probability and statistics can be addressed using the multivariate normal (Gaussian) distribution. In the one-dimensional case, computing the probability for a given mean and variance simply requires the evaluation…

Numerical Analysis · Mathematics 2015-04-07 Sivaram Ambikasaran , Daniel Foreman-Mackey , Leslie Greengard , David W. Hogg , Michael O'Neil

Gaussian Process (GP) regression models typically assume that residuals are Gaussian and have the same variance for all observations. However, applications with input-dependent noise (heteroscedastic residuals) frequently arise in practice,…

Machine Learning · Statistics 2012-12-27 Chunyi Wang , Radford M. Neal

This paper presents a new variable selection approach integrated with Gaussian process (GP) regression. We consider a sparse projection of input variables and a general stationary covariance model that depends on the Euclidean distance…

Machine Learning · Computer Science 2020-08-26 Chiwoo Park , David J. Borth , Nicholas S. Wilson , Chad N. Hunter

In this work, we employ the Bayesian inference framework to solve the problem of estimating the solution and particularly, its derivatives, which satisfy a known differential equation, from the given noisy and scarce observations of the…

Computation · Statistics 2020-10-09 Hongqiao Wang , Xiang Zhou

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Sequential change-point detection for graphs is a fundamental problem for streaming network data types and has wide applications in social networks and power systems. Given fixed vertices and a sequence of random graphs, the objective is to…

Statistics Theory · Mathematics 2021-02-12 Liyan Xie , Yao Xie

Since the work of Page in the 1950s, the problem of detecting an abrupt change in the distribution of stochastic processes has received a great deal of attention. In particular, a deep connection has been established between Lorden's…

Probability · Mathematics 2017-06-23 José E. Figueroa-López , Sveinn Ólafsson

An important assumption in the work on testing for structural breaks in time series consists in the fact that the model is formulated such that the stochastic process under the null hypothesis of "no change-point" is stationary. This…

Methodology · Statistics 2015-03-31 Holger Dette , Weichi Wu , Zhou Zhou

This paper proposes a safe data-driven control framework for nonlinear systems with partially known dynamics. The method ensures stability and constraint satisfaction during online learning, assuming only a stabilizable linear approximation…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Stefano Tonini , Soroush Rastegarpour , Hamid Reza Feyzmahdavian , Nicola Bastianello , Karl Henrik Johansson