English
Related papers

Related papers: Pointwise uncertainty quantification for sparse va…

200 papers

Sparse variational approximations are popular methods for scaling up inference and learning in Gaussian processes to larger datasets. For $N$ training points, exact inference has $O(N^3)$ cost; with $M \ll N$ features, state of the art…

Machine Learning · Statistics 2024-04-15 Talay M Cheema , Carl Edward Rasmussen

The process $(G_t)_{t\in[0,T]}$ is referred to as a fractional Gaussian process if the first-order partial derivative of the difference between its covariance function and that of the fractional Brownian motion $(B^H_t)_{t\in[0,T ]}$ is a…

Probability · Mathematics 2023-09-20 Yong Chen , Ying Li

The paper considers the problem of estimating the parameters in a continuous time regression model with a non-Gaussian noise of pulse type. The noise is specified by the Ornstein-Uhlenbeck process driven by the mixture of a Brownian motion…

Statistics Theory · Mathematics 2019-09-17 Evgeny Pchelintsev

We introduce a new variational characterization of Gaussian diffusion processes as minimum uncertainty states. We then define a variational method constrained by kinematics of diffusions and Schr\"{o}dinger dynamics to seek states of local…

High Energy Physics - Theory · Physics 2016-09-06 F. Illuminati , L. Viola

Recently, a novel linear model predictive control algorithm based on a physics-informed Gaussian Process has been introduced, whose realizations strictly follow a system of underlying linear ordinary differential equations with constant…

Optimization and Control · Mathematics 2025-05-01 Adrian Lepp , Jörn Tebbe , Andreas Besginow

The paper deals with the asymptotic behavior of the bridge of a Gaussian process conditioned to stay in $n$ fixed points at $n$ fixed past instants. In particular, functional large deviation results are stated for small time. Several…

Probability · Mathematics 2016-04-06 L. Caramellino , B. Pacchiarotti

We present a multivariate Gaussian process regression approach for parameter field reconstruction based on the field's measurements collected at two different scales, the coarse and fine scales. The proposed approach treats the parameter…

Methodology · Statistics 2018-04-19 David A. Barajas-Solano , Alexandre M. Tartakovsky

This article studies the finite sample behaviour of a number of estimators for the integrated power volatility process of a Brownian semistationary process in the non semi-martingale setting. We establish three consistent feasible…

Statistics Theory · Mathematics 2021-06-18 Phillip Murray , Riccardo Passeggeri , Almut E. D. Veraart , Mikko S. Pakkanen

This paper gives a brief introduction to some important fractional and multifractional Gaussian processes commonly used in modelling natural phenomena and man-made systems. The processes include fractional Brownian motion (both standard and…

Mathematical Physics · Physics 2014-07-01 S. C. Lim , C. H. Eab

Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior,…

Machine Learning · Computer Science 2023-06-07 Paul E. Chang , Prakhar Verma , S. T. John , Arno Solin , Mohammad Emtiyaz Khan

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

Reduced-rank regression recognises the possibility of a rank-deficient matrix of coefficients. We propose a novel Bayesian model for estimating the rank of the coefficient matrix, which obviates the need for post-processing steps and allows…

Methodology · Statistics 2024-02-14 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

In this work we introduce correlated random walks on $\Z$. When picking suitably at random the coefficient of correlation, and taking the average over a large number of walks, we obtain a discrete Gaussian process, whose scaling limit is…

Probability · Mathematics 2007-05-23 Enriquez Nathanael

We propose a method for variable selection in the intensity function of spatial point processes that combines sparsity-promoting estimation with noise-robust model selection. As high-resolution spatial data becomes increasingly available…

Methodology · Statistics 2025-10-30 Dominik Sturm , Ivo F. Sbalzarini

We introduce a new Gaussian process, a generalization of both fractional and subfractional Brownian motions, which could serve as a good model for a larger class of natural phenomena. We study its main stochastic properties and some…

Probability · Mathematics 2017-04-10 Mounir Zili

For predictive modeling relying on Bayesian inversion, fully independent, or ``mean-field'', Gaussian distributions are often used as approximate probability density functions in variational inference since the number of variational…

Methodology · Statistics 2023-07-14 Wyatt Bridgman , Reese Jones , Mohammad Khalil

Gaussian processes scale prohibitively with the size of the dataset. In response, many approximation methods have been developed, which inevitably introduce approximation error. This additional source of uncertainty, due to limited…

Machine Learning · Computer Science 2023-10-11 Jonathan Wenger , Geoff Pleiss , Marvin Pförtner , Philipp Hennig , John P. Cunningham

We consider the estimation of a sparse parameter vector from measurements corrupted by white Gaussian noise. Our focus is on unbiased estimation as a setting under which the difficulty of the problem can be quantified analytically. We show…

Information Theory · Computer Science 2010-02-02 Alexander Jung , Zvika Ben-Haim , Franz Hlawatsch , Yonina C. Eldar

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Uncertainty quantification in neural networks through methods such as Dropout, Bayesian neural networks and Laplace approximations is either prone to underfitting or computationally demanding, rendering these approaches impractical for…