English
Related papers

Related papers: Two-step wavelet-based estimation for mixed Gaussi…

200 papers

In this article we introduce and study oscillating Gaussian processes defined by $X_t = \alpha_+ Y_t {\bf 1}_{Y_t >0} + \alpha_- Y_t{\bf 1}_{Y_t<0}$, where $\alpha_+,\alpha_->0$ are free parameters and $Y$ is either stationary or…

Probability · Mathematics 2019-05-30 Pauliina Ilmonen , Soledad Torres , Lauri Viitasaari

Existing methods to summarize posterior inference for mixture models focus on identifying a point estimate of the implied random partition for clustering, with density estimation as a secondary goal (Wade and Ghahramani, 2018; Dahl et al.,…

Methodology · Statistics 2025-05-09 Khai Nguyen , Peter Mueller

Gaussian process (GP) models form a core part of probabilistic machine learning. Considerable research effort has been made into attacking three issues with GP models: how to compute efficiently when the number of data is large; how to…

Machine Learning · Statistics 2015-06-15 James Hensman , Alexander G. de G. Matthews , Maurizio Filippone , Zoubin Ghahramani

Multivariate processes with long-range dependence properties can be encountered in many fields of application. Two fundamental characteristics in such frameworks are long-range dependence parameters and correlations between component time…

Statistics Theory · Mathematics 2022-04-07 Irène Gannaz

Gaussian processes provide a compact representation for modeling and estimating an unknown function, that can be updated as new measurements of the function are obtained. This paper extends this powerful framework to the case where the…

Systems and Control · Electrical Eng. & Systems 2023-11-30 Jilles van Hulst , Roy van Zuijlen , Duarte Antunes , W. P. M. H. , Heemels

We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales linearly with…

Machine Learning · Computer Science 2021-11-03 Oliver Hamelijnck , William J. Wilkinson , Niki A. Loppi , Arno Solin , Theodoros Damoulas

Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations.…

Methodology · Statistics 2026-03-10 Adam Gorm Hoffmann , Claus Thorn Ekstrøm , Andreas Kryger Jensen

Nonparametric mixture models based on the Dirichlet process are an elegant alternative to finite models when the number of underlying components is unknown, but inference in such models can be slow. Existing attempts to parallelize…

Machine Learning · Statistics 2012-12-03 Sinead A. Williamson , Avinava Dubey , Eric P. Xing

Considering the issue of estimating small probabilities p, ie. measuring a rare domain F = {x | g(x) > q} with respect to the distribution of a random vector X, Multilevel Splitting strategies (also called Subset Simulation) aim at writing…

Computation · Statistics 2015-09-10 Clément Walter

We propose a nonparametric density estimator based on the Gaussian process (GP) and derive three novel closed form learning algorithms based on Fisher divergence (FD) score matching. The density estimator is formed by multiplying a base…

Machine Learning · Computer Science 2025-11-17 John Paisley , Wei Zhang , Brian Barr

Sparse variational Gaussian process (SVGP) methods are a common choice for non-conjugate Gaussian process inference because of their computational benefits. In this paper, we improve their computational efficiency by using a dual…

Machine Learning · Computer Science 2022-01-20 Vincent Adam , Paul E. Chang , Mohammad Emtiyaz Khan , Arno Solin

We study the asymptotic behavior of wavelet coefficients of random processes with long memory. These processes may be stationary or not and are obtained as the output of non--linear filter with Gaussian input. The wavelet coefficients that…

Probability · Mathematics 2010-07-28 Marianne Clausel , François Roueff , Murad S. Taqqu , Ciprian A. Tudor

We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent…

The Bayesian approach to inference stands out for naturally allowing borrowing information across heterogeneous populations, with different samples possibly sharing the same distribution. A popular Bayesian nonparametric model for…

Methodology · Statistics 2022-01-25 Antonio Lijoi , Igor Prünster , Giovanni Rebaudo

This work brings together two powerful concepts in Gaussian processes: the variational approach to sparse approximation and the spectral representation of Gaussian processes. This gives rise to an approximation that inherits the benefits of…

Machine Learning · Statistics 2017-11-09 James Hensman , Nicolas Durrande , Arno Solin

In this article, we consider a non-parametric Bayesian approach to multivariate quantile regression. The collection of related conditional distributions of a response vector Y given a univariate covariate X is modeled using a Dependent…

Methodology · Statistics 2020-07-03 Indrabati Bhattacharya , Subhashis Ghosal

In this paper, we study the problem of adaptive estimation of the spectral density of a stationary Gaussian process. For this purpose, we consider a wavelet-based method which combines the ideas of wavelet approximation and estimation by…

Statistics Theory · Mathematics 2011-06-07 Jérémie Bigot , Rolando Biscay Lirio , Jean-Michel Loubes , Lilian Muniz Alvarez

We propose a novel estimation framework for path-dependent functionals of Levy processes from discretely observed data. Traditional approaches rely on Monte Carlo simulation of full paths, which requires complete model specification and…

Methodology · Statistics 2025-09-03 Yasutaka Shimizu , Hiroshi Shiraishi

A Neural Process (NP) estimates a stochastic process implicitly defined with neural networks given a stream of data, rather than pre-specifying priors already known, such as Gaussian processes. An ideal NP would learn everything from data…

Machine Learning · Computer Science 2023-04-20 Hyungi Lee , Eunggu Yun , Giung Nam , Edwin Fong , Juho Lee

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal