English
Related papers

Related papers: Posterior convergence rates in non-linear latent v…

200 papers

The paper considers so-called adaptive estimations of regression, distribution density and spectral density of a Gaussian stationary sequence, asymptotically optimal in order at a growing number of observation on any regular subspace…

Probability · Mathematics 2007-05-23 Eugene Ostrovsky , Leonid Sirota

Variational autoencoders model high-dimensional data by positing low-dimensional latent variables that are mapped through a flexible distribution parametrized by a neural network. Unfortunately, variational autoencoders often suffer from…

Machine Learning · Statistics 2023-01-03 Yixin Wang , David M. Blei , John P. Cunningham

Shape restrictions such as monotonicity on functions often arise naturally in statistical modeling. We consider a Bayesian approach to the problem of estimation of a monotone regression function and testing for monotonicity. We construct a…

Statistics Theory · Mathematics 2020-08-05 Moumita Chakraborty , Subhashis Ghosal

A two-class mixture model, where the density of one of the components is known, is considered. We address the issue of the nonparametric adaptive estimation of the unknown probability density of the second component. We propose a randomly…

Statistics Theory · Mathematics 2021-02-08 Gaelle Chagny , Antoine Channarond , Van Ha Hoang , Angelina Roche

We derive rates of contraction of posterior distributions on nonparametric models resulting from sieve priors. The aim of the paper is to provide general conditions to get posterior rates when the parameter space has a general structure,…

Statistics Theory · Mathematics 2016-05-03 Julyan Arbel , Ghislaine Gayraud , Judith Rousseau

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

Posterior contractions rates (PCRs) strengthen the notion of Bayesian consistency, quantifying the speed at which the posterior distribution concentrates on arbitrarily small neighborhoods of the true model, with probability tending to 1 or…

Statistics Theory · Mathematics 2022-01-31 Federico Camerlenghi , Emanuele Dolera , Stefano Favaro , Edoardo Mainini

The focus of this work is the convergence of non-stationary and deep Gaussian process regression. More precisely, we follow a Bayesian approach to regression or interpolation, where the prior placed on the unknown function $f$ is a…

Statistics Theory · Mathematics 2025-03-19 Conor Osborne , Aretha L. Teckentrup

We consider the problem of estimation in Hidden Markov models with finite state space and nonparametric emission distributions. Efficient estimators for the transition matrix are exhibited, and a semiparametric Bernstein-von Mises result is…

Statistics Theory · Mathematics 2023-03-09 Daniel Moss , Judith Rousseau

In this paper, we propose a Spatial Robust Mixture Regression model to investigate the relationship between a response variable and a set of explanatory variables over the spatial domain, assuming that the relationships may exhibit complex…

Methodology · Statistics 2021-09-30 Wennan Chang , Pengtao Dang , Changlin Wan , Xiaoyu Lu , Yue Fang , Tong Zhao , Yong Zang , Bo Li , Chi Zhang , Sha Cao

We present a structured additive regression approach to model conditional densities given scalar covariates, where only samples of the conditional distributions are observed. This links our approach to distributional regression models for…

Methodology · Statistics 2025-10-17 Eva-Maria Maier , Alexander Fottner , Sonja Greven , Almond Stöcker

In this paper we propose a convolution estimator for estimating the density of a response variable that employs an underlying multiple regression framework to enhance the accuracy of density estimates through the incorporation of auxiliary…

Statistics Theory · Mathematics 2021-06-04 Brian Fitzpatrick , James Loughman , Daniel Ian Flitcroft

We study non-parametric regression estimates for random fields. The data satisfies certain strong mixing conditions and is defined on the regular $N$-dimensional lattice structure. We show consistency and obtain rates of convergence. The…

Statistics Theory · Mathematics 2018-07-06 Johannes T. N. Krebs

The problem of developing binary classifiers from positive and unlabeled data is often encountered in machine learning. A common requirement in this setting is to approximate posterior probabilities of positive and negative classes for a…

Machine Learning · Statistics 2016-01-11 Shantanu Jain , Martha White , Michael W. Trosset , Predrag Radivojac

We consider the problem of Bayesian density estimation on the positive semiline for possibly unbounded densities. We propose a hierarchical Bayesian estimator based on the gamma mixture prior which can be viewed as a location mixture. We…

Statistics Theory · Mathematics 2020-02-25 Natalia Bochkina , Judith Rousseau

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

We consider the problem of estimating the mixing density $f$ from $n$ i.i.d. observations distributed according to a mixture density with unknown mixing distribution. In contrast with finite mixtures models, here the distribution of the…

Statistics Theory · Mathematics 2015-05-26 Tabea Rebafka , François Roueff

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…

Statistics Theory · Mathematics 2010-10-05 Andriy Norets

In this article, we investigate posterior convergence of nonparametric binary and Poisson regression under possible model misspecification, assuming general stochastic process prior with appropriate properties. Our model setup and objective…

Statistics Theory · Mathematics 2020-05-04 Debashis Chatterjee , Sourabh Bhattacharya

Stochastic volatility modelling of financial processes has become increasingly popular. The proposed models usually contain a stationary volatility process. We will motivate and review several nonparametric methods for estimation of the…

Methodology · Statistics 2014-07-15 Bert van Es , Peter Spreij , Harry van Zanten