English
Related papers

Related papers: Posterior concentration and fast convergence rates…

200 papers

When related learning tasks are naturally arranged in a hierarchy, an appealing approach for coping with scarcity of instances is that of transfer learning using a hierarchical Bayes framework. As fully Bayesian computations can be…

Machine Learning · Computer Science 2012-06-18 Gal Elidan , Ben Packer , Geremy Heitz , Daphne Koller

We study asymptotic frequentist coverage and approximately Gaussian properties of Bayes posterior credible sets in nonlinear inverse problems when a Gaussian prior is placed on the parameter of the PDE. The aim is to ensure valid…

Statistics Theory · Mathematics 2026-04-24 Youngsoo Baek , Katerina Papagiannouli

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

Long-tailed classification poses a challenge due to its heavy imbalance in class probabilities and tail-sensitivity risks with asymmetric misprediction costs. Recent attempts have used re-balancing loss and ensemble methods, but they are…

Machine Learning · Computer Science 2023-03-22 Bolian Li , Ruqi Zhang

In a general class of Bayesian nonparametric models, we prove that the posterior distribution can be asymptotically approximated by a Gaussian process. Our results apply to nonparametric exponential family that contains both Gaussian and…

Statistics Theory · Mathematics 2017-11-01 Zuofeng Shang , Guang Cheng

In Bayesian theory, calculating a posterior probability distribution is highly important but usually difficult. Therefore, some methods have been put forward to deal with such problem, among which, the most popular one is the asymptotic…

Methodology · Statistics 2012-07-20 Zai-Ying Zhou

This paper brings a contribution to the Bayesian theory of nonparametric and semiparametric estimation. We are interested in the asymptotic normality of the posterior distribution in Gaussian linear regression models when the number of…

Statistics Theory · Mathematics 2012-03-05 Dominique Bontemps

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

Non-linear latent variable models have become increasingly popular in a variety of applications. However, there has been little study on theoretical properties of these models. In this article, we study rates of posterior contraction in…

Statistics Theory · Mathematics 2017-01-27 Shuang Zhou , Debdeep Pati , Anirban Bhattacharya , David Dunson

We study a simple learning algorithm for binary classification. Instead of predicting with the best hypothesis in the hypothesis class, that is, the hypothesis that minimizes the training error, our algorithm predicts with a weighted…

Statistics Theory · Mathematics 2007-06-13 Yoav Freund , Yishay Mansour , Robert E. Schapire

Heckman selection model is the most popular econometric model in analysis of data with sample selection. However, selection models with Normal errors cannot accommodate heavy tails in the error distribution. Recently, Marchenko and Genton…

Computation · Statistics 2014-01-08 Peng Ding

We consider Bayesian nonparametric inference in the right-censoring survival model, where modeling is made at the level of the hazard rate. We derive posterior limiting distributions for linear functionals of the hazard, and then for `many'…

Statistics Theory · Mathematics 2021-06-01 Ismaël Castillo , Stéphanie van der Pas

We obtain the tail probability of generalized sub-Gaussian canonical processes. It can be viewed as a variant of the Bernstein-type inequality in the i.i.d case, and we further get a tighter bound of concentration inequality through…

Probability · Mathematics 2024-02-02 Yiming Chen , Yuxuan Wang , Kefan Zhu

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

Forecasting multivariate time series is a computationally intensive task challenged by extreme or redundant samples. Recent resampling methods aim to increase training efficiency by reweighting samples based on their running losses.…

Machine Learning · Computer Science 2024-06-21 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

The large variety of functions encountered in nonparametric statistics, calls for methods that are flexible enough to achieve optimal or near-optimal performance over a wide variety of functional classes, such as Besov balls, as well as…

Statistics Theory · Mathematics 2026-02-04 Sergios Agapiou , Ismaël Castillo , Paul Egels

This paper studies quasi Bayesian estimation and uncertainty quantification for an unknown function that is identified by a nonparametric conditional moment restriction. We derive contraction rates for a class of Gaussian process priors.…

Econometrics · Economics 2023-11-08 Sid Kankanala

This article shows that a large class of posterior measures that are absolutely continuous with respect to a Gaussian prior have strong maximum a posteriori estimators in the sense of Dashti et al. (2013). This result holds in any separable…

Statistics Theory · Mathematics 2025-09-10 Hefin Lambley

Bayesian reinforcement learning (BRL) is a method that merges principles from Bayesian statistics and reinforcement learning to make optimal decisions in uncertain environments. As a model-based RL method, it has two key components: (1)…

Machine Learning · Statistics 2025-06-03 Shreya Sinha Roy , Richard G. Everitt , Christian P. Robert , Ritabrata Dutta

We study Bayesian linear regression models with skew-symmetric scale mixtures of normal error distributions. These kinds of models can be used to capture departures from the usual assumption of normality of the errors in terms of heavy…

Applications · Statistics 2016-01-12 Francisco J. Rubio , Marc G. Genton