English
Related papers

Related papers: General Bayesian inference schemes in infinite mix…

200 papers

A key problem in statistical modeling is model selection, how to choose a model at an appropriate level of complexity. This problem appears in many settings, most prominently in choosing the number ofclusters in mixture models or the number…

Machine Learning · Statistics 2011-08-05 Samuel J. Gershman , David M. Blei

Nonparametric Bayesian approaches based on Gaussian processes have recently become popular in the empirical learning community. They encompass many classical methods of statistics, like Radial Basis Functions or various splines, and are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

Increasingly complex applications involve large datasets in combination with non-linear and high dimensional mathematical models. In this context, statistical inference is a challenging issue that calls for pragmatic approaches that take…

Data Analysis, Statistics and Probability · Physics 2013-01-31 Andreas Raue , Clemens Kreutz , Fabian Joachim Theis , Jens Timmer

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

We argue for the use of separate exchangeability as a modeling principle in Bayesian nonparametric (BNP) inference. Separate exchangeability is de facto widely applied in the Bayesian parametric case, e.g., it naturally arises in simple…

Methodology · Statistics 2025-07-29 Giovanni Rebaudo , Qiaohui Lin , Peter Mueller

The natural habitat of most Bayesian methods is data represented by exchangeable sequences of observations, for which de Finetti's theorem provides the theoretical foundation. Dirichlet process clustering, Gaussian process regression, and…

Statistics Theory · Mathematics 2015-02-16 Peter Orbanz , Daniel M. Roy

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between…

Machine Learning · Statistics 2021-11-24 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

The remarkable generalization performance of large-scale models has been challenging the conventional wisdom of the statistical learning theory. Although recent theoretical studies have shed light on this behavior in linear models and…

Machine Learning · Statistics 2024-06-18 Tomoya Wakayama

The compound Poisson process and the Dirichlet process are the pillar structures of Renewal theory and Bayesian nonparametric theory, respectively. Both processes have many useful extensions to fulfill the practitioners needs to model the…

Applications · Statistics 2019-05-17 Arrigo Coen , Beatriz Godínez-Chaparro

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

Spurred on by recent successes in causal inference competitions, Bayesian nonparametric (and high-dimensional) methods have recently seen increased attention in the causal inference literature. In this paper, we present a comprehensive…

Methodology · Statistics 2022-01-11 Antonio R. Linero , Joseph L. Antonelli

Clustering multivariate binary data is of interest in many scientific fields, including ecology, biomedicine, and social policy. Beyond heuristic clustering algorithms, such data can be modelled using multivariate Bernoulli mixture models.…

Methodology · Statistics 2026-04-24 Luisa Ferrari , Maria Franco Villoria , Garritt L. Page , Alex Laini

We introduce a Bayesian approach to predictive density calibration and combination that accounts for parameter uncertainty and model set incompleteness through the use of random calibration functionals and random combination weights.…

Applications · Statistics 2016-10-26 Federico Bassetti , Roberto Casarin , Francesco Ravazzolo

Finite mixture models are flexible methods that are commonly used for model-based clustering. A recent focus in the model-based clustering literature is to highlight the difference between the number of components in a mixture model and the…

Methodology · Statistics 2023-08-03 Garritt L. Page , Massimo Ventrucci , Maria Franco-Villoria

Bayesian nonparametric (BNP) models provide elegant methods for discovering underlying latent features within a data set, but inference in such models can be slow. We exploit the fact that completely random measures, which commonly used…

Machine Learning · Statistics 2020-07-17 Avinava Dubey , Michael Minyi Zhang , Eric P. Xing , Sinead A. Williamson

We provide a complete framework for performing infinite-dimensional Bayesian inference and uncertainty quantification for image reconstruction with Poisson data. In particular, we address the following issues to make the Bayesian framework…

Numerical Analysis · Mathematics 2019-10-22 Qingping Zhou , Tengchao Yu , Xiaoqun Zhang , Jinglai Li

We consider the inference of the structure of an undirected graphical model in an exact Bayesian framework. More specifically we aim at achieving the inference with close-form posteriors, avoiding any sampling step. This task would be…

Machine Learning · Statistics 2017-05-02 Loïc Schwaller , Stéphane Robin , Michael Stumpf

We develop a general class of Bayesian repulsive Gaussian mixture models that encourage well-separated clusters, aiming at reducing potentially redundant components produced by independent priors for locations (such as the Dirichlet…

Methodology · Statistics 2017-10-24 Fangzheng Xie , Yanxun Xu

Conjugate pairs of distributions over infinite dimensional spaces are prominent in statistical learning theory, particularly due to the widespread adoption of Bayesian nonparametric methodologies for a host of models and applications. Much…

Machine Learning · Computer Science 2016-01-12 Robert Finn , Brian Kulis

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal