English
Related papers

Related papers: A Channel-Based Perspective on Conjugate Priors

200 papers

This paper addresses the issue of inversion in cases where (1) the observation system is modeled by a linear transformation and additive noise, (2) the problem is ill-posed and regularization is introduced in a Bayesian framework by an a…

Machine Learning · Statistics 2026-02-12 Jean-François Giovannelli

The main contribution of this article is a new prior distribution over directed acyclic graphs, which gives larger weight to sparse graphs. This distribution is intended for structured Bayesian networks, where the structure is given by an…

Machine Learning · Statistics 2015-04-28 Felix L. Rios , John M. Noble , Timo J. T. Koski

Reference priors are theoretically attractive for the analysis of geostatistical data since they enable automatic Bayesian analysis and have desirable Bayesian and frequentist properties. But their use is hindered by computational hurdles…

Methodology · Statistics 2022-01-27 Victor De Oliveira , Zifei Han

Regression classes modeling more than the mean of the response have found a lot of attention in the last years. Expectile regression is a special and computationally convenient case of this family of models. Expectiles offer a quantile-like…

Methodology · Statistics 2013-12-19 Elisabeth Waldmann , Fabian Sobotka , Thomas Kneib

We advocate for a new statistical principle that combines the most desirable aspects of both parameter inference and density estimation. This leads us to the predictively oriented (PrO) posterior, which expresses uncertainty as a…

We consider the Bayesian binary regression model and we introduce a new class of distributions, the Perturbed Unified Skew-Normal (pSUN, henceforth), which generalizes the Unified Skew-Normal (SUN) class. We show that the new class is…

Methodology · Statistics 2025-02-13 Paolo Onorati , Brunero Liseo

We introduce categories of extended Gaussian maps and Gaussian relations which unify Gaussian probability distributions with relational nondeterminism in the form of linear relations. Both have crucial and well-understood applications in…

Logic in Computer Science · Computer Science 2023-06-08 Dario Stein , Richard Samuelson

I propose a normative updating rule, extended Bayesianism, for the incorporation of probabilistic information arising from the process of becoming more aware. Extended Bayesianism generalizes standard Bayesian updating to allow the…

Theoretical Economics · Economics 2021-10-06 Evan Piermont

Bayesian nonparametric methods are a popular choice for analysing survival data due to their ability to flexibly model the distribution of survival times. These methods typically employ a nonparametric prior on the survival function that is…

Methodology · Statistics 2022-02-22 Edwin Fong , Brieuc Lehmann

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz

The study of almost surely discrete random probability measures is an active line of research in Bayesian nonparametrics. The idea of assuming interaction across the atoms of the random probability measure has recently spurred significant…

Statistics Theory · Mathematics 2025-04-25 Mario Beraha , Raffaele Argiento , Federico Camerlenghi , Alessandra Guglielmi

We obtain rates of contraction of posterior distributions in inverse problems defined by scales of smoothness classes. We derive abstract results for general priors, with contraction rates determined by Galerkin approximation. The rate…

Statistics Theory · Mathematics 2020-07-15 Shota Gugushvili , Aad van der Vaart , Dong Yan

Many dynamical phenomena display a cyclic behavior, in the sense that time can be partitioned into units within which distributional aspects of a process are homogeneous. In this paper, we introduce a class of models - called conjugate…

Statistics Theory · Mathematics 2017-05-05 Eduardo Horta , Flavio Ziegelmann

Consider a pair of input distributions which after passing through a Poisson channel become $\epsilon$-close in total variation. We show that they must necessarily then be $\epsilon^{0.5+o(1)}$-close after passing through a Gaussian channel…

Information Theory · Computer Science 2023-06-30 Anzo Teh , Yury Polyanskiy

This chapter offers an accessible introduction to the channel-based approach to Bayesian probability theory. This framework rests on algebraic and logical foundations, inspired by the methodologies of programming language semantics. It…

Artificial Intelligence · Computer Science 2018-04-30 Bart Jacobs , Fabio Zanasi

Bayesian inference is used extensively to quantify the uncertainty in an inferred field given the measurement of a related field when the two are linked by a mathematical model. Despite its many applications, Bayesian inference faces…

Machine Learning · Statistics 2020-03-31 Dhruv V. Patel , Assad A. Oberai

In this paper, we discuss a method to define prior distributions for the threshold of a generalised Pareto distribution, in particular when its applications are directed to heavy-tailed data. We propose to assign prior probabilities to the…

Methodology · Statistics 2016-04-06 Cristiano Villa

Variational Bayesian Inference is a popular methodology for approximating posterior distributions over Bayesian neural network weights. Recent work developing this class of methods has explored ever richer parameterizations of the…

Although continuous density estimation has received abundant attention in the Bayesian nonparametrics literature, there is limited theory on multivariate mixed scale density estimation. In this note, we consider a general framework to…

Statistics Theory · Mathematics 2014-05-26 Antonio Canale , David B. Dunson

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson