English
Related papers

Related papers: Model Prior Distribution for Variable Selection in…

200 papers

To include parameter uncertainty into probabilistic climate forecasts one must first specify a prior. We advocate the use of objective priors, and, in particular, the Jeffreys' Prior. In previous work we have derived expressions for the…

Atmospheric and Oceanic Physics · Physics 2010-05-14 Stephen Jewson , Dan Rowlands , Myles Allen

The beta distribution is a basic distribution serving several purposes. It is used to model data, and also, as a more flexible version of the uniform distribution, it serves as a prior distribution for a binomial probability. The bivariate…

Methodology · Statistics 2014-09-17 Ingram Olkin , Thomas A. Trikalinos

The main purpose of this paper is to introduce a new class of regression models for bounded continuous data, commonly encountered in applied research. The models, named the power logit regression models, assume that the response variable…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes Paula Ferrari

We propose a Bayesian approach using improper priors for hierarchical linear mixed models with flexible random effects and residual error distributions. The error distribution is modelled using scale mixtures of normals, which can capture…

Methodology · Statistics 2018-02-06 F. J. Rubio , M. F. J. Steel

Selection of an architectural prior well suited to a task (e.g. convolutions for image data) is crucial to the success of deep neural networks (NNs). Conversely, the weight priors within these architectures are typically left vague,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Tim Pearce , Andrew Y. K. Foong , Alexandra Brintrup

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

We address the issue of model selection in beta regressions with varying dispersion. The model consists of two submodels, namely: for the mean and for the dispersion. Our focus is on the selection of the covariates for each submodel. Our…

Computation · Statistics 2017-02-08 Fábio M. Bayer , Francisco Cribari-Neto

Which neural networks are similar is a fundamental question for both machine learning and neuroscience. Here, it is proposed to base comparisons on the predictive distributions of linear readouts from intermediate representations. In…

Machine Learning · Computer Science 2025-05-27 Heiko H. Schütt

Linear mixed-effect models with two variance components are often used when variability comes from two sources. In genetics applications, variation in observed traits can be attributed to biological and environmental effects, and the…

Methodology · Statistics 2015-01-19 Qianshun Cheng , Xu Gao , Ryan Martin

Learning priors on trajectory distributions can help accelerate robot motion planning optimization. Given previously successful plans, learning trajectory generative models as priors for a new planning problem is highly desirable. Prior…

Robotics · Computer Science 2024-03-27 Joao Carvalho , An T. Le , Mark Baierl , Dorothea Koert , Jan Peters

We distinguish two questions (i) how much information does the prior contain? and (ii) what is the effect of the prior? Several measures have been proposed for quantifying effective prior sample size, for example Clarke [1996] and Morita et…

Methodology · Statistics 2020-01-30 David E Jones , Robert N Trangucci , Yang Chen

Estimating how uncertain an AI system is in its predictions is important to improve the safety of such systems. Uncertainty in predictive can result from uncertainty in model parameters, irreducible data uncertainty and uncertainty due to…

Machine Learning · Statistics 2018-12-03 Andrey Malinin , Mark Gales

In the context of the expected-posterior prior (EPP) approach to Bayesian variable selection in linear models, we combine ideas from power-prior and unit-information-prior methodologies to simultaneously produce a minimally-informative…

Computation · Statistics 2015-04-27 Dimitris Fouskakis , Ioannis Ntzoufras , David Draper

For line spectrum estimation, we derive the maximum a posteriori probability estimator where prior knowledge of frequencies is modeled probabilistically. Since the spectrum is periodic, an appropriate distribution is the circular von Mises…

Statistics Theory · Mathematics 2013-06-26 Dave Zachariah , Petter Wirfält , Magnus Jansson , Saikat Chatterjee

For the last two decades, high-dimensional data and methods have proliferated throughout the literature. Yet, the classical technique of linear regression has not lost its usefulness in applications. In fact, many high-dimensional…

Statistics Theory · Mathematics 2021-05-18 Arun Kumar Kuchibhotla , Lawrence D. Brown , Andreas Buja , Edward I. George , Linda Zhao

When choosing between competing symbolic models for a data set, a human will naturally prefer the "simpler" expression or the one which more closely resembles equations previously seen in a similar context. This suggests a non-uniform prior…

Machine Learning · Computer Science 2023-06-05 Deaglan J. Bartlett , Harry Desmond , Pedro G. Ferreira

If the prior probability distributions of all possible hypothetical true means and all possible observed means of a continuous variable are conditional on the universal set of all numbers (i.e., before the nature of a study is known and a…

Methodology · Statistics 2025-06-05 Huw Llewelyn

We consider the problem of estimating the class prior in an unlabeled dataset. Under the assumption that an additional labeled dataset is available, the class prior can be estimated by fitting a mixture of class-wise data distributions to…

Machine Learning · Computer Science 2016-11-08 Marthinus C. du Plessis , Gang Niu , Masashi Sugiyama

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

Machine Learning · Computer Science 2019-10-04 Tiago Ramalho , Miguel Miranda

In this work we apply the methodology of integral priors to handle Bayesian model selection in binomial regression models with a general link function. These models are very often used to investigate associations and risks in…

Methodology · Statistics 2013-07-01 Diego Salmeron , Juan Antonio Cano , C. P. Robert