English
Related papers

Related papers: A Bayes factor with reasonable model selection con…

200 papers

High-dimensional linear models have been widely studied, but the developments in high-dimensional generalized linear models, or GLMs, have been slower. In this paper, we propose an empirical or data-driven prior leading to an empirical…

Statistics Theory · Mathematics 2025-07-09 Yiqi Tang , Ryan Martin

Bayesian model selection provides a formal method of determining the level of support for new parameters in a model. However, if there is not a specific enough underlying physical motivation for the new parameters it can be hard to assign…

Astrophysics · Physics 2009-11-13 Christopher Gordon , Roberto Trotta

The Bayes factor, the data-based updating factor from prior to posterior odds, is a principled measure of relative evidence for two competing hypotheses. It is naturally suited to sequential data analysis in settings such as clinical trials…

Methodology · Statistics 2026-01-07 Samuel Pawel , Leonhard Held

Bayes factors are an increasingly popular tool for indexing evidence from experiments. For two competing population models, the Bayes factor reflects the relative likelihood of observing some data under one model compared to the other. In…

Methodology · Statistics 2023-04-26 Thomas J. Faulkenberry , Keelyn B. Brennan

In the social sciences we are often interested in comparing models specified by parametric equality or inequality constraints. For instance, when examining three group means $\{ \mu_1, \mu_2, \mu_3\}$ through an analysis of variance…

Methodology · Statistics 2025-01-08 Guido Consonni , Roberta Paroli

It is often claimed that Bayesian methods, in particular Bayes factor methods for hypothesis testing, can deal with optional stopping. We first give an overview, using elementary probability theory, of three different mathematical meanings…

Statistics Theory · Mathematics 2021-03-24 Allard Hendriksen , Rianne de Heide , Peter Grünwald

Bayes factors for composite hypotheses have difficulty in encoding vague prior knowledge, as improper priors cannot be used and objective priors may be subjectively unreasonable. To address these issues I revisit the posterior Bayes factor,…

Methodology · Statistics 2024-02-29 Frank Dudbridge

We propose a novel Bayesian approach to the problem of variable selection in multiple linear regression models. In particular, we present a hierarchical setting which allows for direct specification of a-priori beliefs about the number of…

Computation · Statistics 2019-03-14 Konstantin Posch , Maximilian Arbeiter , Jürgen Pilz

When prior information is lacking, the go-to strategy for probabilistic inference is to combine a "default prior" and the likelihood via Bayes's theorem. Objective Bayes, (generalized) fiducial inference, etc. fall under this umbrella. This…

Methodology · Statistics 2026-01-05 Ryan Martin

We discuss Bayesian inference for parameters selected using the data. First, we provide a critical analysis of the existing positions in the literature regarding the correct Bayesian approach under selection. Second, we propose two types of…

Statistics Theory · Mathematics 2021-05-12 Daniel G. Rasines , G. Alastair Young

A new empirical Bayes approach to variable selection in the context of generalized linear models is developed. The proposed algorithm scales to situations in which the number of putative explanatory variables is very large, possibly much…

Methodology · Statistics 2021-06-29 Haim Bar , James Booth , Martin T. Wells

The features in high dimensional biomedical prediction problems are often well described with lower dimensional manifolds. An example is genes that are organised in smaller functional networks. The outcome can then be described with the…

In this paper, we develop a generalized Bayesian inference framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon an asymptotically unbiased…

Statistics Theory · Mathematics 2022-04-01 Fangzheng Xie , Dingbo Wu

In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms…

Methodology · Statistics 2009-02-27 M. J. Bayarri , G. García-Donato

Model selection for regression problems with an increasing number of covariates continues to be an important problem both theoretically and in applications. Model selection consistency and mean structure reconstruction depend on the…

Statistics Theory · Mathematics 2019-05-16 Zikun Yang , Andrew Womack

Replication studies are increasingly conducted but there is no established statistical criterion for replication success. We propose a novel approach combining reverse-Bayes analysis with Bayesian hypothesis testing: a sceptical prior is…

Methodology · Statistics 2022-12-15 Samuel Pawel , Leonhard Held

Although variable selection is one of the most popular areas of modern statistical research, much of its development has taken place in the classical paradigm compared to the Bayesian counterpart. Somewhat surprisingly, both the paradigms…

Statistics Theory · Mathematics 2021-05-27 Minerva Mukhopadhyay , Sourabh Bhattacharya

In this paper, we propose a new Bayesian inference method for a high-dimensional sparse factor model that allows both the factor dimensionality and the sparse structure of the loading matrix to be inferred. The novelty is to introduce a…

Machine Learning · Statistics 2023-05-31 Ilsang Ohn , Lizhen Lin , Yongdai Kim

Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike commonly reported p-values for standard null…

Methodology · Statistics 2026-04-22 Joris Mulder , Robbie C. M. van Aert

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

Statistics Theory · Mathematics 2014-07-28 Naveen Naidu Narisetty , Xuming He