English
Related papers

Related papers: Bayesian Constrained-Model Selection for Factor An…

200 papers

Subset selection is a valuable tool for interpretable learning, scientific discovery, and data compression. However, classical subset selection is often avoided due to selection instability, lack of regularization, and difficulties with…

Machine Learning · Statistics 2022-02-17 Daniel R. Kowal

This paper investigates Bayesian variable selection when there is a hierarchical dependence structure on the inclusion of predictors in the model. In particular, we study the type of dependence found in polynomial response surfaces of…

Methodology · Statistics 2015-02-03 Daniel Taylor-Rodriguez , Andrew Womack , Nikolay Bliznyuk

The paper considers linear regression problems where the number of predictor variables is possibly larger than the sample size. The basic motivation of the study is to combine the points of view of model selection and functional regression…

Statistics Theory · Mathematics 2012-02-24 Alois Kneip , Pascal Sarda

In this paper, we derive a Bayesian model order selection rule by using the exponentially embedded family method, termed Bayesian EEF. Unlike many other Bayesian model selection methods, the Bayesian EEF can use vague proper priors and…

Machine Learning · Statistics 2018-12-24 Zhenghan Zhu , Steven Kay

With this paper, we contribute to the growing research area of feature-based analysis of bio-inspired computing. In this research area, problem instances are classified according to different features of the underlying problem in terms of…

Neural and Evolutionary Computing · Computer Science 2016-02-10 Shayan Poursoltan , Frank Neumann

We describe a hierarchical Bayesian approach for inference about a parameter $\theta$ lower-bounded by $\alpha$ with uncertain $\alpha$, derive some basic identities for posterior analysis about $(\theta,\alpha)$, and provide illustrations…

Statistics Theory · Mathematics 2018-06-08 Éric Marchand , Theodoros Nicoleris

Diffusion models have attained prominence for their ability to synthesize a probability distribution for a given dataset via a diffusion process, enabling the generation of new data points with high fidelity. However, diffusion processes…

Machine Learning · Computer Science 2024-11-25 Shervin Khalafi , Dongsheng Ding , Alejandro Ribeiro

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Phylogenetic comparative methods explore the relationships between quantitative traits adjusting for shared evolutionary history. This adjustment often occurs through a Brownian diffusion process along the branches of the phylogeny that…

Methodology · Statistics 2017-01-27 Max R. Tolkoff , Michael L. Alfaro , Guy Baele , Philippe Lemey , Marc A. Suchard

Defining the number of latent factors has been one of the most challenging problems in factor analysis. Infinite factor models offer a solution to this problem by applying increasing shrinkage on the columns of factor loading matrices, thus…

Methodology · Statistics 2023-09-25 Margarita Grushanina

When performing regression or classification, we are interested in the conditional probability distribution for an outcome or class variable Y given a set of explanatoryor input variables X. We consider Bayesian models for this task. In…

Machine Learning · Computer Science 2013-02-08 David Heckerman , Christopher Meek

A predictive Bayesian model selection approach is presented to discriminate coupled models used to predict an unobserved quantity of interest (QoI). The need for accurate predictions arises in a variety of critical applications such as…

Applications · Statistics 2011-07-06 Gabriel Terejanu , Todd Oliver , Chris Simmons

Inference after model selection has been an active research topic in the past few years, with numerous works offering different approaches to addressing the perils of the reuse of data. In particular, major progress has been made recently…

Methodology · Statistics 2020-06-02 Snigdha Panigrahi , Jonathan Taylor , Asaf Weinstein

Approving and assessing new drugs is complex because multiple criteria must be considered simultaneously. A common approach is benefit-risk analysis, often conducted within a Bayesian framework to account for uncertainty and combine data…

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

Equivariant models leverage prior knowledge on symmetries to improve predictive performance, but misspecified architectural constraints can harm it instead. While work has explored learning or relaxing constraints, selecting among…

Machine Learning · Computer Science 2025-07-16 Putri A. van der Linden , Alexander Timans , Dharmesh Tailor , Erik J. Bekkers

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Datasets encountered when examining deeper issues in ecology and evolution are often complex. This calls for careful strategies for both model building, model selection, and model averaging. Our paper aims at motivating, exhibiting, and…

Applications · Statistics 2026-03-19 Gerda Claeskens , Céline Cunen , Nils Lid Hjort

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

Based on a recent development in the area of error control coding, we introduce the notion of convolutional factor graphs (CFGs) as a new class of probabilistic graphical models. In this context, the conventional factor graphs are referred…

Artificial Intelligence · Computer Science 2012-07-19 Yongyi Mao , Frank Kschischang , Brendan J. Frey