English
Related papers

Related papers: Penalising model component complexity: A principle…

200 papers

In many domains, we are interested in analyzing the structure of the underlying distribution, e.g., whether one variable is a direct parent of the other. Bayesian model-selection attempts to find the MAP model and use its structure to…

Machine Learning · Computer Science 2013-01-18 Nir Friedman , Daphne Koller

Causal sensitivity analysis aims to provide bounds for causal effect estimates in the presence of unobserved confounding. However, existing methods for causal sensitivity analysis are per-instance procedures, meaning that changes to the…

Machine Learning · Statistics 2026-05-12 Emil Javurek , Dennis Frauen , Marie Brockschmidt , Jonas Schweisthal , Stefan Feuerriegel

Recently there has been sustained interest in modifying prediction algorithms to satisfy fairness constraints. These constraints are typically complex nonlinear functionals of the observed data distribution. Focusing on the path-specific…

Machine Learning · Statistics 2022-04-15 Razieh Nabi , Daniel Malinsky , Ilya Shpitser

Inferring causal structure poses a combinatorial search problem that typically involves evaluating structures with a score or independence test. The resulting search is costly, and designing suitable scores or tests that capture prior…

Machine Learning · Computer Science 2022-12-16 Lars Lorch , Scott Sussex , Jonas Rothfuss , Andreas Krause , Bernhard Schölkopf

To include parameter uncertainty into probabilistic climate forecasts one must first specify a prior. We advocate the use of objective priors, and, in particular, the Jeffreys' Prior. In previous work we have derived expressions for the…

Atmospheric and Oceanic Physics · Physics 2010-05-14 Stephen Jewson , Dan Rowlands , Myles Allen

Prior specification for nonparametric Bayesian inference involves the difficult task of quantifying prior knowledge about a parameter of high, often infinite, dimension. Realistically, a statistician is unlikely to have informed opinions…

Methodology · Statistics 2012-05-01 David C. Kessler , Peter D. Hoff , David B. Dunson

We develop a natural Bayesian multiplicity-correcting prior distribution within the probabilistic forward stepwise representation of model space priors for regression problems. The proposed prior, obtained from making an analogy to the Holm…

Statistics Theory · Mathematics 2026-05-29 Andrew Womack , Daniel Taylor-Rodriguez

Model selection in penalized regression critically depends on an accurate assessment of model complexity, commonly quantified through the effective degrees of freedom. While the Lasso admits a simple and unbiased characterization, given by…

Methodology · Statistics 2026-04-06 Mauro Bernardi , Antonio Canale , Marco Stefanucci

We consider the problem of producing fair probabilistic classifiers for multi-class classification tasks. We formulate this problem in terms of "projecting" a pre-trained (and potentially unfair) classifier onto the set of models that…

Machine Learning · Computer Science 2022-06-17 Wael Alghamdi , Hsiang Hsu , Haewon Jeong , Hao Wang , P. Winston Michalak , Shahab Asoodeh , Flavio P. Calmon

Fairness-aware statistical learning is essential for mitigating discrimination against protected attributes such as gender, race, and ethnicity in data-driven decision-making. This is particularly critical in high-stakes applications like…

Methodology · Statistics 2025-04-15 Fei Huang , Junhao Shen , Yanrong Yang , Ran Zhao

One of the challenges with functional data is incorporating spatial structure, or local correlation, into the analysis. This structure is inherent in the output from an increasing number of biomedical technologies, and a functional linear…

Applications · Statistics 2011-11-07 Timothy W. Randolph , Jaroslaw Harezlak , Ziding Feng

We provide a remedy for two concerns that have dogged the use of principal components in regression: (i) principal components are computed from the predictors alone and do not make apparent use of the response, and (ii) principal components…

Methodology · Statistics 2009-06-23 R. Dennis Cook , Liliana Forzani

This study develops a framework for a class of constant modulus (CM) optimization problems, which covers binary constraints, discrete phase constraints, semi-orthogonal matrix constraints, non-negative semi-orthogonal matrix constraints,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

Complex networks theory has commonly been used for modelling and understanding the interactions taking place between the elements composing complex systems. More recently, the use of generative models has gained momentum, as they allow…

Physics and Society · Physics 2016-05-19 Massimiliano Zanin , Marco Correia , Pedro A. C. Sousa , Jorge Cruz

Parameter estimation connects mathematical models to real-world data and decision making across many scientific and industrial applications. Standard approaches such as maximum likelihood estimation and Markov chain Monte Carlo estimate…

Methodology · Statistics 2026-02-06 Matthew J Simpson , James S Bennett , Alexander Johnston , Ruth E Baker

Learning the structure of Bayesian networks and causal relationships from observations is a common goal in several areas of science and technology. We show that the prequential minimum description length principle (MDL) can be used to…

Machine Learning · Computer Science 2021-07-13 Jorg Bornschein , Silvia Chiappa , Alan Malek , Rosemary Nan Ke

Prior distributions elicited for modelling the natural fluctuations or the uncertainty on parameters of Bayesian fishery population models, can be chosen among a vast range of statistical laws. Since the statistical framework is defined by…

Statistics Theory · Mathematics 2010-10-12 Nicolas Bousquet

In this paper, we present an innovative method for constructing proper priors for the skewness (shape) parameter in the skew-symmetric family of distributions. The proposed method is based on assigning a prior distribution on the…

Methodology · Statistics 2017-08-28 Holger Dette , Christophe Ley , Francisco Javier Rubio

The identification of predictive biomarkers from a large scale of covariates for subgroup analysis has attracted fundamental attention in medical research. In this article, we propose a generalized penalized regression method with a novel…

Methodology · Statistics 2019-04-29 Chong Ma , Wenxuan Deng , Shuangge Ma , Ray Liu , Kevin Galinsky

In both observational data and randomized control trials, researchers select statistical models to articulate how the outcome of interest varies with combinations of observable covariates. Choosing a model that is too simple can obfuscate…