English
Related papers

Related papers: A Generalized Variable Importance Metric and Estim…

200 papers

Ensuring model calibration is critical for reliable prediction, yet popular distribution-free methods such as histogram binning and isotonic regression offer only asymptotic guarantees. We introduce a unified framework for Venn and…

Machine Learning · Statistics 2025-07-17 Lars van der Laan , Ahmed Alaa

Because of the widespread use of black box prediction methods such as random forests and neural nets, there is renewed interest in developing methods for quantifying variable importance as part of the broader goal of interpretable…

Methodology · Statistics 2021-11-23 Isabella Verdinelli , Larry Wasserman

Survey instruments and assessments are frequently used in many domains of social science. When the constructs that these assessments try to measure become multifaceted, multidimensional item response theory (MIRT) provides a unified…

Methodology · Statistics 2025-01-08 Chenchen Ma , Jing Ouyang , Chun Wang , Gongjun Xu

Projection predictive inference is a decision theoretic Bayesian approach that decouples model estimation from decision making. Given a reference model previously built including all variables present in the data, projection predictive…

Methodology · Statistics 2020-10-15 Alejandro Catalina , Paul-Christian Bürkner , Aki Vehtari

Identifiability describes the possibility of determining the values of the unknown parameters that characterize a dynamic system from the knowledge of its inputs and outputs. This paper finds the general analytical condition that fully…

Optimization and Control · Mathematics 2023-05-03 Agostino Martinelli

Inferring variable importance is the key problem of many scientific studies, where researchers seek to learn the effect of a feature $X$ on the outcome $Y$ in the presence of confounding variables $Z$. Focusing on classification problems,…

Methodology · Statistics 2023-09-11 Wenshuo Wang , Lucas Janson , Lihua Lei , Aaditya Ramdas

We develop a framework for quantifying omitted variable bias (OVB) in nonlinear instrumental variable (IV) estimators, including the local average treatment effect (LATE), the LATE for the treated (LATT), and the partially linear IV model…

Econometrics · Economics 2026-04-07 Yu-Min Yen

A method for the local and global interpretation of a black-box model on the basis of the well-known generalized additive models is proposed. It can be viewed as an extension or a modification of the algorithm using the neural additive…

Machine Learning · Computer Science 2020-10-16 Andrei V. Konstantinov , Lev V. Utkin

Many learning algorithms require categorical data to be transformed into real vectors before it can be used as input. Often, categorical variables are encoded as one-hot (or dummy) vectors. However, this mode of representation can be…

Machine Learning · Statistics 2021-10-29 Jonathan Johannemann , Vitor Hadad , Susan Athey , Stefan Wager

In this paper, we present a new explainability formalism designed to shed light on how each input variable of a test set impacts the predictions of machine learning models. Hence, we propose a group explainability formalism for trained…

Machine Learning · Statistics 2022-08-12 François Bachoc , Fabrice Gamboa , Max Halford , Jean-Michel Loubes , Laurent Risser

We introduce and study Multi-Quantile estimators for the parameters $( \xi, \sigma, \mu)$ of Generalized Extreme Value (GEV) distributions to provide a robust approach to extreme value modeling. Unlike classical estimators, such as the…

Methodology · Statistics 2025-03-03 Sen Lin , Ao Kong , Robert Azencott

Generalized additive index models (GAIMs) offer a flexible semiparametric framework for capturing complex data relationships, balancing the interpretability of parametric models with the flexibility of nonparametric approaches. However,…

Methodology · Statistics 2026-05-29 Ziyu Peng , Linglingzhi Zhu , Yao Xie

Risk scores are widely used for clinical decision making and commonly generated from logistic regression models. Machine-learning-based methods may work well for identifying important predictors, but such 'black box' variable selection…

Machine Learning · Computer Science 2024-12-31 Yilin Ning , Siqi Li , Marcus Eng Hock Ong , Feng Xie , Bibhas Chakraborty , Daniel Shu Wei Ting , Nan Liu

A connection between the General Linear Model (GLM) in combination with classical statistical inference and the machine learning (MLE)-based inference is described in this paper. Firstly, the estimation of the GLM parameters is expressed as…

Machine Learning · Statistics 2022-02-10 Juan Manuel Gorriz , SIPBA group , John Suckling

Many Machine Learning (ML) models are referred to as black box models, providing no real insights into why a prediction is made. Feature importance and explainability are important for increasing transparency and trust in ML models,…

Machine Learning · Computer Science 2024-05-16 Luke Power , Krishnendu Guha

Message importance measure (MIM) is applicable to characterize the importance of information in the scenario of big data, similar to entropy in information theory. In fact, MIM with a variable parameter can make an effect on the…

Information Theory · Computer Science 2024-04-08 Rui She , Shanyun Liu , Yunquan Dong , Pingyi Fan

While large transformer models excel in predictive performance, their lack of interpretability restricts their usefulness in high-stakes domains. To remedy this, we propose the Generalized Induction-Head Model (GIM), an interpretable model…

Computation and Language · Computer Science 2025-10-31 Eunji Kim , Sriya Mantena , Weiwei Yang , Chandan Singh , Sungroh Yoon , Jianfeng Gao

Variable importance is central to scientific studies, including the social sciences and causal inference, healthcare, and other domains. However, current notions of variable importance are often tied to a specific predictive model. This is…

Machine Learning · Statistics 2020-02-11 Jiayun Dong , Cynthia Rudin

Given a collection of features available for inclusion in a predictive model, it may be of interest to quantify the relative importance of a subset of features for the prediction task at hand. For example, in HIV vaccine trials, participant…

Methodology · Statistics 2025-03-27 Charles J. Wolock , Peter B. Gilbert , Noah Simon , Marco Carone

Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" features via permutation…