English
Related papers

Related papers: A general framework for inference on algorithm-agn…

200 papers

Variable importance is defined as a measure of each regressor's contribution to model fit. Using R^2 as the fit criterion in linear models leads to the Shapley value (LMG) and proportionate value (PMVD) as variable importance measures.…

Methodology · Statistics 2022-12-08 Charles D. Coleman

Model agnostic feature attribution algorithms (such as SHAP and LIME) are ubiquitous techniques for explaining the decisions of complex classification models, such as deep neural networks. However, since complex classification models…

Machine Learning · Computer Science 2022-11-29 Ron Bitton , Alon Malach , Amiel Meiseles , Satoru Momiyama , Toshinori Araki , Jun Furukawa , Yuval Elovici , Asaf Shabtai

Identifiability is a structural property of any ODE model characterized by a set of unknown parameters. It describes the possibility of determining the values of these parameters from fusing the observations of the system inputs and…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Agostino Martinelli

Missing data is an universal problem in statistics. We develop a unified framework for estimating parameters defined by general estimating equations under a missing-at-random (MAR) mechanism, based on generalized entropy calibration…

Methodology · Statistics 2026-03-31 Mst Moushumi Pervin , Hengfang Wang , Jae Kwang Kim

Statistical models are central to machine learning with broad applicability across a range of downstream tasks. The models are controlled by free parameters that are typically estimated from data by maximum-likelihood estimation or…

Machine Learning · Computer Science 2023-08-16 Vaidotas Simkus , Benjamin Rhodes , Michael U. Gutmann

The empirical likelihood is a powerful nonparametric tool, that emulates its parametric counterpart -- the parametric likelihood -- preserving many of its large-sample properties. This article tackles the problem of assessing the…

Methodology · Statistics 2023-05-29 Duc-Khanh To , Gianfranco Adimari , Monica Chiogna

In constructing an econometric or statistical model, we pick relevant features or variables from many candidates. A coalitional game is set up to study the selection problem where the players are the candidates and the payoff function is a…

Machine Learning · Statistics 2021-10-07 Xingwei Hu

The American Statistical Association (ASA) statement on statistical significance and P-values \cite{wasserstein2016asa} cautioned statisticians against making scientific decisions solely on the basis of traditional P-values. The statement…

Methodology · Statistics 2024-02-22 Abhisek Chakraborty , Megan H. Murray , Ilya Lipkovich , Yu Du

A fundamental task in statistical learning is quantifying the joint dependence or association between two continuous random variables. We introduce a novel, fully non-parametric measure that assesses the degree of association between…

In high-dimensional linear models, the sparsity assumption is typically made, stating that most of the parameters are equal to zero. Under the sparsity assumption, estimation and, recently, inference have been well studied. However, in…

Methodology · Statistics 2019-07-09 Yinchu Zhu , Jelena Bradic

This article investigates nonparametric estimation of variance functions for functional data when the mean function is unknown. We obtain asymptotic results for the kernel estimator based on squared residuals. Similar to the finite…

Methodology · Statistics 2008-12-16 Heng Lian

Machine learning is central to modern science, industry, and policy, yet its predictive power often comes at the cost of transparency: we rarely know which input features truly drive a model's predictions. Without such understanding,…

Machine Learning · Statistics 2026-04-03 Kay Giesecke , Enguerrand Horel , Chartsiri Jirachotkulthorn

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Forensic examination of evidence like firearms and toolmarks, traditionally involves a visual and therefore subjective assessment of similarity of two questioned items. Statistical models are used to overcome this subjectivity and allow…

Human-Computer Interaction · Computer Science 2021-11-03 Ganesh Krishnan , Heike Hofmann

This paper proposes a variance-based measure of importance for coherent systems with dependent and heterogeneous components. The particular cases of independent components and homogeneous components are also considered. We model the…

Applications · Statistics 2024-09-30 Antonio Arriaza , Jorge Navarro , Miguel Angel Sordo , Alfonso Suárez-Llorens

Estimating prevalence, the fraction of a population with a certain medical condition, is fundamental to epidemiology. Traditional methods rely on classification of test samples taken at random from a population. Such approaches to…

Methodology · Statistics 2022-03-25 Paul Patrone , Anthony Kearsley

Variable selection comprises an important step in many modern statistical inference procedures. In the regression setting, when estimators cannot shrink irrelevant signals to zero, covariates without relationships to the response often…

Statistics Theory · Mathematics 2025-03-28 Ka Long Keith Ho , Hien Duy Nguyen

In the 70s a novel branch of statistics emerged focusing its effort in selecting a function in the pattern recognition problem, which fulfils a definite relationship between the quality of the approximation and its complexity. These…

Machine Learning · Statistics 2022-02-10 J M Gorriz , SiPBA Group , CAM neuroscience

Statistical inference on histograms and frequency counts plays a central role in categorical data analysis. Moving beyond classical methods that directly analyze labeled frequencies, we introduce a framework that models the multiset of…

Statistics Theory · Mathematics 2025-11-10 Yun Ma , Pengkun Yang

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia