English
Related papers

Related papers: Conditional Feature Importance revisited: Double R…

200 papers

The standard constraint-based paradigm for causal discovery with incomplete data -- impute first, test second -- is frequently miscalibrated: any consistent conditional independence (CI) test rejects a true null with probability approaching…

Methodology · Statistics 2026-05-07 Thomas S. Robinson , Ranjit Lall

We propose a test of the conditional independence of random variables $X$ and~$Y$ given~$Z$ under the additional assumption that $X$ is stochastically nondecreasing in~$Z$. The well-documented hardness of testing conditional independence…

Methodology · Statistics 2026-04-24 Rohan Hore , Jake A. Soloff , Rina Foygel Barber , Richard J. Samworth

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

The principal contribution of this paper is a conceptual framework for off-policy reinforcement learning, based on conditional expectations of importance sampling ratios. This framework yields new perspectives and understanding of existing…

Machine Learning · Computer Science 2020-07-31 Mark Rowland , Anna Harutyunyan , Hado van Hasselt , Diana Borsa , Tom Schaul , Rémi Munos , Will Dabney

This paper develops a novel nonparametric significance test based on a tailored nonparametric-type projected weighting function that exhibits appealing theoretical and numerical properties. We derive the asymptotic properties of the…

Econometrics · Economics 2026-02-18 Xiaojun Song , Jichao Yuan

We propose conditional PED-ANOVA (condPED-ANOVA), a principled framework for estimating hyperparameter importance (HPI) in conditional search spaces, where the presence or domain of a hyperparameter can depend on other hyperparameters.…

Machine Learning · Computer Science 2026-02-10 Kaito Baba , Yoshihiko Ozaki , Shuhei Watanabe

Conditional independence, and more generally conditional mutual independence, are central notions in probability theory. In their general forms, they include functional dependence as a special case. In this paper, we tackle two fundamental…

Probability · Mathematics 2026-03-24 Laigang Guo , Raymond W. Yeung , Tao Guo

Confidence intervals (CIs) are instrumental in statistical analysis, providing a range estimate of the parameters. In modern statistics, selective inference is common, where only certain parameters are highlighted. However, this selective…

Methodology · Statistics 2025-09-17 Tzviel Frostig , Yoav Benjamini , Ruth Heller

Sensitivity indices are commonly used to quantify the relative influence of any specific group of input variables on the output of a computer code. One crucial question is then to decide whether a given set of variables has a significant…

Statistics Theory · Mathematics 2022-04-05 Thierry Klein , Nicolas Peteilh , Paul Rochet

Sufficiency, Conditionality and Invariance are basic principles of statistical inference. Current mathematical statistics courses do not devote much teaching time to these classical principles, and even ignore the latter two, in order to…

Statistics Theory · Mathematics 2018-11-20 Micha Mandel

We propose a symbolic representation for support vector machines (SVMs) by means of abstract interpretation, a well-known and successful technique for designing and implementing static program analyses. We leverage this abstraction in two…

Machine Learning · Computer Science 2022-10-25 Abhinandan Pal , Francesco Ranzato , Caterina Urban , Marco Zanella

The inferential model (IM) framework provides valid prior-free probabilistic inference by focusing on predicting unobserved auxiliary variables. But, efficient IM-based inference can be challenging when the auxiliary variable is of higher…

Statistics Theory · Mathematics 2015-01-20 Ryan Martin , Chuanhai Liu

Deep models produce a number of features in each internal layer. A key problem in applications such as feature compression for remote inference is determining how important each feature is for the task(s) performed by the model. The problem…

Image and Video Processing · Electrical Eng. & Systems 2024-05-16 Saeed Ranjbar Alvar , Ivan V. Bajić

Conditional effect estimation has great scientific and policy importance because interventions may impact subjects differently depending on their characteristics. Most research has focused on estimating the conditional average treatment…

Methodology · Statistics 2023-04-25 Alec McClean , Zach Branson , Edward H. Kennedy

Conditional selective inference (SI) has been studied intensively as a new statistical inference framework for data-driven hypotheses. The basic concept of conditional SI is to make the inference conditional on the selection event, which…

Machine Learning · Statistics 2022-12-15 Vo Nguyen Le Duy , Ichiro Takeuchi

Evaluating the performance of an algorithm is crucial. Evaluating the performance of data imputation and data augmentation can be similar since both generated data can be compared with an original distribution. Although, the typical…

Machine Learning · Computer Science 2022-06-22 Jean-Sébastien Dessureault , Daniel Massicotte

Testing the significance of a variable or group of variables $X$ for predicting a response $Y$, given additional covariates $Z$, is a ubiquitous task in statistics. A simple but common approach is to specify a linear model, and then test…

Statistics Theory · Mathematics 2024-05-08 Anton Rask Lundborg , Ilmun Kim , Rajen D. Shah , Richard J. Samworth

The Influence Function (IF) is a widely used technique for assessing the impact of individual training samples on model predictions. However, existing IF methods often fail to provide reliable influence estimates in deep neural networks,…

Machine Learning · Computer Science 2025-12-02 Xichen Ye , Yifan Wu , Weizhong Zhang , Cheng Jin , Yifan Chen

Mutual information is fundamentally important for measuring statistical dependence between variables and for quantifying information transfer by signaling and communication mechanisms. It can, however, be challenging to evaluate for…

Information Theory · Computer Science 2014-07-29 Clive G. Bowsher , Margaritis Voliotis

Simulation-based inference (SBI) is constantly in search of more expressive and efficient algorithms to accurately infer the parameters of complex simulation models. In line with this goal, we present consistency models for posterior…

Machine Learning · Computer Science 2024-11-05 Marvin Schmitt , Valentin Pratz , Ullrich Köthe , Paul-Christian Bürkner , Stefan T Radev