English
Related papers

Related papers: Valid Feature-Level Inference for Tabular Foundati…

200 papers

For testing conditional independence (CI) of a response Y and a predictor X given covariates Z, the recently introduced model-X (MX) framework has been the subject of active methodological research, especially in the context of MX knockoffs…

Statistics Theory · Mathematics 2022-11-01 Eugene Katsevich , Aaditya Ramdas

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality training data, most…

Machine Learning · Computer Science 2022-04-01 Sainyam Galhotra , Karthikeyan Shanmugam , Prasanna Sattigeri , Kush R. Varshney

Association Rule Mining (ARM) is a fundamental task for knowledge discovery in tabular data and is widely used in high-stakes decision-making. Classical ARM methods rely on frequent itemset mining, leading to rule explosion and poor…

Artificial Intelligence · Computer Science 2026-02-18 Erkan Karabulut , Daniel Daza , Paul Groth , Martijn C. Schut , Victoria Degeler

We consider testing multivariate conditional independence between a response Y and a covariate vector X given additional variables Z. We introduce the Multivariate Sufficient Statistic Conditional Randomization Test (MS-CRT), which…

Methodology · Statistics 2025-04-10 Xiaotong Lin , Jie Xie , Fangqiao Tian , Dongming Huang

Machine learning (ML) systems are utilized in critical sectors, such as healthcare, law enforcement, and finance. However, these systems are often trained on historical data that contains demographic biases, leading to ML decisions that…

Machine Learning · Computer Science 2025-06-10 Jake Robertson , Noah Hollmann , Samuel Müller , Noor Awad , Frank Hutter

Recent Tabular Foundation Models (TFMs) have demonstrated state-of-the-art predictive performance, often surpassing Gradient-Boosted Decision Trees (GBDTs). However, the trustworthiness of these models, particularly their uncertainty…

Machine Learning · Computer Science 2026-05-28 José Lucas De Melo Costa , Fabrice Popineau , Arpad Rimmel , Bich-Liên Doan

In text classification tasks, models often rely on spurious correlations for predictions, incorrectly associating irrelevant features with the target labels. This issue limits the robustness and generalization of models, especially when…

Machine Learning · Computer Science 2025-02-04 Yuqing Zhou , Ziwei Zhu

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

Methodology · Statistics 2021-05-14 David S. Watson , Marvin N. Wright

The model-X conditional randomization test is a generic framework for conditional independence testing, unlocking new possibilities to discover features that are conditionally associated with a response of interest while controlling type-I…

Machine Learning · Computer Science 2023-02-21 Shalev Shaer , Yaniv Romano

This study proposed an exhaustive stable/reproducible rule-mining algorithm combined to a classifier to generate both accurate and interpretable models. Our method first extracts rules (i.e., a conjunction of conditions about the values of…

Machine Learning · Computer Science 2017-07-03 Margaux Luck , Nicolas Pallet , Cecilia Damon

It is often critical for prediction models to be robust to distributional shifts between training and testing data. From a causal perspective, the challenge is to distinguish the stable causal relationships from the unstable spurious…

Machine Learning · Computer Science 2021-01-15 Shuxi Zeng , Murat Ali Bayir , Joesph J. Pfeiffer , Denis Charles , Emre Kiciman

We consider the problem of conditional independence testing: given a response Y and covariates (X,Z), we test the null hypothesis that Y is independent of X given Z. The conditional randomization test (CRT) was recently proposed as a way to…

Methodology · Statistics 2021-06-07 Molei Liu , Eugene Katsevich , Lucas Janson , Aaditya Ramdas

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

Estimation of causal effects is critical to a range of scientific disciplines. Existing methods for this task either require interventional data, knowledge about the ground truth causal graph, or rely on assumptions such as…

Machine Learning · Computer Science 2025-11-21 Jake Robertson , Arik Reuter , Siyuan Guo , Noah Hollmann , Frank Hutter , Bernhard Schölkopf

We consider statistical hypothesis testing simultaneously over a fairly general, possibly uncountably infinite, set of null hypotheses, under the assumption that a suitable single test (and corresponding $p$-value) is known for each…

Methodology · Statistics 2014-02-10 Gilles Blanchard , Sylvain Delattre , Etienne Roquain

While precise data observation is essential for the learning processes of predictive models, it can be challenging owing to factors such as insufficient observation accuracy, high collection costs, and privacy constraints. In this paper, we…

Machine Learning · Computer Science 2024-09-18 Kosuke Sugiyama , Masato Uchida

Inference from tabular data, collections of continuous and categorical variables organized into matrices, is a foundation for modern technology and science. Yet, in contrast to the explosive changes in the rest of AI, the best practice for…

Machine Learning · Computer Science 2026-04-07 Daniel Beaglehole , David Holzmüller , Adityanarayanan Radhakrishnan , Mikhail Belkin

Robust validation of Machine Learning (ML) models is essential, but traditional data partitioning approaches often ignore the intrinsic quality of each instance. This study proposes the use of Item Response Theory (IRT) parameters to…

Machine Learning · Computer Science 2025-08-15 Lucas Cardoso , Vitor Santos , José Ribeiro Filho , Ricardo Prudêncio , Regiane Kawasaki , Ronnie Alves

The gold standard for causal model evaluation involves comparing model predictions with true effects estimated from randomized controlled trials (RCT). However, RCTs are not always feasible or ethical to perform. In contrast, conditionally…

Machine Learning · Computer Science 2023-11-06 Chao Ma , Cheng Zhang

We consider the problem of validating whether a neural posterior estimate \( q(\theta \mid x) \) is an accurate approximation to the true, unknown true posterior \( p(\theta \mid x) \). Existing methods for evaluating the quality of an NPE…

Machine Learning · Statistics 2025-07-24 Tianyu Chen , Vansh Bansal , James G. Scott