English
Related papers

Related papers: Toward Scalable and Valid Conditional Independence…

200 papers

A key property of neural networks (both biological and artificial) is how they learn to represent and manipulate input information in order to solve a task. Different types of representations may be suited to different types of tasks,…

Machine Learning · Computer Science 2023-07-18 Ryan Pyle , Sebastian Musslick , Jonathan D. Cohen , Ankit B. Patel

Conditional independence testing (CIT) is essential for reliable scientific discovery. It prevents spurious findings and enables controlled feature selection. Recent CIT methods have used machine learning (ML) models as surrogates of the…

Statistics Theory · Mathematics 2026-02-02 Angel Reyero-Lobo , Bertrand Thirion , Pierre Neuvial

Conditional mean independence (CMI) testing is crucial for statistical tasks including model determination and variable importance evaluation. In this work, we introduce a novel population CMI measure and a bootstrap-based testing procedure…

Machine Learning · Statistics 2025-01-30 Yi Zhang , Linjun Huang , Yun Yang , Xiaofeng Shao

Multimodal affective computing aims to predict humans' sentiment, emotion, intention, and opinion using language, acoustic, and visual modalities. However, current models often learn spurious correlations that harm generalization under…

Machine Learning · Computer Science 2026-04-21 Sijie Mai , Shiqin Han

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

Machine Learning · Statistics 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Constraint Programming (CP) has been successfully used to model and solve complex combinatorial problems. However, modeling is often not trivial and requires expertise, which is a bottleneck to wider adoption. In Constraint Acquisition…

Artificial Intelligence · Computer Science 2023-12-19 Dimos Tsouros , Senne Berden , Tias Guns

Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random…

Quantum Physics · Physics 2025-03-10 Yota Maeda , Hideaki Kawaguchi , Hiroyuki Tezuka

Estimating causal effects from observational data requires identifying valid adjustment sets. This task is especially challenging in realistic settings where latent confounding and feedback loops are present. Existing approaches typically…

Machine Learning · Computer Science 2026-05-08 Ana Leticia Garcez Vicente , Gijs van Seeventer , Saber Salehkaleybar

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Analyzing the covariance structure of data is a fundamental task of statistics. While this task is simple for low-dimensional observations, it becomes challenging for more intricate objects, such as multivariate functions. Here, the…

Methodology · Statistics 2023-01-12 Holger Dette , Gauthier Dierickx , Tim Kutta

Finding overcomplete latent representations of data has applications in data analysis, signal processing, machine learning, theoretical neuroscience and many other fields. In an overcomplete representation, the number of latent features…

Machine Learning · Computer Science 2021-06-10 Jesse A. Livezey , Alejandro F. Bujan , Friedrich T. Sommer

In this paper, we consider the problem of autonomous driving using imitation learning in a semi-supervised manner. In particular, both labeled and unlabeled demonstrations are leveraged during training by estimating the quality of each…

Robotics · Computer Science 2021-09-24 Gunmin Lee , Wooseok Oh , Seungyoun Shin , Dohyeong Kim , Jeongwoo Oh , Jaeyeon Jeong , Sungjoon Choi , Songhwai Oh

We propose an independence test for random variables valued into metric spaces by using a test statistic obtained from appropriately centering and rescaling the squared Hilbert-Schmidt norm of the usual empirical estimator of normalized…

Statistics Theory · Mathematics 2022-11-11 Terence Kevin Manfoumbi Djonguet , Guy Martial Nkiet

We study the problem of testing the null hypothesis that X and Y are conditionally independent given Z, where each of X, Y and Z may be functional random variables. This generalises testing the significance of X in a regression model of…

Statistics Theory · Mathematics 2023-09-27 Anton Rask Lundborg , Rajen D. Shah , Jonas Peters

Variable selection can be performed by testing conditional independence (CI) between each predictor and the response, given the other predictors. A doubly robust and powerful option for these CI tests is the projected covariance measure…

Methodology · Statistics 2025-11-10 Abhinav Chakraborty , Jeffrey Zhang , Eugene Katsevich

Conformal Prediction (CP) is a popular framework for constructing prediction bands with valid coverage in finite samples, while being free of any distributional assumption. A well-known limitation of conformal prediction is the lack of…

Machine Learning · Computer Science 2025-05-28 Louis Allain , Sébastien da Veiga , Brian Staber

Learning models that are robust to distribution shifts is a key concern in the context of their real-life applicability. Invariant Risk Minimization (IRM) is a popular framework that aims to learn robust models from multiple environments.…

Machine Learning · Computer Science 2023-04-04 Moulik Choraria , Ibtihal Ferwana , Ankur Mani , Lav R. Varshney

Aiming to generalize the label knowledge from a source domain with continuous outputs to an unlabeled target domain, Domain Adaptation Regression (DAR) is developed for complex practical learning problems. However, due to the continuity…

Machine Learning · Computer Science 2024-08-14 Hao-Ran Yang , Chuan-Xian Ren , You-Wei Luo

I introduce a temporal belief-network representation of causal independence that a knowledge engineer can use to elicit probabilistic models. Like the current, atemporal belief-network representation of causal independence, the new…

Artificial Intelligence · Computer Science 2015-05-19 David Heckerman