English
Related papers

Related papers: Causal Information Splitting: Engineering Proxy Fe…

200 papers

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

Robust planning in interactive scenarios requires predicting the uncertain future to make risk-aware decisions. Unfortunately, due to long-tail safety-critical events, the risk is often under-estimated by finite-sampling approximations of…

Machine Learning · Computer Science 2023-01-13 Haruki Nishimura , Jean Mercat , Blake Wulfe , Rowan McAllister , Adrien Gaidon

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

We study the problem of domain adaptation under distribution shift, where the shift is due to a change in the distribution of an unobserved, latent variable that confounds both the covariates and the labels. In this setting, neither the…

Conditional diffusion models serve as the foundation of modern image synthesis and find extensive application in fields like computational biology and reinforcement learning. In these applications, conditional diffusion models incorporate…

Machine Learning · Computer Science 2024-03-19 Hengyu Fu , Zhuoran Yang , Mengdi Wang , Minshuo Chen

Causal discovery problems use a set of observations to deduce causality between variables in the real world, typically to answer questions about biological or physical systems. These observations are often recorded at regular time…

Signal Processing · Electrical Eng. & Systems 2026-02-24 Kurt Butler , Damian Machlanski , Panagiotis Dimitrakopoulos , Sotirios A. Tsaftaris

A structural causal model is made of endogenous (manifest) and exogenous (latent) variables. We show that endogenous observations induce linear constraints on the probabilities of the exogenous variables. This allows to exactly map a causal…

Artificial Intelligence · Computer Science 2020-08-04 Marco Zaffalon , Alessandro Antonucci , Rafael Cabañas

What is the ideal regression (if any) for estimating average causal effects? We study this question in the setting of discrete covariates, deriving expressions for the finite-sample variance of various stratification estimators. This…

Methodology · Statistics 2022-09-26 P. Richard Hahn , Andrew Herren

The discovery of discriminatory bias in human or automated decision making is a task of increasing importance and difficulty, exacerbated by the pervasive use of machine learning and data mining. Currently, discrimination discovery largely…

Computers and Society · Computer Science 2019-11-05 Bilal Qureshi , Faisal Kamiran , Asim Karim , Salvatore Ruggieri , Dino Pedreschi

Multimodal distributions of some physics based model parameters are often encountered in engineering due to different situations such as a change in some environmental conditions, and the presence of some types of damage and nonlinearity.…

Computation · Statistics 2022-10-19 Felipe Igea , Alice Cicirello

A major barrier to deploying current machine learning models lies in their non-reliability to dataset shifts. To resolve this problem, most existing studies attempted to transfer stable information to unseen environments. Particularly,…

Machine Learning · Statistics 2023-05-31 Mingzhou Liu , Xiangyu Zheng , Xinwei Sun , Fang Fang , Yizhou Wang

Extraneous variables are variables that are irrelevant for a certain task, but heavily affect the distribution of the available data. In this work, we show that the presence of such variables can degrade the performance of deep-learning…

Machine Learning · Computer Science 2020-02-27 Aakash Kaku , Sreyas Mohan , Avinash Parnandi , Heidi Schambra , Carlos Fernandez-Granda

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

We study the problem of learning fair prediction models for unseen test sets distributed differently from the train set. Stability against changes in data distribution is an important mandate for responsible deployment of models. The domain…

Machine Learning · Computer Science 2021-01-26 Harvineet Singh , Rina Singh , Vishwali Mhasawade , Rumi Chunara

Identifying causal effects in the presence of unmeasured variables is a fundamental challenge in causal inference, for which proxy variable methods have emerged as a powerful solution. We contrast two major approaches in this framework: (1)…

Methodology · Statistics 2026-05-12 Helen Guo , Elizabeth L. Ogburn , Ilya Shpitser

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

We propose a framework for analyzing the sensitivity of counterfactuals to parametric assumptions about the distribution of latent variables in structural models. In particular, we derive bounds on counterfactuals as the distribution of…

Econometrics · Economics 2024-03-26 Timothy Christensen , Benjamin Connault

Knowing the features of a complex system that are highly relevant to a particular target variable is of fundamental interest in many areas of science. Existing approaches are often limited to linear settings, sometimes lack guarantees, and…

Machine Learning · Computer Science 2023-07-06 Francesco Quinzan , Ashkan Soleymani , Patrick Jaillet , Cristian R. Rojas , Stefan Bauer

Experimental data is often comprised of variables measured independently, at different sampling rates (non-uniform ${\Delta}$t between successive measurements); and at a specific time point only a subset of all variables may be sampled.…

Machine Learning · Computer Science 2023-05-01 Saurabh Malani , Tom S. Bertalan , Tianqi Cui , Jose L. Avalos , Michael Betenbaugh , Ioannis G. Kevrekidis