English
Related papers

Related papers: Revisiting the General Identifiability Problem

200 papers

Generalizing empirical findings to new environments, settings, or populations is essential in most scientific explorations. This article treats a particular problem of generalizability, called "transportability", defined as a license to…

Artificial Intelligence · Computer Science 2014-01-03 Elias Bareinboim , Judea Pearl

Causal inference revealing causal dependencies between variables from empirical data has found applications in multiple sub-fields of scientific research. A quantum perspective of correlations holds the promise of overcoming the limitation…

We propose a new family of fairness definitions for classification problems that combine some of the best properties of both statistical and individual notions of fairness. We posit not only a distribution over individuals, but also a…

Machine Learning · Computer Science 2019-12-18 Michael Kearns , Aaron Roth , Saeed Sharifi-Malvajerdi

We study the problem of ignorability in likelihood-based inference from incomplete categorical data. Two versions of the coarsened at random assumption (car) are distinguished, their compatibility with the parameter distinctness assumption…

Statistics Theory · Mathematics 2007-06-13 Manfred Jaeger

We address the problem of estimating the effect of intervening on a set of variables X from experiments on a different set, Z, that is more accessible to manipulation. This problem, which we call z-identifiability, reduces to ordinary…

Artificial Intelligence · Computer Science 2012-10-19 Elias Bareinboim , Judea Pearl

Generalized latent factor analysis not only provides a useful latent embedding approach in statistics and machine learning, but also serves as a widely used tool across various scientific fields, such as psychometrics, econometrics, and…

Methodology · Statistics 2025-08-11 Chengyu Cui , Gongjun Xu

Re-identification algorithms are used in data privacy to measure disclosure risk. They model the situation in which an adversary attacks a published database by means of linking the information of this adversary with the database. In this…

Cryptography and Security · Computer Science 2013-01-23 Vicenç Torra , Klara Stokes

The algorithmic theory of randomness is well developed when the underlying space is the set of finite or infinite sequences and the underlying probability distribution is the uniform distribution or a computable distribution. These…

Computational Complexity · Computer Science 2016-08-31 Peter Gacs

The ID algorithm solves the problem of identification of interventional distributions of the form p(Y | do(a)) in graphical causal models, and has been formulated in a number of ways [12, 9, 6]. The ID algorithm is sound (outputs the…

Methodology · Statistics 2023-07-10 Ilya Shpitser

This paper focuses on causal representation learning (CRL) under a general nonparametric latent causal model and a general transformation model that maps the latent data to the observational data. It establishes identifiability and…

Machine Learning · Computer Science 2024-02-15 Burak Varıcı , Emre Acartürk , Karthikeyan Shanmugam , Ali Tajer

We propose a new modeling approach that is a generalization of generative and discriminative models. The core idea is to use an implicit parameterization of a joint probability distribution by specifying only the conditional distributions.…

Machine Learning · Computer Science 2016-12-06 Dmitrij Schlesinger , Carsten Rother

In forensics it is a classical problem to determine, when a suspect $S$ shares a property $\Gamma$ with a criminal $C$, the probability that $S=C$. In this paper we give a detailed account of this problem in various degrees of generality.…

Probability · Mathematics 2012-01-24 Klaas Slooten , Ronald Meester

Deepfake detection models face two critical challenges: generalization to unseen manipulations and demographic fairness among population groups. However, existing approaches often demonstrate that these two objectives are inherently…

Machine Learning · Computer Science 2025-07-04 Harry Cheng , Ming-Hui Liu , Yangyang Guo , Tianyi Wang , Liqiang Nie , Mohan Kankanhalli

Interpretability research on large language models (LLMs) has yielded important insights into model behaviour, yet recurring pitfalls persist: findings that do not generalise, and causal interpretations that outrun the evidence. Our…

Machine Learning · Computer Science 2026-03-20 Shruti Joshi , Aaron Mueller , David Klindt , Wieland Brendel , Patrik Reizinger , Dhanya Sridhar

Repeated use of a data sample via adaptively chosen queries can rapidly lead to overfitting, wherein the empirical evaluation of queries on the sample significantly deviates from their mean with respect to the underlying data distribution.…

Machine Learning · Computer Science 2024-04-26 Moshe Shenfeld , Katrina Ligett

The concept of causality has a controversial history. The question of whether it is possible to represent and address causal problems with probability theory, or if fundamentally new mathematics such as the do-calculus is required has been…

Machine Learning · Statistics 2019-10-22 Finnian Lattimore , David Rohde

Causal inference quantifies cause-effect relationships by estimating counterfactual parameters from data. This entails using \emph{identification theory} to establish a link between counterfactual parameters of interest and distributions…

Machine Learning · Statistics 2020-04-17 Jaron J. R. Lee , Ilya Shpitser

This paper examines the classical matching distribution arising in the "problem of coincidences". We generalise the classical matching distribution with a preliminary round of allocation where items are correctly matched with some fixed…

Other Statistics · Statistics 2021-12-24 Ben O'Neill

Principal stratification is a general framework for studying causal mechanisms involving post-treatment variables. When estimating principal causal effects, the principal ignorability assumption is commonly invoked, which we study in detail…

Methodology · Statistics 2026-04-21 Minxuan Wu , Joseph Antonelli

This thesis scrutinizes common assumptions underlying traditional machine learning approaches to fairness in consequential decision making. After challenging the validity of these assumptions in real-world applications, we propose ways to…

Machine Learning · Computer Science 2021-02-01 Niki Kilbertus