English
Related papers

Related papers: Revisiting the General Identifiability Problem

200 papers

In this paper, we study the accuracy of values aggregated over classes predicted by a classification algorithm. The problem is that the resulting aggregates (e.g., sums of a variable) are known to be biased. The bias can be large even for…

Machine Learning · Statistics 2019-12-02 Q. A. Meertens , C. G. H. Diks , H. J. van den Herik , F W Takes

Existing generalization theories analyze the generalization performance mainly based on the model complexity and training process. The ignorance of the task properties, which results from the widely used IID assumption, makes these theories…

Machine Learning · Computer Science 2019-12-02 Guanhua Zheng , Jitao Sang , Houqiang Li , Jian Yu , Changsheng Xu

Recently, Saeb et al (2017) showed that, in diagnostic machine learning applications, having data of each subject randomly assigned to both training and test sets (record-wise data split) can lead to massive underestimation of the…

We study the problem of causal effect identification from observational distribution given the causal graph and some context-specific independence (CSI) relations. It was recently shown that this problem is NP-hard, and while a sound…

Machine Learning · Computer Science 2022-02-18 Ehsan Mokhtarian , Fateme Jamshidi , Jalal Etesami , Negar Kiyavash

Data values in a dataset can be missing or anomalous due to mishandling or human error. Analysing data with missing values can create bias and affect the inferences. Several analysis methods, such as principle components analysis or…

Artificial Intelligence · Computer Science 2022-05-11 Sandeep Hans , Diptikalyan Saha , Aniya Aggarwal

Testing whether the observed data conforms to a purported model (probability distribution) is a basic and fundamental statistical task, and one that is by now well understood. However, the standard formulation, identity testing, fails to…

Statistics Theory · Mathematics 2021-05-06 Clément L. Canonne , Karl Wimmer

We reformulate Pearl's three rules of do-calculus in the language of completely positive (CP) trace-preserving maps, thereby extending them to quantum systems with entanglement. We prove that Rule~2 fails whenever the underlying process…

Quantum Physics · Physics 2025-08-08 Jordi Vallverdu

How are abstract concepts and musical themes recognized on the basis of some previous experience? It is interesting to compare the different behaviors of human and of artificial intelligences with respect to this problem. Generally, a human…

Machine Learning · Computer Science 2022-02-23 Maria Luisa Dalla Chiara , Roberto Giuntini , Eleonora Negri , Giuseppe Sergioli

Current face recognition systems robustly recognize identities across a wide variety of imaging conditions. In these systems recognition is performed via classification into known identities obtained from supervised identity annotations.…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Daniel C. Castro , Sebastian Nowozin

The central challenges in missing data models concern the identifiability of two distributions: the target law and the full law. The target law refers to the joint distribution of the data variables, whereas the full law refers to the joint…

Statistics Theory · Mathematics 2025-10-30 Juha Karvanen , Santtu Tikka

We address the general task of learning with a set of candidate models that is too large to have a uniform convergence of empirical estimates to true losses. While the common approach to such challenges is SRM (or regularization) based…

Machine Learning · Computer Science 2025-11-14 Alireza F. Pour , Shai Ben-David

We study the complexity of satisfiability problems in probabilistic and causal reasoning. Given random variables $X_1, X_2,\ldots$ over finite domains, the basic terms are probabilities of propositional formulas over atomic events $X_i =…

Computational Complexity · Computer Science 2025-04-29 Markus Bläser , Julian Dörfler , Maciej Liśkiewicz , Benito van der Zander

Learning about cause and effect is arguably the main goal in applied econometrics. In practice, the validity of these causal inferences is contingent on a number of critical assumptions regarding the type of data that has been collected and…

Econometrics · Economics 2023-03-03 Paul Hünermund , Elias Bareinboim

In this paper we introduce the so-called Generalized Naive Bayes structure as an extension of the Naive Bayes structure. We give a new greedy algorithm that finds a good fitting Generalized Naive Bayes (GNB) probability distribution. We…

Machine Learning · Statistics 2024-08-29 Edith Alice Kovács , Anna Ország , Dániel Pfeifer , András Benczúr

Observability is a fundamental structural property of any dynamic system and describes the possibility of reconstructing the state that characterizes the system from observing its inputs and outputs. Despite the huge effort made to study…

Optimization and Control · Mathematics 2022-03-31 Agostino Martinelli

Currently, there is renewed interest in the problem, raised by Shafer in 1985, of updating probabilities when observations are incomplete. This is a fundamental problem in general, and of particular interest for Bayesian networks. Recently,…

Artificial Intelligence · Computer Science 2007-05-23 Gert de Cooman , Marco Zaffalon

While person Re-identification (Re-ID) has progressed rapidly due to its wide real-world applications, it also causes severe risks of leaking personal information from training data. Thus, this paper focuses on quantifying this risk by…

Cryptography and Security · Computer Science 2024-03-21 Junyao Gao , Xinyang Jiang , Huishuai Zhang , Yifan Yang , Shuguang Dou , Dongsheng Li , Duoqian Miao , Cheng Deng , Cairong Zhao

Shared randomness is a valuable resource in distributed computing, allowing some form of coordination between processors without explicit communication. But what happens when the shared random string can affect the inputs to the system?…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-05 Adar Hadad , Moni Naor

The discussion on causality in human history dates back to ancient Greece, yet to this day, there is still no consensus. Fundamentally, this stems from the nature of human cognition, as understanding causality requires abstract tools to…

Artificial Intelligence · Computer Science 2024-03-19 Jiaxin Wang , YiLong Ma

We consider the problem of estimating the probability of an observed string drawn i.i.d. from an unknown distribution. The key feature of our study is that the length of the observed string is assumed to be of the same order as the size of…

Information Theory · Computer Science 2007-07-13 Aaron B. Wagner , Pramod Viswanath , Sanjeev R. Kulkarni