English
Related papers

Related papers: Lower Bounds on Information Requirements for Causa…

200 papers

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor

This paper proposes a new algorithm for recovery of belief network structure from data handling hidden variables. It consists essentially in an extension of the CI algorithm of Spirtes et al. by restricting the number of conditional…

Artificial Intelligence · Computer Science 2017-07-03 Mieczysław A. Kłopotek

We introduce a unified framework for contextual and causal Bayesian optimisation, which aims to design intervention policies maximising the expectation of a target variable. Our approach leverages both observed contextual information and…

Machine Learning · Computer Science 2026-02-04 Vahan Arsenyan , Antoine Grosnit , Haitham Bou-Ammar , Arnak Dalalyan

Most existing debiasing methods for multimodal models, including causal intervention and inference methods, utilize approximate heuristics to represent the biases, such as shallow features from early stages of training or unimodal features…

Machine Learning · Computer Science 2023-11-29 Vaidehi Patil , Adyasha Maharana , Mohit Bansal

Bayesian coresets speed up posterior inference in the large-scale data regime by approximating the full-data log-likelihood function with a surrogate log-likelihood based on a small, weighted subset of the data. But while Bayesian coresets…

Machine Learning · Statistics 2024-10-18 Trevor Campbell

Telling apart the cause and effect between two random variables with purely observational data is a challenging problem that finds applications in various scientific disciplines. A key principle utilized in this task is the algorithmic…

Machine Learning · Computer Science 2025-08-15 Quang-Duy Tran , Bao Duong , Phuoc Nguyen , Thin Nguyen

Network topology inference is a fundamental problem in many applications of network science, such as locating the source of fake news, brain connectivity networks detection, etc. Many real-world situations suffer from a critical problem…

Applications · Statistics 2022-06-22 Yupeng Chen , Zhiguo Wang , Xiaojing Shen

Network interference occurs when treatments assigned to some units affect the outcomes of others. Traditional approaches often assume that the observed network correctly specifies the interference structure. However, in practice,…

Methodology · Statistics 2026-02-04 Bar Weinstein , Daniel Nevo

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

Machine Learning · Computer Science 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

We provide a unified treatment of a broad class of noisy structure recovery problems, known as structured normal means problems. In this setting, the goal is to identify, from a finite collection of Gaussian distributions with different…

Machine Learning · Statistics 2016-01-27 Akshay Krishnamurthy

The receiver operating characteristic curve is widely applied in measuring the performance of diagnostic tests. Many direct and indirect approaches have been proposed for modelling the ROC curve, and because of its tractability, the…

Methodology · Statistics 2017-10-09 Amay Cheam , Paul D. McNicholas

Information causality was proposed as a physical principle to put upper bound on the accessible information gain in a physical bi-partite communication scheme. Intuitively, the information gain cannot be larger than the amount of classical…

Quantum Physics · Physics 2015-07-27 I-Ching Yu , Feng-Li Lin

We present a sound and complete algorithm, called iterative causal discovery (ICD), for recovering causal graphs in the presence of latent confounders and selection bias. ICD relies on the causal Markov and faithfulness assumptions and…

Machine Learning · Computer Science 2022-01-19 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

We develop a principled framework for discovering causal structure in partial differential equations (PDEs) using physics-informed neural networks and counterfactual perturbations. Unlike classical residual minimization or sparse regression…

Machine Learning · Computer Science 2025-06-26 Ronald Katende

The Cram\'er-Rao bound (CRB), a well-known lower bound on the performance of any unbiased parameter estimator, has been used to study a wide variety of problems. However, to obtain the CRB, requires an analytical expression for the…

Machine Learning · Computer Science 2022-10-11 Hai Victor Habi , Hagit Messer , Yoram Bresler

Promising results have driven a recent surge of interest in continuous optimization methods for Bayesian network structure learning from observational data. However, there are theoretical limitations on the identifiability of underlying…

We consider the problem of estimating the underlying graph associated with a Markov random field, with the added twist that the decoding algorithm can iteratively choose which subsets of nodes to sample based on the previous samples,…

Information Theory · Computer Science 2017-02-08 Jonathan Scarlett , Volkan Cevher

We consider the problem of approximating a function in general nonlinear subsets of $L^2$ when only a weighted Monte Carlo estimate of the $L^2$-norm can be computed. Of particular interest in this setting is the concept of sample…

Numerical Analysis · Mathematics 2021-08-12 Philipp Trunschke

Uncovering causal relationships is a fundamental problem across science and engineering. However, most existing causal discovery methods assume acyclicity and direct access to the system variables -- assumptions that fail to hold in many…

Machine Learning · Computer Science 2026-03-24 Muralikrishnna G. Sethuraman , Faramarz Fekri

We study the problem of learning the causal relationships between a set of observed variables in the presence of latents, while minimizing the cost of interventions on the observed variables. We assume access to an undirected graph $G$ on…

Data Structures and Algorithms · Computer Science 2020-12-29 Raghavendra Addanki , Andrew McGregor , Cameron Musco