English
Related papers

Related papers: Lower Bounds on Information Requirements for Causa…

200 papers

Causal discovery from i.i.d. observational data is known to be generally ill-posed. We demonstrate that if we have access to the distribution {induced} by a structural causal model, and additional data from (in the best case) \textit{only…

Machine Learning · Statistics 2026-05-15 Francesco Montagna

We consider the problem of estimating a signal corrupted by independent interference with the assistance of a cost-constrained helper who knows the interference causally or noncausally. When the interference is known causally, we…

Information Theory · Computer Science 2012-03-21 Yeow-Khiang Chia , Rajiv Soundararajan , Tsachy Weissman

Structural causal models postulate noisy functional relations among a set of interacting variables. The causal structure underlying each such model is naturally represented by a directed graph whose edges indicate for each variable which…

Statistics Theory · Mathematics 2022-03-15 David Strieder , Tobias Freidling , Stefan Haffner , Mathias Drton

One of the common obstacles for learning causal models from data is that high-order conditional independence (CI) relationships between random variables are difficult to estimate. Since CI tests with conditioning sets of low order can be…

Machine Learning · Computer Science 2020-10-07 Marcel Wienöbst , Maciej Liśkiewicz

We prove three new lower bounds for graph connectivity in the $1$-bit broadcast congested clique model, BCC$(1)$. First, in the KT-$0$ version of BCC$(1)$, in which nodes are aware of neighbors only through port numbers, we show an…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-23 Shreyas Pai , Sriram V. Pemmaraju

There are several existing algorithms that under appropriate assumptions can reliably identify a subset of the underlying causal relationships from observational data. This paper introduces the first computationally feasible score-based…

Artificial Intelligence · Computer Science 2012-07-02 Subramani Mani , Peter L. Spirtes , Gregory F. Cooper

The correlations that can be observed between a set of variables depend on the causal structure underpinning them. Causal structures can be modeled using directed acyclic graphs, where nodes represent variables and edges denote functional…

Quantum Physics · Physics 2015-01-08 Rafael Chaves , Christian Majenz , David Gross

Recovering a unique causal graph from observational data is an ill-posed problem because multiple generating mechanisms can lead to the same observational distribution. This problem becomes solvable only by exploiting specific structural or…

Machine Learning · Computer Science 2026-02-09 Ameya Rathod , Sujay Belsare , Salvik Krishna Nautiyal , Dhruv Laad , Ponnurangam Kumaraguru

We propose a new Bayesian Neural Net formulation that affords variational inference for which the evidence lower bound is analytically tractable subject to a tight approximation. We achieve this tractability by (i) decomposing ReLU…

Machine Learning · Statistics 2019-06-13 Manuel Haussmann , Fred A. Hamprecht , Melih Kandemir

We consider the task of estimating a high-dimensional directed acyclic graph, given observations from a linear structural equation model with arbitrary noise distribution. By exploiting properties of common random graphs, we develop a new…

Machine Learning · Statistics 2019-12-30 Arjun Sondhi , Ali Shojaie

In recent years, with the increase in renewable energy and storage penetration, power flow studies in low-voltage networks have become of interest in both industry and academia. Many studies use impedance represented by sequence components…

Optimization and Control · Mathematics 2025-06-10 Ching Hong Tam , Frederik Geth , Nadarajah Mithulananthan

Causal discovery between collections of time-series data can help diagnose causes of symptoms and hopefully prevent faults before they occur. However, reliable causal discovery can be very challenging, especially when the data acquisition…

Machine Learning · Computer Science 2023-01-12 Haonan Chen , Bo Yuan Chang , Mohamed A. Naiel , Georges Younes , Steven Wardell , Stan Kleinikkink , John S. Zelek

Causal discovery from observational data is an important tool in many branches of science. Under certain assumptions it allows scientists to explain phenomena, predict, and make decisions. In the large sample limit, sound and complete…

Machine Learning · Statistics 2021-07-13 Shami Nisimov , Yaniv Gurwicz , Raanan Y. Rohekar , Gal Novik

The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower…

Information Theory · Computer Science 2009-11-05 Gongguo Tang , Arye Nehorai

The sample complexity of estimating or maximising an unknown function in a reproducing kernel Hilbert space is known to be linked to both the effective dimension and the information gain associated with the kernel. While the information…

Machine Learning · Statistics 2026-01-16 Hamish Flynn

We present deterministic techniques for computing upper and lower bounds on marginal probabilities in sigmoid and noisy-OR networks. These techniques become useful when the size of the network (or clique size) precludes exact computations.…

Artificial Intelligence · Computer Science 2013-02-18 Tommi S. Jaakkola , Michael I. Jordan

Causal discovery aims to uncover cause-and-effect relationships encoded in causal graphs by leveraging observational, interventional data, or their combination. The majority of existing causal discovery methods are developed assuming…

Machine Learning · Computer Science 2024-06-25 Muhammad Qasim Elahi , Lai Wei , Murat Kocaoglu , Mahsa Ghasemi

Analysing statistical properties of neural networks is a central topic in statistics and machine learning. However, most results in the literature focus on the properties of the neural network minimizing the training error. The goal of this…

Statistics Theory · Mathematics 2022-02-04 Laura Tinsi , Arnak S. Dalalyan

Causal graph discovery is a significant problem with applications across various disciplines. However, with observational data alone, the underlying causal graph can only be recovered up to its Markov equivalence class, and further…

Machine Learning · Computer Science 2024-02-14 Davin Choo , Kirankumar Shiragur , Caroline Uhler

Increasingly, there is a marked interest in estimating causal effects under network interference due to the fact that interference manifests naturally in networked experiments. However, network information generally is available only up to…

Methodology · Statistics 2022-09-02 Wenrui Li , Daniel L. Sussman , Eric D. Kolaczyk