English
Related papers

Related papers: Causal Discovery using Compression-Complexity Meas…

200 papers

Much of the causal discovery literature prioritises guaranteeing the identifiability of causal direction in statistical models. For structures within a Markov equivalence class, this requires strong assumptions which may not hold in…

Machine Learning · Statistics 2024-05-29 Anish Dhir , Samuel Power , Mark van der Wilk

Scientific practice typically involves repeatedly studying a system, each time trying to unravel a different perspective. In each study, the scientist may take measurements under different experimental conditions (interventions,…

Machine Learning · Statistics 2014-03-11 Sofia Triantafillou , Ioannis Tsamardinos

In compressed sensing (CS) framework, a signal is sampled below Nyquist rate, and the acquired compressed samples are generally random in nature. However, for efficient estimation of the actual signal, the sensing matrix must preserve the…

Information Theory · Computer Science 2015-07-28 V. Abrol , P. Sharma , A. K Sao

Algorithms for constraint-based causal discovery select graphical causal models among a space of possible candidates (e.g., all directed acyclic graphs) by executing a sequence of conditional independence tests. These may be used to inform…

Methodology · Statistics 2025-09-19 Ting-Hsuan Chang , Zijian Guo , Daniel Malinsky

Inferring the causal structure of a set of random variables from a finite sample of the joint distribution is an important problem in science. Recently, methods using additive noise models have been suggested to approach the case of…

Machine Learning · Statistics 2012-07-24 Jonas Peters , Dominik Janzing , Bernhard Schölkopf

Providing extensive context via prompting is vital for leveraging the capabilities of Large Language Models (LLMs). However, lengthy contexts significantly increase inference latency, as the computational cost of self-attention grows…

Artificial Intelligence · Computer Science 2026-02-17 Guojie Liu , Yiqi Wang , Yanfeng Yang , Wenqi Fan , Songlei Jian , Jianfeng Zhang , Jie Yu

Causal Learning has emerged as a major theme of research in statistics and machine learning in recent years, promising specific computational techniques to apply to datasets that reveal the true nature of cause and effect in a number of…

Machine Learning · Computer Science 2025-06-04 Vyacheslav Kungurtsev , Leonardo Christov Moore , Gustav Sir , Martin Krutsky

Bayesian causal discovery aims to infer the posterior distribution over causal models from observed data, quantifying epistemic uncertainty and benefiting downstream tasks. However, computational challenges arise due to joint inference over…

Machine Learning · Computer Science 2023-12-11 Yashas Annadani , Nick Pawlowski , Joel Jennings , Stefan Bauer , Cheng Zhang , Wenbo Gong

We consider the problem of inferring causal relationships between two or more passively observed variables. While the problem of such causal discovery has been extensively studied especially in the bivariate setting, the majority of current…

Machine Learning · Statistics 2019-04-22 Ricardo Pio Monti , Kun Zhang , Aapo Hyvarinen

As language models (LMs) deliver increasing performance on a range of NLP tasks, probing classifiers have become an indispensable technique in the effort to better understand their inner workings. A typical setup involves (1) defining an…

Computation and Language · Computer Science 2024-08-01 Charles Jin , Martin Rinard

The ability to understand causality from data is one of the major milestones of human-level intelligence. Causal Discovery (CD) algorithms can identify the cause-effect relationships among the variables of a system from related…

Artificial Intelligence · Computer Science 2024-03-14 Uzma Hasan , Emam Hossain , Md Osman Gani

Causal inference is known to be very challenging when only observational data are available. Randomized experiments are often costly and impractical and in instrumental variable regression the number of instruments has to exceed the number…

Methodology · Statistics 2018-06-19 Dominik Rothenhäusler , Peter Bühlmann , Nicolai Meinshausen

The goal of compressed sensing is to estimate a vector from an underdetermined system of noisy linear measurements, by making use of prior knowledge on the structure of vectors in the relevant domain. For almost all results in this…

Machine Learning · Statistics 2017-03-10 Ashish Bora , Ajil Jalal , Eric Price , Alexandros G. Dimakis

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Large reasoning models (LRMs) typically solve reasoning-intensive tasks by generating long chain-of-thought (CoT) traces, leading to substantial inference overhead. We identify a reproducible inference-time phenomenon, termed…

Computation and Language · Computer Science 2026-02-03 Jie Deng , Shining Liang , Jun Li , Hongzhi Li , Yutao Xie

Causality is essential for understanding complex systems, such as the economy, the brain, and the climate. Constructing causal graphs often relies on either data-driven or expert-driven approaches, both fraught with challenges. The former…

Artificial Intelligence · Computer Science 2024-06-12 Kai-Hendrik Cohrs , Gherardo Varando , Emiliano Diaz , Vasileios Sitokonstantinou , Gustau Camps-Valls

Causal inference remains a fundamental challenge for large language models. Recent advances in internal reasoning with large language models have sparked interest in whether state-of-the-art reasoning models can robustly perform causal…

Artificial Intelligence · Computer Science 2025-08-01 Kacper Kadziolka , Saber Salehkaleybar

Deep learning models have made significant progress in automatic program repair. However, the black-box nature of these methods has restricted their practical applications. To address this challenge, this paper presents an interpretable…

Software Engineering · Computer Science 2022-06-07 Jianzong Wang , Shijing Si , Zhitao Zhu , Xiaoyang Qu , Zhenhou Hong , Jing Xiao

As systems are getting more autonomous with the development of artificial intelligence, it is important to discover the causal knowledge from observational sensory inputs. By encoding a series of cause-effect relations between events,…

Machine Learning · Computer Science 2020-01-16 Yuhao Wang , Vlado Menkovski , Hao Wang , Xin Du , Mykola Pechenizkiy

Causal inference is the process of capturing cause-effect relationship among variables. Most existing works focus on dealing with structured data, while mining causal relationship among factors from unstructured data, like text, has been…

Computation and Language · Computer Science 2021-04-22 Xiao Liu , Da Yin , Yansong Feng , Yuting Wu , Dongyan Zhao