English
Related papers

Related papers: Improving constraint-based discovery with robust p…

200 papers

Circuit discovery aims to explain how language models (LMs) implement a specific task by localizing and interpreting a circuit, a computational subgraph responsible for the LM's behavior. Existing circuit discovery methods are…

Artificial Intelligence · Computer Science 2026-05-12 Daking Rai , Mor Geva , Ziyu Yao

Causal structure discovery methods are commonly applied to structured data where the causal variables are known and where statistical testing can be used to assess the causal relationships. By contrast, recovering a causal structure from…

Computation and Language · Computer Science 2024-10-10 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

In complex multivariate systems, interactions among variables are defined by dependency structures, often encoded as directed acyclic graphs ($\text{DAGs}$). However, dependency structures can vary across subjects, and ignoring this…

Machine Learning · Statistics 2026-05-20 Honglin Du , Muxuan Liang , Xiang Zhong

Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational…

Machine Learning · Computer Science 2021-01-19 Anqi Liu , Hao Liu , Tongxin Li , Saeed Karimi-Bidhendi , Yisong Yue , Anima Anandkumar

We present a constraint-based algorithm for learning causal structures from observational time-series data, in the presence of latent confounders. We assume a discrete-time, stationary structural vector autoregressive process, with both…

Artificial Intelligence · Computer Science 2023-06-02 Raanan Y. Rohekar , Shami Nisimov , Yaniv Gurwicz , Gal Novik

Large Language Models (LLMs) are increasingly used for question answering over scientific research papers. Existing retrieval augmentation methods often rely on isolated text chunks or concepts, but overlook deeper semantic connections…

Computation and Language · Computer Science 2026-01-30 Jiayin Lan , Jiaqi Li , Baoxin Wang , Ming Liu , Dayong Wu , Shijin Wang , Bing Qin , Guoping Hu

Large Language Models (LLMs) often generate hallucinations, producing outputs that are contextually inaccurate or factually incorrect. We introduce HICD, a novel method designed to induce hallucinations for contrastive decoding to mitigate…

Computation and Language · Computer Science 2025-05-26 Xinyan Jiang , Hang Ye , Yongxin Zhu , Xiaoying Zheng , Zikang Chen , Jun Gong

The aim in many sciences is to understand the mechanisms that underlie the observed distribution of variables, starting from a set of initial hypotheses. Causal discovery allows us to infer mechanisms as sets of cause and effect…

Machine Learning · Computer Science 2025-03-05 Ashka Shah , Adela DePavia , Nathaniel Hudson , Ian Foster , Rick Stevens

Causal discovery has achieved substantial theoretical progress, yet its deployment in large-scale longitudinal systems remains limited. A key obstacle is that operational data are generated under institutional workflows whose induced…

Methodology · Statistics 2026-03-02 Tadahisa Okuda , Shohei Shimizu , Thong Pham , Tatsuyoshi Ikenoue , Shingo Fukuma

Large language models (LLMs) often exhibit Context Faithfulness Hallucinations, where outputs deviate from retrieved information due to incomplete context integration. Our analysis reveals a strong correlation between token-level…

Computation and Language · Computer Science 2025-02-26 Yanwen Huang , Yong Zhang , Ning Cheng , Zhitao Li , Shaojun Wang , Jing Xiao

Recently, differentiable causal discovery has emerged as a promising approach to improve the accuracy and efficiency of existing methods. However, when applied to high-dimensional data or data with latent confounders, these methods, often…

Machine Learning · Computer Science 2026-01-12 Pingchuan Ma , Qixin Zhang , Shuai Wang , Dacheng Tao

Classical machine learning techniques often struggle with overfitting and unreliable predictions when exposed to novel conditions. Introducing causality into the modelling process offers a promising way to mitigate these challenges by…

Computational Engineering, Finance, and Science · Computer Science 2025-05-28 David Zapata Gonzalez , Marcel Meyer , Oliver Mueller

Learning causal structures from observational data is a fundamental problem facing important computational challenges when the number of variables is large. In the context of linear structural equation models (SEMs), this paper focuses on…

Machine Learning · Computer Science 2024-02-21 Shuyu Dong , Kento Uemura , Akito Fujii , Shuang Chang , Yusuke Koyanagi , Koji Maruhashi , Michèle Sebag

Ensuring fairness in machine learning requires understanding how sensitive attributes like race or gender causally influence outcomes. Existing causal discovery (CD) methods often struggle to recover fairness-relevant pathways in the…

Machine Learning · Computer Science 2026-01-08 Khadija Zanna , Akane Sano

Revealing hidden causal variables alongside the underlying causal mechanisms is essential to the development of science. Despite the progress in the past decades, existing practice in causal discovery (CD) heavily relies on high-quality…

Machine Learning · Computer Science 2025-10-14 Chenxi Liu , Yongqiang Chen , Tongliang Liu , Mingming Gong , James Cheng , Bo Han , Kun Zhang

We target the problem of accuracy and robustness in causal inference from finite data sets. Some state-of-the-art algorithms produce clear output complete with solid theoretical guarantees but are susceptible to propagating erroneous…

Artificial Intelligence · Computer Science 2012-10-19 Tom Claassen , Tom Heskes

Many of the causal discovery methods rely on the faithfulness assumption to guarantee asymptotic correctness. However, the assumption can be approximately violated in many ways, leading to sub-optimal solutions. Although there is a line of…

Machine Learning · Computer Science 2022-01-19 Ignavier Ng , Yujia Zheng , Jiji Zhang , Kun Zhang

Knowledge driven discovery of novel materials necessitates the development of the causal models for the property emergence. While in classical physical paradigm the causal relationships are deduced based on the physical principles or via…

We study the task of conducting structured reasoning as generating a reasoning graph from natural language input using large language models (LLMs). Previous approaches have explored various prompting schemes, yet they suffer from error…

Computation and Language · Computer Science 2024-06-04 Inderjeet Nair , Lu Wang

Causal discovery (CD) is an important component of many scientific applications, yet most techniques produce unreliable point estimates that often contradict expert knowledge. To mitigate this, recent research has focused on ex-ante…