English
Related papers

Related papers: LLM-initialized Differentiable Causal Discovery

200 papers

We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger…

Machine Learning · Computer Science 2026-04-06 Thomas Jiralerspong , Xiaoyin Chen , Yash More , Vedant Shah , Yoshua Bengio

Traditional causal discovery methods often depend on strong, untestable assumptions, making them unreliable in real-world applications. In this context, Large Language Models (LLMs) have emerged as a promising alternative for extracting…

Artificial Intelligence · Computer Science 2026-03-31 Federico Baldo , Simon Ferreira , Charles K. Assaad

Causal discovery is an imperative foundation for decision-making across domains, such as smart health, AI for drug discovery and AIOps. Traditional statistical causal discovery methods, while well-established, predominantly rely on…

Machine Learning · Computer Science 2025-06-03 ChengAo Shen , Zhengzhang Chen , Dongsheng Luo , Dongkuan Xu , Haifeng Chen , Jingchao Ni

Integrating expert knowledge, e.g. from large language models, into causal discovery algorithms can be challenging when the knowledge is not guaranteed to be correct. Expert recommendations may contradict data-driven results, and their…

The ability to understand causality from data is one of the major milestones of human-level intelligence. Causal Discovery (CD) algorithms can identify the cause-effect relationships among the variables of a system from related…

Artificial Intelligence · Computer Science 2024-03-14 Uzma Hasan , Emam Hossain , Md Osman Gani

Learning causal structure from observational data is a fundamental challenge in machine learning. However, the majority of commonly used differentiable causal discovery methods are non-identifiable, turning this problem into a continuous…

Machine Learning · Computer Science 2022-09-30 Yu Wang , An Zhang , Xiang Wang , Yancheng Yuan , Xiangnan He , Tat-Seng Chua

Motivation: Algorithms that discover variables which are causally related to a target may inform the design of experiments. With observational gene expression data, many methods discover causal variables by measuring each variable's degree…

Quantitative Methods · Quantitative Biology 2014-07-30 Eric V. Strobl , Shyam Visweswaran

Revealing hidden causal variables alongside the underlying causal mechanisms is essential to the development of science. Despite the progress in the past decades, existing practice in causal discovery (CD) heavily relies on high-quality…

Machine Learning · Computer Science 2025-10-14 Chenxi Liu , Yongqiang Chen , Tongliang Liu , Mingming Gong , James Cheng , Bo Han , Kun Zhang

Ensuring fairness in machine learning requires understanding how sensitive attributes like race or gender causally influence outcomes. Existing causal discovery (CD) methods often struggle to recover fairness-relevant pathways in the…

Machine Learning · Computer Science 2026-01-08 Khadija Zanna , Akane Sano

Large Language Models (LLMs) and causal learning each hold strong potential for clinical decision making (CDM). However, their synergy remains poorly understood, largely due to the lack of systematic benchmarks evaluating their integration…

Machine Learning · Computer Science 2025-11-14 Linna Wang , Zhixuan You , Qihui Zhang , Jiunan Wen , Ji Shi , Yimin Chen , Yusen Wang , Fanqi Ding , Ziliang Feng , Li Lu

Large language model (LLM) development is currently driven by large-scale empirical iteration over data mixtures, reward models, routing strategies, and evaluation pipelines. Here, we argue that many central questions in LLM development and…

How does a cause lead to an effect, and which intermediate causal steps explain their connection? This work scrutinizes the mechanistic causal reasoning capabilities of large language models (LLMs) to answer these questions through the task…

Artificial Intelligence · Computer Science 2026-03-19 Liesbeth Allein , Nataly Pineda-Castañeda , Andrea Rocci , Marie-Francine Moens

Mainstream methods for Legal Judgment Prediction (LJP) based on Pre-trained Language Models (PLMs) heavily rely on the statistical correlation between case facts and judgment results. This paradigm lacks explicit modeling of legal…

Computation and Language · Computer Science 2026-03-13 Yuzhi Liang , Lixiang Ma , Xinrong Zhu

Causal structure discovery methods are commonly applied to structured data where the causal variables are known and where statistical testing can be used to assess the causal relationships. By contrast, recovering a causal structure from…

Computation and Language · Computer Science 2024-10-10 Gaël Gendron , Jože M. Rožanec , Michael Witbrock , Gillian Dobbie

Understanding causality helps to structure interventions to achieve specific goals and enables predictions under interventions. With the growing importance of learning causal relationships, causal discovery tasks have transitioned from…

Machine Learning · Computer Science 2022-09-15 Hang Chen , Keqing Du , Xinyu Yang , Chenguang Li

Causal discovery is fundamental to scientific understanding and reliable decision-making. Existing approaches face critical limitations: purely data-driven methods suffer from statistical indistinguishability and modeling assumptions, while…

Computation and Language · Computer Science 2026-01-21 Bo Peng , Sirui Chen , Lei Xu , Chaochao Lu

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

Artificial Intelligence · Computer Science 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

This paper introduces a causal attribution model to enhance the interpretability of large language models (LLMs) and improve their causal reasoning abilities via precise fine-tuning. Despite LLMs' proficiency in diverse tasks, their…

Artificial Intelligence · Computer Science 2026-05-22 Hengrui Cai , Shengjie Liu , Rui Song

The causal capabilities of large language models (LLMs) are a matter of significant debate, with critical implications for the use of LLMs in societally impactful domains such as medicine, science, law, and policy. We conduct a "behavorial"…

Artificial Intelligence · Computer Science 2024-08-21 Emre Kıcıman , Robert Ness , Amit Sharma , Chenhao Tan

Causality is essential in scientific research, enabling researchers to interpret true relationships between variables. These causal relationships are often represented by causal graphs, which are directed acyclic graphs. With the recent…

Computation and Language · Computer Science 2025-02-19 Ivaxi Sheth , Bahare Fatemi , Mario Fritz