English
Related papers

Related papers: Revealing Multimodal Causality with Large Language…

200 papers

We present DMCD (DataMap Causal Discovery), a two-phase causal discovery framework that integrates LLM-based semantic drafting from variable metadata with statistical validation on observational data. In Phase I, a large language model…

Artificial Intelligence · Computer Science 2026-02-25 Samarth KaPatel , Sofia Nikiforova , Giacinto Paolo Saggese , Paul Smith

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

Artificial Intelligence · Computer Science 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

Computation and Language · Computer Science 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

Recent advancements in Large Language Models (LLMs) have facilitated the development of Multimodal LLMs (MLLMs). Despite their impressive capabilities, MLLMs often suffer from over-reliance on unimodal biases (e.g., language bias and vision…

Computation and Language · Computer Science 2024-11-14 Meiqi Chen , Yixin Cao , Yan Zhang , Chaochao Lu

With the rapid advancement of multimodal large language models (MLLMs), models have demonstrated increasingly powerful multimodal capabilities. However, whether MLLMs trained through statistical learning can truly understand the causal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Junzhe Zhang , Huixuan Zhang , Guirong Wang , Xingyao Zhang , Pei Liu , Lin Qu , Hu Wei , Xiaojun Wan

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

Machine Learning · Computer Science 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Artificial Intelligence · Computer Science 2024-07-19 Tianyi Bai , Hao Liang , Binwang Wan , Yanran Xu , Xi Li , Shiyu Li , Ling Yang , Bozhou Li , Yifan Wang , Bin Cui , Ping Huang , Jiulong Shan , Conghui He , Binhang Yuan , Wentao Zhang

Large language models (LLMs) are trained on enormous amounts of data and encode knowledge in their parameters. We propose a pipeline to elicit causal relationships from LLMs. Specifically, (i) we sample many documents from LLMs on a given…

Machine Learning · Computer Science 2026-03-05 Takashi Kameyama , Masahiro Kato , Yasuko Hio , Yasushi Takano , Naoto Minakawa

Cognitive diagnosis (CD) plays a crucial role in intelligent education, evaluating students' comprehension of knowledge concepts based on their test histories. However, current CD methods often model students, exercises, and knowledge…

Computation and Language · Computer Science 2025-05-21 Weiming Zhang , Lingyue Fu , Qingyao Li , Kounianhua Du , Jianghao Lin , Jingwei Yu , Wei Xia , Weinan Zhang , Ruiming Tang , Yong Yu

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

Machine Learning · Computer Science 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Large language models (LLMs) have shown great potential in decision-making due to the vast amount of knowledge stored within the models. However, these pre-trained models are prone to lack reasoning abilities and are difficult to adapt to…

Machine Learning · Computer Science 2025-06-02 Wei Chen , Jiahao Zhang , Haipeng Zhu , Boyan Xu , Zhifeng Hao , Keli Zhang , Junjian Ye , Ruichu Cai

How does a cause lead to an effect, and which intermediate causal steps explain their connection? This work scrutinizes the mechanistic causal reasoning capabilities of large language models (LLMs) to answer these questions through the task…

Artificial Intelligence · Computer Science 2026-03-19 Liesbeth Allein , Nataly Pineda-Castañeda , Andrea Rocci , Marie-Francine Moens

Causal discovery from observational data is pivotal for deciphering complex relationships. Causal Structure Learning (CSL), which focuses on deriving causal Directed Acyclic Graphs (DAGs) from data, faces challenges due to vast DAG spaces…

Artificial Intelligence · Computer Science 2023-11-21 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Huanhuan Chen

Genes, proteins and other biological entities influence one another via causal molecular networks. Causal relationships in such networks are mediated by complex and diverse mechanisms, through latent variables, and are often specific to…

Machine Learning · Computer Science 2025-03-07 Izzy Newsham , Luka Kovačević , Richard Moulange , Nan Rosemary Ke , Sach Mukherjee

In the field of Artificial Intelligence for Information Technology Operations, causal discovery is pivotal for operation and maintenance of graph construction, facilitating downstream industrial tasks such as root cause analysis. Temporal…

Artificial Intelligence · Computer Science 2024-05-28 Peiwen Li , Xin Wang , Zeyang Zhang , Yuan Meng , Fang Shen , Yue Li , Jialong Wang , Yang Li , Wenweu Zhu

Traditional causal discovery methods often depend on strong, untestable assumptions, making them unreliable in real-world applications. In this context, Large Language Models (LLMs) have emerged as a promising alternative for extracting…

Artificial Intelligence · Computer Science 2026-03-31 Federico Baldo , Simon Ferreira , Charles K. Assaad

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Inferring causal relationships between variable pairs is crucial for understanding multivariate interactions in complex systems. Knowledge-based causal discovery -- which involves inferring causal relationships by reasoning over the…

Artificial Intelligence · Computer Science 2025-06-11 Yuni Susanti , Michael Färber

The validity of medical studies based on real-world clinical data, such as observational studies, depends on critical assumptions necessary for drawing causal conclusions about medical interventions. Many published studies are flawed…

Artificial Intelligence · Computer Science 2024-07-30 Ahmed Alaa , Rachael V. Phillips , Emre Kıcıman , Laura B. Balzer , Mark van der Laan , Maya Petersen

We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger…

Machine Learning · Computer Science 2026-04-06 Thomas Jiralerspong , Xiaoyin Chen , Yash More , Vedant Shah , Yoshua Bengio