中文
相关论文

相关论文: Revealing Multimodal Causality with Large Language…

200 篇论文

We present DMCD (DataMap Causal Discovery), a two-phase causal discovery framework that integrates LLM-based semantic drafting from variable metadata with statistical validation on observational data. In Phase I, a large language model…

人工智能 · 计算机科学 2026-02-25 Samarth KaPatel , Sofia Nikiforova , Giacinto Paolo Saggese , Paul Smith

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

人工智能 · 计算机科学 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

计算与语言 · 计算机科学 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

Recent advancements in Large Language Models (LLMs) have facilitated the development of Multimodal LLMs (MLLMs). Despite their impressive capabilities, MLLMs often suffer from over-reliance on unimodal biases (e.g., language bias and vision…

计算与语言 · 计算机科学 2024-11-14 Meiqi Chen , Yixin Cao , Yan Zhang , Chaochao Lu

With the rapid advancement of multimodal large language models (MLLMs), models have demonstrated increasingly powerful multimodal capabilities. However, whether MLLMs trained through statistical learning can truly understand the causal…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Junzhe Zhang , Huixuan Zhang , Guirong Wang , Xingyao Zhang , Pei Liu , Lin Qu , Hu Wei , Xiaojun Wan

Causal structure discovery from observations can be improved by integrating background knowledge provided by an expert to reduce the hypothesis space. Recently, Large Language Models (LLMs) have begun to be considered as sources of prior…

机器学习 · 计算机科学 2024-05-24 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Multimodal large language models (MLLMs) enhance the capabilities of standard large language models by integrating and processing data from multiple modalities, including text, vision, audio, video, and 3D environments. Data plays a pivotal…

Large language models (LLMs) are trained on enormous amounts of data and encode knowledge in their parameters. We propose a pipeline to elicit causal relationships from LLMs. Specifically, (i) we sample many documents from LLMs on a given…

机器学习 · 计算机科学 2026-03-05 Takashi Kameyama , Masahiro Kato , Yasuko Hio , Yasushi Takano , Naoto Minakawa

Cognitive diagnosis (CD) plays a crucial role in intelligent education, evaluating students' comprehension of knowledge concepts based on their test histories. However, current CD methods often model students, exercises, and knowledge…

计算与语言 · 计算机科学 2025-05-21 Weiming Zhang , Lingyue Fu , Qingyao Li , Kounianhua Du , Jianghao Lin , Jingwei Yu , Wei Xia , Weinan Zhang , Ruiming Tang , Yong Yu

Large language models (LLMs) have shown remarkable ability in various language tasks, especially with their emergent in-context learning capability. Extending LLMs to incorporate visual inputs, large vision-language models (LVLMs) have…

机器学习 · 计算机科学 2025-10-13 Aneesh Komanduri , Karuna Bhaila , Xintao Wu

Large language models (LLMs) have shown great potential in decision-making due to the vast amount of knowledge stored within the models. However, these pre-trained models are prone to lack reasoning abilities and are difficult to adapt to…

机器学习 · 计算机科学 2025-06-02 Wei Chen , Jiahao Zhang , Haipeng Zhu , Boyan Xu , Zhifeng Hao , Keli Zhang , Junjian Ye , Ruichu Cai

How does a cause lead to an effect, and which intermediate causal steps explain their connection? This work scrutinizes the mechanistic causal reasoning capabilities of large language models (LLMs) to answer these questions through the task…

人工智能 · 计算机科学 2026-03-19 Liesbeth Allein , Nataly Pineda-Castañeda , Andrea Rocci , Marie-Francine Moens

Causal discovery from observational data is pivotal for deciphering complex relationships. Causal Structure Learning (CSL), which focuses on deriving causal Directed Acyclic Graphs (DAGs) from data, faces challenges due to vast DAG spaces…

人工智能 · 计算机科学 2023-11-21 Taiyu Ban , Lyuzhou Chen , Derui Lyu , Xiangyu Wang , Huanhuan Chen

Genes, proteins and other biological entities influence one another via causal molecular networks. Causal relationships in such networks are mediated by complex and diverse mechanisms, through latent variables, and are often specific to…

机器学习 · 计算机科学 2025-03-07 Izzy Newsham , Luka Kovačević , Richard Moulange , Nan Rosemary Ke , Sach Mukherjee

In the field of Artificial Intelligence for Information Technology Operations, causal discovery is pivotal for operation and maintenance of graph construction, facilitating downstream industrial tasks such as root cause analysis. Temporal…

人工智能 · 计算机科学 2024-05-28 Peiwen Li , Xin Wang , Zeyang Zhang , Yuan Meng , Fang Shen , Yue Li , Jialong Wang , Yang Li , Wenweu Zhu

Traditional causal discovery methods often depend on strong, untestable assumptions, making them unreliable in real-world applications. In this context, Large Language Models (LLMs) have emerged as a promising alternative for extracting…

人工智能 · 计算机科学 2026-03-31 Federico Baldo , Simon Ferreira , Charles K. Assaad

Multi-modal large language models (MLLMs) have shown promise in advancing healthcare. However, most existing models remain confined to single-image understanding, which greatly limits their applicability in clinical workflows. In practice,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Chen , Yihang Fu , Gabriel Madera , Mauro Giuffre , Serina Applebaum , Hyunjae Kim , Hua Xu , Qingyu Chen

Inferring causal relationships between variable pairs is crucial for understanding multivariate interactions in complex systems. Knowledge-based causal discovery -- which involves inferring causal relationships by reasoning over the…

人工智能 · 计算机科学 2025-06-11 Yuni Susanti , Michael Färber

The validity of medical studies based on real-world clinical data, such as observational studies, depends on critical assumptions necessary for drawing causal conclusions about medical interventions. Many published studies are flawed…

人工智能 · 计算机科学 2024-07-30 Ahmed Alaa , Rachael V. Phillips , Emre Kıcıman , Laura B. Balzer , Mark van der Laan , Maya Petersen

We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger…

机器学习 · 计算机科学 2026-04-06 Thomas Jiralerspong , Xiaoyin Chen , Yash More , Vedant Shah , Yoshua Bengio