English
Related papers

Related papers: Sequential Causal Discovery with Noisy Language Mo…

200 papers

The development of robust generative models for highly varied non-stationary time series data is a complex yet important problem. Traditional models for time series data prediction, such as Long Short-Term Memory (LSTM), are inefficient and…

Machine Learning · Computer Science 2024-11-18 Anton Johansson , Arunselvan Ramaswamy

Models that learn spurious correlations from training data often fail when deployed in new environments. While many methods aim to learn invariant representations to address this, they often underperform standard empirical risk minimization…

Machine Learning · Computer Science 2025-11-11 Ruqi Bai , Yao Ji , Zeyu Zhou , David I. Inouye

Bayesian causal discovery aims to infer the posterior distribution over causal models from observed data, quantifying epistemic uncertainty and benefiting downstream tasks. However, computational challenges arise due to joint inference over…

Machine Learning · Computer Science 2023-12-11 Yashas Annadani , Nick Pawlowski , Joel Jennings , Stefan Bauer , Cheng Zhang , Wenbo Gong

Models that adapt their predictions based on some given contexts, also known as in-context learning, have become ubiquitous in recent years. We propose to study the behavior of such models when data is contaminated by noise. Towards this…

Machine Learning · Computer Science 2024-11-05 Chen Shapira , Dan Rosenbaum

Sequential Recommenders generate recommendations based on users' historical interaction sequences. However, in practice, these collected sequences are often contaminated by noisy interactions, which significantly impairs recommendation…

Information Retrieval · Computer Science 2025-06-10 Bohao Wang , Feng Liu , Changwang Zhang , Jiawei Chen , Yudi Wu , Sheng Zhou , Xingyu Lou , Jun Wang , Yan Feng , Chun Chen , Can Wang

Causal inference from observational data following the restricted structural causal models (SCM) framework hinges largely on the asymmetry between cause and effect from the data generating mechanisms, such as non-Gaussianity or…

Machine Learning · Computer Science 2024-05-30 Kang Du , Yu Xiang

Large language models (LLMs) often exhibit Context Faithfulness Hallucinations, where outputs deviate from retrieved information due to incomplete context integration. Our analysis reveals a strong correlation between token-level…

Computation and Language · Computer Science 2025-02-26 Yanwen Huang , Yong Zhang , Ning Cheng , Zhitao Li , Shaojun Wang , Jing Xiao

Large Language Models (LLMs) struggle with knowledge-intensive tasks due to hallucinations and fragmented reasoning over dispersed information. While Retrieval-Augmented Generation (RAG) grounds generation in external sources, existing…

Computation and Language · Computer Science 2026-04-14 Cheng-Yen Li , Xuanjun Chen , Claire Lin , Wei-Yu Chen , Wenhua Nie , Hung-Yi Lee , Jyh-Shing Roger Jang

Recursive linear structural equation models and the associated directed acyclic graphs (DAGs) play an important role in causal discovery. The classic identifiability result for this class of models states that when only observational data…

Statistics Theory · Mathematics 2023-08-21 Jun Wu , Mathias Drton

When using large language models (LLMs) in knowledge-intensive tasks, such as open-domain question answering, external context can bridge the gap between external knowledge and the LLMs' parametric knowledge. Recent research has been…

Computation and Language · Computer Science 2024-10-08 Youna Kim , Hyuhng Joon Kim , Cheonbok Park , Choonghyun Park , Hyunsoo Cho , Junyeob Kim , Kang Min Yoo , Sang-goo Lee , Taeuk Kim

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions.…

Machine Learning · Computer Science 2025-05-22 Xiaoling Zhou , Wei Ye , Rui Xie , Shikun Zhang

Despite the strong abilities, large language models (LLMs) still suffer from hallucinations and reliance on outdated knowledge, raising concerns in knowledge-intensive tasks. Graph-based retrieval-augmented generation (GRAG) enriches LLMs…

Computation and Language · Computer Science 2026-01-14 Derong Xu , Pengyue Jia , Xiaopeng Li , Yingyi Zhang , Maolin Wang , Qidong Liu , Xiangyu Zhao , Yichao Wang , Huifeng Guo , Ruiming Tang , Enhong Chen , Tong Xu

The causal dependence in data is often characterized by Directed Acyclic Graphical (DAG) models, widely used in many areas. Causal discovery aims to recover the DAG structure using observational data. This paper focuses on causal discovery…

Machine Learning · Computer Science 2024-06-12 Boxin Zhao , Weishi Wang , Dingyuan Zhu , Ziqi Liu , Dong Wang , Zhiqiang Zhang , Jun Zhou , Mladen Kolar

Retrieval-augmented large language models (LLMs) have been remarkably competent in various NLP tasks. However, it was observed by previous works that retrieval is not always helpful, especially when the LLM is already knowledgeable on the…

Computation and Language · Computer Science 2024-12-16 Chengkai Huang , Yu Xia , Rui Wang , Kaige Xie , Tong Yu , Julian McAuley , Lina Yao

Process discovery aims to derive process models from event logs, providing insights into operational behavior and forming a foundation for conformance checking and process improvement. However, models derived solely from event data may not…

Artificial Intelligence · Computer Science 2025-10-09 Ali Norouzifar , Humam Kourani , Marcus Dees , Wil van der Aalst

Neural language models (LMs) have been shown to capture complex linguistic patterns, yet their utility in understanding human language and more broadly, human cognition, remains debated. While existing work in this area often evaluates…

Computation and Language · Computer Science 2026-04-10 Kanishka Misra , Najoung Kim

Causal representation learning (CRL) offers the promise of uncovering the underlying causal model by which observed data was generated, but the practical applicability of existing methods remains limited by the strong assumptions required…

Machine Learning · Computer Science 2026-01-30 Yuhang Liu , Zhen Zhang , Dong Gong , Erdun Gao , Biwei Huang , Mingming Gong , Anton van den Hengel , Kun Zhang , Javen Qinfeng Shi

Large Language Models (LLMs) have achieved impressive performance across a wide range of applications. However, they often suffer from hallucinations in knowledge-intensive domains due to their reliance on static pretraining corpora. To…

Information Retrieval · Computer Science 2026-02-10 Lihui Liu , Jiayuan Ding , Subhabrata Mukherjee , Carl J. Yang

We focus on the extension of bivariate causal learning methods into multivariate problem settings in a systematic manner via a novel framework. It is purposive to augment the scale to which bivariate causal discovery approaches can be…

Methodology · Statistics 2023-05-29 Hongyi Chen , Maurits Kaptein

Constraint-based causal discovery is brittle in finite-sample regimes because erroneous conditional-independence (CI) decisions can cascade into substantial structural errors. We propose Quantitative Argumentation for Causal Discovery…

Artificial Intelligence · Computer Science 2026-04-28 Sheng Wei , Yulin Chen , Beishui Liao