English
Related papers

Related papers: NoisyCausal: A Benchmark for Evaluating Causal Rea…

200 papers

Causal machine learning (Causal ML) aims to answer "what if" questions using machine learning algorithms, making it a promising tool for high-stakes decision-making. Yet, empirical evaluation practices in Causal ML remain limited. Existing…

Causal discovery is fundamental to scientific understanding and reliable decision-making. Existing approaches face critical limitations: purely data-driven methods suffer from statistical indistinguishability and modeling assumptions, while…

Computation and Language · Computer Science 2026-01-21 Bo Peng , Sirui Chen , Lei Xu , Chaochao Lu

Large language models (LLMs) have shown strong performance in zero-shot summarization, but often struggle to model document structure and identify salient information in long texts. In this work, we introduce StrucSum, a training-free…

Computation and Language · Computer Science 2026-01-22 Haohan Yuan , Sukhwa Hong , Haopeng Zhang

Effective and reliable evaluation is essential for advancing empirical machine learning. However, the increasing accessibility of generalist models and the progress towards ever more complex, high-level tasks make systematic evaluation more…

Machine Learning · Computer Science 2025-02-10 Felix Leeb , Zhijing Jin , Bernhard Schölkopf

Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning over external…

Computation and Language · Computer Science 2025-09-26 Harshad Khadilkar , Abhay Gupta

Recent large language models (LLMs) achieve near-saturation accuracy on many established mathematical reasoning benchmarks, raising concerns about their ability to diagnose genuine reasoning competence. This saturation largely stems from…

Large Language Models (LLMs) have recently demonstrated strong capabilities in code-related tasks, but their robustness in code reasoning under perturbations remains underexplored. We introduce CodeCrash, a stress-testing framework with…

Artificial Intelligence · Computer Science 2025-10-14 Man Ho Lam , Chaozheng Wang , Jen-tse Huang , Michael R. Lyu

Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by…

Computation and Language · Computer Science 2026-02-11 Bakhtawar Ahtisham , Kirk Vanacore , Zhuqian Zhou , Jinsook Lee , Rene F. Kizilcec

The reasoning abilities of Large Language Models (LLMs) are attracting increasing attention. In this work, we focus on causal reasoning and address the task of establishing causal relationships based on correlation information, a highly…

Computation and Language · Computer Science 2024-12-19 Eleni Sgouritsa , Virginia Aglietti , Yee Whye Teh , Arnaud Doucet , Arthur Gretton , Silvia Chiappa

Large language models (LLMs) exhibit logically inconsistent hallucinations that appear coherent yet violate reasoning principles, with recent research suggesting an inverse relationship between causal reasoning capabilities and such…

Computation and Language · Computer Science 2025-11-13 Yuangang Li , Yiqing Shen , Yi Nian , Jiechao Gao , Ziyi Wang , Chenxiao Yu , Shawn Li , Jie Wang , Xiyang Hu , Yue Zhao

Distinguishing the cause and effect from bivariate observational data is the foundational problem that finds applications in many scientific disciplines. One solution to this problem is assuming that cause and effect are generated from a…

Machine Learning · Statistics 2023-12-19 Quang-Duy Tran , Bao Duong , Phuoc Nguyen , Thin Nguyen

Learning causal relationships from empirical observations is a central task in scientific research. A common method is to employ structural causal models that postulate noisy functional relations among a set of interacting variables. To…

Machine Learning · Statistics 2023-09-11 Grigor Keropyan , David Strieder , Mathias Drton

Large language models (LLMs) are increasingly applied for tabular tasks using in-context learning. The prompt representation for a table may play a role in the LLMs ability to process the table. Inspired by prior work, we generate a…

Computation and Language · Computer Science 2023-10-17 Ananya Singha , José Cambronero , Sumit Gulwani , Vu Le , Chris Parnin

In recent years a lot of research has been conducted within the area of causal inference and causal learning. Many methods have been developed to identify the cause-effect pairs in models and have been successfully applied to observational…

Machine Learning · Statistics 2021-08-26 Benjamin Kap

As large language models (LLMs) are increasing integrated into fact-checking pipelines, formal logic is often proposed as a rigorous means by which to mitigate bias, errors and hallucinations in these models' outputs. For example, some…

Computation and Language · Computer Science 2026-04-28 Jason Chan , Robert Gaizauskas , Zhixue Zhao

Having a clean dataset has been the foundational assumption of most natural language processing (NLP) systems. However, properly written text is rarely found in real-world scenarios and hence, oftentimes invalidates the aforementioned…

Computation and Language · Computer Science 2025-10-08 Ayush Singh , Navpreet Singh , Shubham Vatsal

Large Language Models (LLMs) exhibit remarkable capabilities but remain vulnerable to adversarial manipulations such as jailbreaking, where crafted prompts bypass safety mechanisms. Understanding the causal factors behind such…

Cryptography and Security · Computer Science 2025-12-05 Wei Zhao , Zhe Li , Jun Sun

Natural language reasoning plays an increasingly important role in improving language models' ability to solve complex language understanding tasks. An interesting use case for reasoning is the resolution of context-dependent ambiguity. But…

Computation and Language · Computer Science 2023-10-24 Stefan F. Schouten , Peter Bloem , Ilia Markov , Piek Vossen

Recent advances in large language models (LLMs) have improved reasoning in text and image domains, yet achieving robust video reasoning remains a significant challenge. Existing video benchmarks mainly assess shallow understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang , Wentao Zhang

Large language models often hallucinate when processing long and noisy retrieval contexts because they rely on spurious correlations rather than genuine causal relationships. We propose CIP, a lightweight and plug-and-play causal prompting…

Computation and Language · Computer Science 2025-12-15 Qingsen Ma , Dianyun Wang , Ran Jing , Yujun Sun , Zhenbo Xu