English
Related papers

Related papers: ReplaySCM: A Benchmark for Executable Causal Mecha…

200 papers

We introduce CEMTM, a context-enhanced multimodal topic model designed to infer coherent and interpretable topic structures from both short and long documents containing text and images. CEMTM builds on fine-tuned large vision language…

Computation and Language · Computer Science 2025-10-07 Amirhossein Abaskohi , Raymond Li , Chuyuan Li , Shafiq Joty , Giuseppe Carenini

Heterogeneity in medical data, e.g., from data collected at different sites and with different protocols in a clinical study, is a fundamental hurdle for accurate prediction using machine learning models, as such models often fail to…

Machine Learning · Computer Science 2021-07-13 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Despite impressive advances in large language models (LLMs), existing benchmarks often focus on single-turn or single-step tasks, failing to capture the kind of iterative reasoning required in real-world settings. To address this…

Computation and Language · Computer Science 2025-11-26 Yiran Zhang , Mo Wang , Xiaoyang Li , Kaixuan Ren , Chencheng Zhu , Usman Naseem

Large language models (LLMs) are increasingly used as automated judges and synthetic labelers, especially in low-label settings. Yet these systems are stochastic and often overconfident, which makes deployment decisions difficult when…

Machine Learning · Computer Science 2026-03-19 Maxim Khomiakov , Jes Frellsen

Causal reinforcement learning (RL) lacks benchmarks for complex systems that combine sequential decision making, hidden information, large masked action spaces, and explicit causal structure. We introduce MTG-Causal-RL, a Gymnasium…

Machine Learning · Computer Science 2026-05-08 Cristiano da Costa Cunha , Ajmal Mian , Tim French , Wei Liu

Standard reward models typically predict scalar scores that fail to capture the multifaceted nature of response quality in non-verifiable domains, such as creative writing or open-ended instruction following. To address this limitation, we…

Computation and Language · Computer Science 2026-02-13 Ran Xu , Tianci Liu , Zihan Dong , Tony Yu , Ilgee Hong , Carl Yang , Linjun Zhang , Tao Zhao , Haoyu Wang

The key of sequential recommendation lies in the accurate item correlation modeling. Previous models infer such information based on item co-occurrences, which may fail to capture the real causal relations, and impact the recommendation…

Information Retrieval · Computer Science 2022-12-14 Zhenlei Wang , Xu Chen , Rui Zhou , Quanyu Dai , Zhenhua Dong , Ji-Rong Wen

Abstractive related work generation has attracted increasing attention in generating coherent related work that better helps readers grasp the background in the current research. However, most existing abstractive models ignore the inherent…

Computation and Language · Computer Science 2023-05-24 Jiachang Liu , Qi Zhang , Chongyang Shi , Usman Naseem , Shoujin Wang , Ivor Tsang

Causal discovery is challenging in general dynamical systems because, without strong structural assumptions, the underlying causal graph may not be identifiable even from interventional data. However, many real-world systems exhibit…

Machine Learning · Computer Science 2026-04-07 Panayiotis Panayiotou , Özgür Şimşek

Research on causal effects often relies on synthetic data due to the scarcity of real-world datasets with ground-truth effects. Since current data-generating tools do not always meet all requirements for state-of-the-art research, ad-hoc…

Artificial Intelligence · Computer Science 2024-05-24 Andreas W M Sauter , Erman Acar , Aske Plaat

Paralinguistic cues are essential for natural human-computer interaction, yet their evaluation in Large Audio-Language Models (LALMs) remains limited by coarse feature coverage and the inherent subjectivity of assessment. To address these…

Computation and Language · Computer Science 2026-04-23 Ruohan Liu , Shukang Yin , Tao Wang , Dong Zhang , Weiji Zhuang , Shuhuai Ren , Ran He , Caifeng Shan , Chaoyou Fu

Knowing the effect of an intervention is critical for human decision-making, but current approaches for causal effect estimation rely on manual data collection and structuring, regardless of the causal assumptions. This increases both the…

Machine Learning · Computer Science 2024-10-29 Nikita Dhawan , Leonardo Cotta , Karen Ullrich , Rahul G. Krishnan , Chris J. Maddison

Explanatory studies, such as randomized controlled trials, are targeted to extract the true causal effect of interventions on outcomes and are by design adjusted for covariates through randomization. On the contrary, observational studies…

Methodology · Statistics 2022-05-02 Riddhiman Adib , Sheikh Iqbal Ahamed , Mohammad Adibuzzaman

To perform effective causal inference in high-dimensional datasets, initiating the process with causal discovery is imperative, wherein a causal graph is generated based on observational data. However, obtaining a complete and accurate…

Machine Learning · Computer Science 2025-04-18 Elahe Khatibi , Mahyar Abbasian , Zhongqi Yang , Iman Azimi , Amir M. Rahmani

The ultimate goal of most scientific studies is to understand the underlying causal mechanism between the involved variables. Structural causal models (SCMs) are widely used to represent such causal mechanisms. Given an SCM, causal queries…

Machine Learning · Statistics 2025-03-21 Beate Sick , Oliver Dürr

In this paper, we propose CodeSCM, a Structural Causal Model (SCM) for analyzing multi-modal code generation using large language models (LLMs). By applying interventions to CodeSCM, we measure the causal effects of different prompt…

Computation and Language · Computer Science 2025-02-10 Mukur Gupta , Noopur Bhatt , Suman Jana

Multi-turn instruction following capability constitutes a core competency of large language models (LLMs) in real-world applications. Existing evaluation benchmarks predominantly focus on fine-grained constraint satisfaction and…

Computation and Language · Computer Science 2025-06-02 Jinnan Li , Jinzhe Li , Yue Wang , Yi Chang , Yuan Wu

Targeted and uniform interventions to a system are crucial for unveiling causal relationships. While several methods have been developed to leverage interventional data for causal structure learning, their practical application in…

Machine Learning · Computer Science 2025-05-20 Mathieu Chevalley , Patrick Schwab , Arash Mehrjou

This reproducibility study analyzes and extends the paper "Axiomatic Causal Interventions for Reverse Engineering Relevance Computation in Neural Retrieval Models," which investigates how neural retrieval models encode task-relevant…

Information Retrieval · Computer Science 2025-05-06 Oliver Savolainen , Dur e Najaf Amjad , Roxana Petcu

Structural Causal Models (SCMs) provide a popular causal modeling framework. In this work, we show that SCMs are not flexible enough to give a complete causal representation of dynamical systems at equilibrium. Instead, we propose a…

Artificial Intelligence · Computer Science 2019-08-07 Tineke Blom , Stephan Bongers , Joris M. Mooij