English
Related papers

Related papers: Using LLMs for Explaining Sets of Counterfactual E…

200 papers

While LLMs exhibit impressive fluency and factual recall, they struggle with robust causal reasoning, often relying on spurious correlations and brittle patterns. Similarly, traditional Reinforcement Learning agents also lack causal…

Machine Learning · Computer Science 2025-09-26 Abi Aryan , Zac Liu

Counterfactuals refer to minimally edited inputs that cause a model's prediction to change, serving as a promising approach to explaining the model's behavior. Large language models (LLMs) excel at generating English counterfactuals and…

Computation and Language · Computer Science 2026-04-07 Qianli Wang , Van Bach Nguyen , Yihong Liu , Fedor Splitt , Nils Feldhus , Christin Seifert , Hinrich Schütze , Sebastian Möller , Vera Schmitt

Causality is a fundamental part of the scientific endeavour to understand the world. Unfortunately, causality is still taboo in much of psychology and social science. Motivated by a growing number of recommendations for the importance of…

Methodology · Statistics 2022-06-27 Matthew J. Vowels

Large language models (LLMs) have made remarkable progress in a wide range of natural language understanding and generation tasks. However, their ability to generate counterfactuals has not been examined systematically. To bridge this gap,…

Computation and Language · Computer Science 2024-02-26 Yongqi Li , Mayi Xu , Xin Miao , Shen Zhou , Tieyun Qian

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

Counterfactuals are widely used to explain ML model predictions by providing alternative scenarios for obtaining the more desired predictions. They can be generated by a variety of methods that optimize different, sometimes conflicting,…

Machine Learning · Computer Science 2024-08-05 Ignacy Stępka , Mateusz Lango , Jerzy Stefanowski

Process mining is widely used to diagnose processes and uncover performance and compliance problems. It is also possible to see relations between different behavioral aspects, e.g., cases that deviate more at the beginning of the process…

Artificial Intelligence · Computer Science 2021-12-23 Mahnaz Sadat Qafari , Wil van der Aalst

In the wake of responsible AI, interpretability methods, which attempt to provide an explanation for the predictions of neural models have seen rapid progress. In this work, we are concerned with explanations that are applicable to natural…

Computation and Language · Computer Science 2023-05-29 Giorgos Filandrianos , Edmund Dervakos , Orfeas Menis-Mastromichalakis , Chrysoula Zerva , Giorgos Stamou

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

The instrumental variables (IVs) method is a leading empirical strategy for causal inference. Finding IVs is a heuristic and creative process, and justifying its validity -- especially exclusion restrictions -- is largely rhetorical. We…

Econometrics · Economics 2025-06-06 Sukjin Han

In recent years, various machine and deep learning architectures have been successfully introduced to the field of predictive process analytics. Nevertheless, the inherent opacity of these algorithms poses a significant challenge for human…

Artificial Intelligence · Computer Science 2024-03-15 Alexander Stevens , Chun Ouyang , Johannes De Smedt , Catarina Moreira

The ability to perform causal reasoning is widely considered a core feature of intelligence. In this work, we investigate whether large language models (LLMs) can coherently reason about causality. Much of the existing work in natural…

Natural language explanations of deep neural network decisions provide an intuitive way for a AI agent to articulate a reasoning process. Current textual explanations learn to discuss class discriminative features in an image. However, it…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Lisa Anne Hendricks , Ronghang Hu , Trevor Darrell , Zeynep Akata

Fair decisions require ignoring irrelevant, potentially biasing, information. To achieve this, decision-makers need to approximate what decision they would have made had they not known certain facts, such as the gender or race of a job…

Computation and Language · Computer Science 2026-01-22 Brian Christian , Matan Mazor

Counterfactual explanations are a widely used approach in Explainable AI, offering actionable insights into decision-making by illustrating how small changes to input data can lead to different outcomes. Despite their importance, evaluating…

Human-Computer Interaction · Computer Science 2025-04-22 Marharyta Domnich , Rasmus Moorits Veski , Julius Välja , Kadi Tulver , Raul Vicente

Counterfactual (CF) explanations have been employed as one of the modes of explainability in explainable AI-both to increase the transparency of AI systems and to provide recourse. Cognitive science and psychology, however, have pointed out…

Artificial Intelligence · Computer Science 2022-12-14 Marko Tesic , Ulrike Hahn

As NLP models become more complex, understanding their decisions becomes more crucial. Counterfactuals (CFs), where minimal changes to inputs flip a model's prediction, offer a way to explain these models. While Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-11-13 Van Bach Nguyen , Paul Youssef , Christin Seifert , Jörg Schlötterer

Counterfactual inference is a powerful tool for analysing and evaluating autonomous agents, but its application to language model (LM) agents remains challenging. Existing work on counterfactuals in LMs has primarily focused on token-level…

Machine Learning · Computer Science 2025-06-04 Edoardo Pona , Milad Kazemi , Yali Du , David Watson , Nicola Paoletti

As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a…

Machine Learning · Computer Science 2020-10-09 Amir-Hossein Karimi , Bernhard Schölkopf , Isabel Valera

Large language model (LLM)-powered agents can translate high-level user intents into plans and actions in an environment. Yet after observing an outcome, users may wonder: What if I had phrased my intent differently? We introduce a…

Artificial Intelligence · Computer Science 2026-01-30 Amirmohammad Farzaneh , Salvatore D'Oro , Osvaldo Simeone