English
Related papers

Related papers: Improving Model Understanding and Trust with Count…

200 papers

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

As humans increasingly rely on multiround conversational AI for high stakes decisions, principled frameworks are needed to ensure such interactions reliably improve decision quality. We adopt a human centric view governed by two principles:…

Machine Learning · Computer Science 2026-02-25 Sima Noorani , Shayan Kiyani , Hamed Hassani , George Pappas

Despite the widespread adoption of autoregressive language models, explainability evaluation research has predominantly focused on span infilling and masked language models. Evaluating the faithfulness of an explanation method -- how…

Computation and Language · Computer Science 2025-03-11 Sepehr Kamahi , Yadollah Yaghoobzadeh

Explanations are hypothesized to improve human understanding of machine learning models and achieve a variety of desirable outcomes, ranging from model debugging to enhancing human decision making. However, empirical studies have found…

Artificial Intelligence · Computer Science 2023-05-02 Chacha Chen , Shi Feng , Amit Sharma , Chenhao Tan

World models have garnered substantial interest in the AI community. These are internal representations that simulate aspects of the external world, track entities and states, capture causal relationships, and enable prediction of…

Artificial Intelligence · Computer Science 2025-11-18 Tarun Gupta , Danish Pruthi

Post-hoc explanations of machine learning models are crucial for people to understand and act on algorithmic predictions. An intriguing class of explanations is through counterfactuals, hypothetical examples that show people how to obtain a…

Machine Learning · Computer Science 2019-12-09 Ramaravind Kommiya Mothilal , Amit Sharma , Chenhao Tan

Counterfactual explanations emerge as a powerful approach in explainable AI, providing what-if scenarios that reveal how minimal changes to an input time series can alter the model's prediction. This work presents a survey of recent…

Machine Learning · Computer Science 2026-03-31 Udo Schlegel , Thomas Seidl

How much are we to trust a decision made by an AI algorithm? Trusting an algorithm without cause may lead to abuse, and mistrusting it may similarly lead to disuse. Trust in an AI is only desirable if it is warranted; thus, calibrating…

Human-Computer Interaction · Computer Science 2023-03-27 Neil Natarajan , Reuben Binns , Jun Zhao , Nigel Shadbolt

Deep learning models in computer vision have made remarkable progress, but their lack of transparency and interpretability remains a challenge. The development of explainable AI can enhance the understanding and performance of these models.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Bismillah Khan , Syed Ali Tariq , Tehseen Zia , Muhammad Ahsan , David Windridge

This study critically examines the commonly held assumption that explicability in artificial intelligence (AI) systems inherently boosts user trust. Utilizing a meta-analytical approach, we conducted a comprehensive examination of the…

Artificial Intelligence · Computer Science 2025-04-18 Zahra Atf , Peter R. Lewis

LLMs and AI chatbots have improved people's efficiency in various fields. However, the necessary knowledge for answering the question may be beyond the models' knowledge boundaries. To mitigate this issue, many researchers try to introduce…

Computation and Language · Computer Science 2023-11-15 Yi Liu , Lianzhe Huang , Shicheng Li , Sishuo Chen , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun

The illusion of consensus occurs when people believe there is consensus across multiple sources, but the sources are the same and thus there is no "true" consensus. We explore this phenomenon in the context of an AI-based intelligent agent…

Human-Computer Interaction · Computer Science 2023-04-25 Takane Ueno , Yeongdae Kim , Hiroki Oura , Katie Seaborn

We present CounterfactualExplanations.jl: a package for generating Counterfactual Explanations (CE) and Algorithmic Recourse (AR) for black-box models in Julia. CE explain how inputs into a model need to change to yield specific model…

Machine Learning · Computer Science 2023-08-15 Patrick Altmeyer , Arie van Deursen , Cynthia C. S. Liem

Machine learning models are widely used in real-world applications. However, their complexity makes it often challenging to interpret the rationale behind their decisions. Counterfactual explanations (CEs) have emerged as a viable solution…

Machine Learning · Computer Science 2024-03-04 Muhammad Suffian , Jose M. Alonso-Moral , Alessandro Bogliolo

Model explanations based on pure observational data cannot compute the effects of features reliably, due to their inability to estimate how each factor alteration could affect the rest. We argue that explanations should be based on the…

Machine Learning · Statistics 2019-09-20 Álvaro Parafita , Jordi Vitrià

Large-scale AI models such as GPT-4 have accelerated the deployment of artificial intelligence across critical domains including law, healthcare, and finance, raising urgent questions about trust and transparency. This study investigates…

Artificial Intelligence · Computer Science 2025-10-20 Allen Daniel Sunny

Corporate mergers and acquisitions (M&A) account for billions of dollars of investment globally every year, and offer an interesting and challenging domain for artificial intelligence. However, in these highly sensitive domains, it is…

Computation and Language · Computer Science 2020-10-26 Linyi Yang , Eoin M. Kenny , Tin Lok James Ng , Yi Yang , Barry Smyth , Ruihai Dong

Counterfactual explanations are increasingly used as an Explainable Artificial Intelligence (XAI) technique to provide stakeholders of complex machine learning algorithms with explanations for data-driven decisions. The popularity of…

Artificial Intelligence · Computer Science 2023-04-26 Dieter Brughmans , Lissa Melis , David Martens

Counterfactual explanations utilize feature perturbations to analyze the outcome of an original decision and recommend an actionable recourse. We argue that it is beneficial to provide several alternative explanations rather than a single…

Machine Learning · Computer Science 2023-01-24 Natraj Raman , Daniele Magazzeni , Sameena Shah

Interactive constraint systems often suffer from infeasibility (no solution) due to conflicting user constraints. A common approach to recover infeasibility is to eliminate the constraints that cause the conflicts in the system. This…

Artificial Intelligence · Computer Science 2022-04-08 Sharmi Dev Gupta , Begum Genc , Barry O'Sullivan