中文
相关论文

相关论文: Evaluating Local Explanations using White-box Mode…

200 篇论文

There exist several methods that aim to address the crucial task of understanding the behaviour of AI/ML models. Arguably, the most popular among them are local explanations that focus on investigating model behaviour for individual…

机器学习 · 计算机科学 2023-01-04 Saumitra Mishra , Sanghamitra Dutta , Jason Long , Daniele Magazzeni

A myriad of explainability methods have been proposed in recent years, but there is little consensus on how to evaluate them. While automatic metrics allow for quick benchmarking, it isn't clear how such metrics reflect human interaction…

计算与语言 · 计算机科学 2021-06-30 Ana Valeria Gonzalez , Anna Rogers , Anders Søgaard

We introduce LAMP (Local Attribution Mapping Probe), a method that shines light onto a black-box language model's decision surface and studies how reliably a model maps its stated reasons to its reported predictions by approximating a…

机器学习 · 计算机科学 2026-04-28 Ryan Chen , Youngmin Ko , Zeyu Zhang , Catherine Cho , Sunny Chung , Mauro Giuffré , Dennis L. Shung , Bradly C. Stadie

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

人机交互 · 计算机科学 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Artificial Intelligence (AI) has come to prominence as one of the major components of our society, with applications in most aspects of our lives. In this field, complex and highly nonlinear machine learning models such as ensemble models,…

机器学习 · 计算机科学 2021-01-29 Mattia Setzu , Riccardo Guidotti , Anna Monreale , Franco Turini , Dino Pedreschi , Fosca Giannotti

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

机器学习 · 计算机科学 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

Explainable Artificial Intelligence (XAI) aims to provide transparent insights into machine learning models, yet the reliability of many feature attribution methods remains a critical challenge. Prior research (Haufe et al., 2014; Wilming…

机器学习 · 计算机科学 2026-02-11 Benedict Clark , Stoyan Karastoyanov , Rick Wilming , Stefan Haufe

Due to the increasing use of machine learning in practice it becomes more and more important to be able to explain the prediction and behavior of machine learning models. An instance of explanations are counterfactual explanations which…

机器学习 · 计算机科学 2019-11-19 André Artelt , Barbara Hammer

With the increasing adoption of predictive models trained using machine learning across a wide range of high-stakes applications, e.g., health care, security, criminal justice, finance, and education, there is a growing need for effective…

机器学习 · 计算机科学 2020-08-04 Aria Khademi , Vasant Honavar

The significant advances in autonomous systems together with an immensely wider application domain have increased the need for trustable intelligent systems. Explainable artificial intelligence is gaining considerable attention among…

人工智能 · 计算机科学 2020-06-02 Sule Anjomshoae , Kary Främling , Amro Najjar

Existing sample-based methods, like influence functions and representer points, measure the importance of a training point by approximating the effect of its removal from training. As such, they are skewed towards outliers and points that…

机器学习 · 计算机科学 2024-08-13 Lucas Agussurja , Xinyang Lu , Bryan Kian Hsiang Low

While research on applications and evaluations of explanation methods continues to expand, fairness of the explanation methods concerning disparities in their performance across subgroups remains an often overlooked aspect. In this paper,…

计算与语言 · 计算机科学 2025-05-05 Mahdi Dhaini , Ege Erdogan , Nils Feldhus , Gjergji Kasneci

Free-text explanations are expressive and easy to understand, but many datasets lack annotated explanation data, making it challenging to train models for explainable predictions. To address this, we investigate how to use existing…

计算与语言 · 计算机科学 2025-02-10 Jing Yang , Max Glockner , Anderson Rocha , Iryna Gurevych

Neural networks are ubiquitous in applied machine learning for education. Their pervasive success in predictive performance comes alongside a severe weakness, the lack of explainability of their decisions, especially relevant in…

机器学习 · 计算机科学 2022-07-04 Vinitra Swamy , Bahar Radmehr , Natasa Krco , Mirko Marras , Tanja Käser

As machine learning becomes increasingly integral to autonomous decision-making processes involving human interaction, the necessity of comprehending the model's outputs through conversational means increases. Most recently, foundation…

人工智能 · 计算机科学 2024-07-31 Sule Tekkesinoglu , Lars Kunze

Artificial Intelligence algorithms have now become pervasive in multiple high-stakes domains. However, their internal logic can be obscure to humans. Explainable Artificial Intelligence aims to design tools and techniques to illustrate the…

人机交互 · 计算机科学 2024-04-29 Eleonora Cappuccio , Daniele Fadda , Rosa Lanzilotti , Salvatore Rinzivillo

The majority of existing post-hoc explanation approaches for machine learning models produce independent, per-variable feature attribution scores, ignoring a critical inherent characteristics of homogeneously structured data, such as visual…

机器学习 · 计算机科学 2023-02-14 Vadim Borisov , Gjergji Kasneci

Time series forecasting aids decision-making, especially for stakeholders who rely on accurate predictions, making it very important to understand and explain these models to ensure informed decisions. Traditional explainable AI (XAI)…

计算与语言 · 计算机科学 2024-10-22 Taha Aksu , Chenghao Liu , Amrita Saha , Sarah Tan , Caiming Xiong , Doyen Sahoo

Large language models (LLMs) have the potential to aid and improve human decision-making in classification tasks, not only by providing fairly accurate predictions, but also in their ability to generate cogent narrative explanations of…

人机交互 · 计算机科学 2026-05-25 Laura R. Marusich , Mary Grace Kozuch Dhooghe , Jonathan Z. Bakdash , Murat Kantarcioglu

This paper studies the problem of estimating the contributions of features to the prediction of a specific instance by a machine learning model and the overall contribution of a feature to the model. The causal effect of a feature…

机器学习 · 计算机科学 2022-06-24 Jiuyong Li , Ha Xuan Tran , Thuc Duy Le , Lin Liu , Kui Yu , Jixue Liu