中文
相关论文

相关论文: Human-grounded Evaluations of Explanation Methods …

200 篇论文

In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and…

人工智能 · 计算机科学 2021-10-11 Bettina Finzel , David E. Tafler , Stephan Scheele , Ute Schmid

Recently many efforts have been devoted to interpreting the black-box NMT models, but little progress has been made on metrics to evaluate explanation methods. Word Alignment Error Rate can be used as such a metric that matches human…

计算与语言 · 计算机科学 2020-05-05 Jierui Li , Lemao Liu , Huayang Li , Guanlin Li , Guoping Huang , Shuming Shi

A major concern of Machine Learning (ML) models is their opacity. They are deployed in an increasing number of applications where they often operate as black boxes that do not provide explanations for their predictions. Among others, the…

机器学习 · 计算机科学 2022-11-10 Pepa Atanasova

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

机器学习 · 计算机科学 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

We study how well large language models (LLMs) explain their generations through rationales -- a set of tokens extracted from the input text that reflect the decision-making process of LLMs. Specifically, we systematically study rationales…

计算与语言 · 计算机科学 2024-10-23 Mohsen Fayyaz , Fan Yin , Jiao Sun , Nanyun Peng

Explaining Graph Neural Networks predictions to end users of AI applications in easily understandable terms remains an unsolved problem. In particular, we do not have well developed methods for automatically evaluating explanations, in ways…

人工智能 · 计算机科学 2021-06-23 Vanya BK , Balaji Ganesan , Aniket Saxena , Devbrat Sharma , Arvind Agarwal

While deep neural networks are extremely effective at classifying images, they remain opaque and hard to interpret. We introduce local and global explanation methods for black-box models that generate explanations in terms of…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Bhavan Vasu , Giuseppe Raffa , Prasad Tadepalli

Machine learning models are increasingly integrated into societally critical applications such as recidivism prediction and medical diagnosis, thanks to their superior predictive power. In these applications, however, full automation is…

人机交互 · 计算机科学 2020-03-18 Vivian Lai , Samuel Carton , Chenhao Tan

Is explainability a false promise? This debate has emerged from the insufficient evidence that explanations help people in situations they are introduced for. More human-centered, application-grounded evaluations of explanations are needed…

计算与语言 · 计算机科学 2024-11-06 Fateme Hashemi Chaleshtori , Atreya Ghosal , Alexander Gill , Purbid Bambroo , Ana Marasović

Evaluating translation models is a trade-off between effort and detail. On the one end of the spectrum there are automatic count-based methods such as BLEU, on the other end linguistic evaluations by humans, which arguably are more…

计算与语言 · 计算机科学 2019-03-29 Robert Schwarzenberg , David Harbecke , Vivien Macketanz , Eleftherios Avramidis , Sebastian Möller

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

机器学习 · 计算机科学 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by…

计算与语言 · 计算机科学 2021-07-12 Wei Zhao , Rahul Singh , Tarun Joshi , Agus Sudjianto , Vijayan N. Nair

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

机器学习 · 计算机科学 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

We address the need to generate faithful explanations of "black box" Deep Learning models. Several tests have been proposed to determine aspects of faithfulness of explanation methods, but they lack cross-domain applicability and a rigorous…

机器学习 · 计算机科学 2023-06-27 Harshinee Sriram , Cristina Conati

Deep neural perception and control networks have become key components of self-driving vehicles. User acceptance is likely to benefit from easy-to-interpret textual explanations which allow end-users to understand what triggered a…

计算机视觉与模式识别 · 计算机科学 2018-08-01 Jinkyu Kim , Anna Rohrbach , Trevor Darrell , John Canny , Zeynep Akata

While deep learning models often achieve strong task performance, their successes are hampered by their inability to disentangle spurious correlations from causative factors, such as when they use protected attributes (e.g., race, gender,…

机器学习 · 计算机科学 2020-11-17 Kurtis Evan David , Qiang Liu , Ruth Fong

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

计算机视觉与模式识别 · 计算机科学 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

We evaluate four computational models of explanation in Bayesian networks by comparing model predictions to human judgments. In two experiments, we present human participants with causal structures for which the models make divergent…

人工智能 · 计算机科学 2013-09-27 Michael Pacer , Joseph Williams , Xi Chen , Tania Lombrozo , Thomas Griffiths

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

人工智能 · 计算机科学 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand.…

计算机视觉与模式识别 · 计算机科学 2021-09-29 Qianmengke Zhao , Ye Wang , Qun Liu