中文
相关论文

相关论文: Evaluating the Utility of Model Explanations for M…

200 篇论文

Explainable Artificial Intelligence (XAI) is essential for building advanced machine learning-powered applications, especially in critical domains such as medical diagnostics or autonomous driving. Legal, business, and ethical requirements…

Artificial Intelligence/Machine Learning techniques have been widely used in software engineering to improve developer productivity, the quality of software systems, and decision-making. However, such AI/ML models for software engineering…

软件工程 · 计算机科学 2020-12-04 Chakkrit Tantithamthavorn , Jirayus Jiarpakdee , John Grundy

Due to the absence of ground truth, objective evaluation of explainability methods is an essential research direction. So far, the vast majority of evaluations can be summarized into three categories, namely human evaluation, sensitivity…

人工智能 · 计算机科学 2024-05-01 Hanxiao Tan

Explainability is needed to establish confidence in machine learning results. Some explainable methods take a post hoc approach to explain the weights of machine learning models, others highlight areas of the input contributing to…

机器学习 · 计算机科学 2024-07-15 Paul Whitten , Francis Wolff , Chris Papachristou

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

机器学习 · 计算机科学 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics, along with an exhaustive experimental study…

人工智能 · 计算机科学 2021-01-01 Xiao-Hui Li , Yuhan Shi , Haoyang Li , Wei Bai , Yuanwei Song , Caleb Chen Cao , Lei Chen

Modern data analytics underpinned by machine learning techniques has become a key enabler to the automation of data-led decision making. As an important branch of state-of-the-art data analytics, business process predictions are also faced…

人工智能 · 计算机科学 2021-07-22 Chun Ouyang , Renuka Sindhgatta , Catarina Moreira

Understanding the decisions made and actions taken by increasingly complex AI system remains a key challenge. This has led to an expanding field of research in explainable artificial intelligence (XAI), highlighting the potential of…

Recent years have seen a boom in interest in machine learning systems that can provide a human-understandable rationale for their predictions or decisions. However, exactly what kinds of explanation are truly human-interpretable remains…

机器学习 · 计算机科学 2019-08-30 Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Sam Gershman , Finale Doshi-Velez

Although deep models achieve high predictive performance, it is difficult for humans to understand the predictions they made. Explainability is important for real-world applications to justify their reliability. Many example-based…

机器学习 · 统计学 2021-12-08 Tomoharu Iwata , Yuya Yoshikawa

In explainable artificial intelligence (XAI) research, the predominant focus has been on interpreting models for experts and practitioners. Model agnostic and local explanation approaches are deemed interpretable and sufficient in many…

人工智能 · 计算机科学 2024-02-01 Adarsa Sivaprasad , Ehud Reiter , Nava Tintarev , Nir Oren

The need for systems to explain behavior to users has become more evident with the rise of complex technology like machine learning or self-adaptation. In general, the need for an explanation arises when the behavior of a system does not…

软件工程 · 计算机科学 2021-08-16 Mersedeh Sadeghi , Verena Klös , Andreas Vogelsang

Deep learning models have performed well on many NLP tasks. However, their internal mechanisms are typically difficult for humans to understand. The development of methods to explain models has become a key issue in the reliability of deep…

人机交互 · 计算机科学 2024-05-20 Xiaotian Lu , Jiyi Li , Zhen Wan , Xiaofeng Lin , Koh Takeuchi , Hisashi Kashima

Explainability is a critical factor in enhancing the trustworthiness and acceptance of artificial intelligence (AI) in healthcare, where decisions directly impact patient outcomes. Despite advancements in AI interpretability, clear…

人工智能 · 计算机科学 2025-05-15 Michail Mamalakis , Héloïse de Vareilles , Graham Murray , Pietro Lio , John Suckling

The explanation dimension of Artificial Intelligence (AI) based system has been a hot topic for the past years. Different communities have raised concerns about the increasing presence of AI in people's everyday tasks and how it can affect…

人机交互 · 计算机科学 2021-02-23 Juliana Jansen Ferreira , Mateus Monteiro

We take inspiration from the study of human explanation to inform the design and evaluation of interpretability methods in machine learning. First, we survey the literature on human explanation in philosophy, cognitive science, and the…

人工智能 · 计算机科学 2021-09-21 David Alvarez-Melis , Harmanpreet Kaur , Hal Daumé , Hanna Wallach , Jennifer Wortman Vaughan

There is a growing interest within the AI research community to develop autonomous systems capable of explaining their behavior to users. One aspect of the explanation generation problem that has yet to receive much attention is the task of…

人工智能 · 计算机科学 2018-02-21 Sarath Sreedharan , Siddharth Srivastava , Subbarao Kambhampati

Training a model with access to human explanations can improve data efficiency and model performance on in- and out-of-domain data. Adding to these empirical findings, similarity with the process of human learning makes learning from…

计算与语言 · 计算机科学 2022-04-20 Mareike Hartmann , Daniel Sonntag

Saliency maps are widely used for visual explanations in deep learning, but a fundamental lack of consensus persists regarding their intended purpose and alignment with diverse user queries. This ambiguity hinders the effective evaluation…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Yehonatan Elisha , Seffi Cohen , Oren Barkan , Noam Koenigstein

The increasingly widespread application of AI models motivates increased demand for explanations from a variety of stakeholders. However, this demand is ambiguous because there are many types of 'explanation' with different evaluative…

人工智能 · 计算机科学 2021-06-29 Yiheng Yao