中文
相关论文

相关论文: Back to the Baseline: Examining Baseline Effects o…

200 篇论文

Feature attribution maps are a popular approach to highlight the most important pixels in an image for a given prediction of a model. Despite a recent growth in popularity and available methods, little attention is given to the objective…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Arne Gevaert , Axel-Jan Rousseau , Thijs Becker , Dirk Valkenborg , Tijl De Bie , Yvan Saeys

Many explainable AI (XAI) techniques strive for interpretability by providing concise salient information, such as sparse linear factors. However, users either only see inaccurate global explanations, or highly-varying local explanations.…

人机交互 · 计算机科学 2024-04-11 Jessica Y. Bo , Pan Hao , Brian Y. Lim

We discuss a way to find a well behaved baseline for attribution methods that work by feeding a neural network with a sequence of interpolated inputs between two given inputs. Then, we test it with our novel Riemann-Stieltjes Integrated…

计算机视觉与模式识别 · 计算机科学 2022-04-14 Miguel Lerma , Mirtha Lucas

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

计算机视觉与模式识别 · 计算机科学 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Explainable AI has attracted much research attention in recent years with feature attribution algorithms, which compute "feature importance" in predictions, becoming increasingly popular. However, there is little analysis of the validity of…

人工智能 · 计算机科学 2021-05-21 Orcun Yalcin , Xiuyi Fan , Siyuan Liu

Within the field of Requirements Engineering (RE), the increasing significance of Explainable Artificial Intelligence (XAI) in aligning AI-supported systems with user needs, societal expectations, and regulatory standards has garnered…

人工智能 · 计算机科学 2023-07-27 Timo Speith , Markus Langer

Explainable AI aims to render model behavior understandable by humans, which can be seen as an intermediate step in extracting causal relations from correlative patterns. Due to the high risk of possible fatal decisions in image-based…

计算机视觉与模式识别 · 计算机科学 2023-06-16 Lukas Klein , João B. S. Carvalho , Mennatallah El-Assady , Paolo Penna , Joachim M. Buhmann , Paul F. Jaeger

A multitude of explainability methods and associated fidelity performance metrics have been proposed to help better understand how modern AI systems make decisions. However, much of the current work has remained theoretical -- without much…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Julien Colin , Thomas Fel , Remi Cadene , Thomas Serre

The advancements in deep learning-based methods for visual perception tasks have seen astounding growth in the last decade, with widespread adoption in a plethora of application areas from autonomous driving to clinical decision support…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Kumar Abhishek , Deeksha Kamath

The currently dominating artificial intelligence and machine learning technology, neural networks, builds on inductive statistical learning. Neural networks of today are information processing systems void of understanding and reasoning…

人工智能 · 计算机科学 2022-08-26 Lars Holmberg

Artificial intelligence (AI) is being applied in almost every field. At the same time, the currently dominant deep learning methods are fundamentally black-box systems that lack explanations for their inferences, significantly limiting…

人工智能 · 计算机科学 2025-10-06 Martina Mattioli , Eike Petersen , Aasa Feragen , Marcello Pelillo , Siavash A. Bigdeli

In recent years, neural networks have demonstrated their remarkable ability to discern intricate patterns and relationships from raw data. However, understanding the inner workings of these black box models remains challenging, yet crucial…

机器学习 · 统计学 2024-04-18 Niklas Koenen , Marvin N. Wright

Feature attribution methods identify which features of an input most influence a model's output. Most widely-used feature attribution methods (such as SHAP, LIME, and Grad-CAM) are "class-dependent" methods in that they generate a feature…

机器学习 · 计算机科学 2023-02-28 Neil Jethani , Adriel Saporta , Rajesh Ranganath

Most methods in explainable AI (XAI) focus on providing reasons for the prediction of a given set of features. However, we solve an inverse explanation problem, i.e., given the deviation of a label, find the reasons of this deviation. We…

机器学习 · 计算机科学 2024-11-06 Quan Long

Explainable AI (xAI) methods are important for establishing trust in using black-box models. However, recent criticism has mounted against current xAI methods that they disagree, are necessarily false, and can be manipulated, which has…

人工智能 · 计算机科学 2024-04-26 Emily Sullivan

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

机器学习 · 计算机科学 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

Deep Neural Networks (DNNs) have demonstrated strong capacity in supporting a wide variety of applications. Shapley value has emerged as a prominent tool to analyze feature importance to help people understand the inference process of deep…

机器学习 · 统计学 2025-02-19 Xiaolei Lu

Explainable Artificial Intelligence (XAI) has become increasingly significant for improving the interpretability and trustworthiness of machine learning models. While saliency maps have stolen the show for the last few years in the XAI…

人工智能 · 计算机科学 2023-09-08 Antonin Poché , Lucas Hervier , Mohamed-Chafik Bakkay

Explainable artificial intelligence (XAI) methods have become increasingly important in the context of explainable intrusion detection systems (X-IDSs) for improving the interpretability and trustworthiness of X-IDSs. However, existing…

密码学与安全 · 计算机科学 2025-05-14 Mohammed Alquliti , Erisa Karafili , BooJoong Kang

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

人工智能 · 计算机科学 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen