中文
相关论文

相关论文: Focus! Rating XAI Methods and Finding Biases

200 篇论文

In the field of eXplainable AI (XAI), robust "blackbox" algorithms such as Convolutional Neural Networks (CNNs) are known for making high prediction performance. However, the ability to explain and interpret these algorithms still require…

机器学习 · 计算机科学 2021-11-25 Shaw-Hwa Lo , Yiqiao Yin

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

机器学习 · 计算机科学 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

计算机与社会 · 计算机科学 2023-06-14 Bhavya Ghai

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

人工智能 · 计算机科学 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

Explainability plays a crucial role in providing a more comprehensive understanding of deep learning models' behaviour. This allows for thorough validation of the model's performance, ensuring that its decisions are based on relevant visual…

机器学习 · 计算机科学 2023-06-16 E. Zhixuan Zeng , Hayden Gunraj , Sheldon Fernandez , Alexander Wong

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

Convolutional Neural Networks (CNNs) are frequently and successfully used in medical prediction tasks. They are often used in combination with transfer learning, leading to improved performance when training data for the task are scarce.…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Marta Oliveira , Rick Wilming , Benedict Clark , Céline Budding , Fabian Eitel , Kerstin Ritter , Stefan Haufe

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

人工智能 · 计算机科学 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

Deep learning models have achieved remarkable success across diverse domains. However, the intricate nature of these models often impedes a clear understanding of their decision-making processes. This is where Explainable AI (XAI) becomes…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Soham Mitra , Atri Sukul , Swalpa Kumar Roy , Pravendra Singh , Vinay Verma

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Despite the growing interest in Explainable Artificial Intelligence (XAI), explainability is rarely considered during hyperparameter tuning or neural architecture optimization, where the focus remains primarily on minimizing predictive…

机器学习 · 计算机科学 2025-05-26 Alexander Hinterleitner , Thomas Bartz-Beielstein

Explainable AI (XAI) methods identify which features are relevant to a model's predictions but often fail to clarify why certain decisions are made. In this work, we present a novel method that integrates causality with argument-based…

人工智能 · 计算机科学 2026-05-22 Henry Salgado , Meagan R. Kendall , Martine Ceberio

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

机器学习 · 计算机科学 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

机器学习 · 计算机科学 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Gradient-based attribution methods can aid in the understanding of convolutional neural networks (CNNs). However, the redundancy of attribution features and the gradient saturation problem, which weaken the ability to identify significant…

计算机视觉与模式识别 · 计算机科学 2021-04-13 An Zhang , Xiang Wang , Chengfang Fang , Jie Shi , Tat-seng Chua , Zehua Chen

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

计算机视觉与模式识别 · 计算机科学 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

Good quality explanations strengthen the understanding of language models and data. Feature attribution methods, such as Integrated Gradient, are a type of post-hoc explainer that can provide token-level insights. However, explanations on…

计算与语言 · 计算机科学 2026-04-21 Jonathan Kamp , Roos Bakker , Dominique Blok

Explainable artificial intelligence (XAI) methods shed light on the predictions of machine learning algorithms. Several different approaches exist and have already been applied in climate science. However, usually missing ground truth…

机器学习 · 计算机科学 2024-03-25 Philine Bommer , Marlene Kretschmer , Anna Hedström , Dilyara Bareeva , Marina M. -C. Höhne

Attribution methods reveal which input features a neural network uses for a prediction, adding transparency to their decisions. A common problem is that these attributions seem unspecific, highlighting both important and irrelevant…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Nils Philipp Walter , Jilles Vreeken , Jonas Fischer