English
Related papers

Related papers: Focus! Rating XAI Methods and Finding Biases

200 papers

In the field of eXplainable AI (XAI), robust "blackbox" algorithms such as Convolutional Neural Networks (CNNs) are known for making high prediction performance. However, the ability to explain and interpret these algorithms still require…

Machine Learning · Computer Science 2021-11-25 Shaw-Hwa Lo , Yiqiao Yin

Explainability of AI models is an important topic that can have a significant impact in all domains and applications from autonomous driving to healthcare. The existing approaches to explainable AI (XAI) are mainly limited to simple machine…

Machine Learning · Computer Science 2023-05-24 Poushali Sengupta , Yan Zhang , Sabita Maharjan , Frank Eliassen

There has been a significant surge of interest recently around the concept of explainable artificial intelligence (XAI), where the goal is to produce an interpretation for a decision made by a machine learning algorithm. Of particular…

Machine Learning · Computer Science 2019-10-31 Zhong Qiu Lin , Mohammad Javad Shafiee , Stanislav Bochkarev , Michael St. Jules , Xiao Yu Wang , Alexander Wong

The rise of machine learning (ML) is accompanied by several high-profile cases that have stressed the need for fairness, accountability, explainability and trust in ML systems. The existing literature has largely focused on fully automated…

Computers and Society · Computer Science 2023-06-14 Bhavya Ghai

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

Explainability plays a crucial role in providing a more comprehensive understanding of deep learning models' behaviour. This allows for thorough validation of the model's performance, ensuring that its decisions are based on relevant visual…

Machine Learning · Computer Science 2023-06-16 E. Zhixuan Zeng , Hayden Gunraj , Sheldon Fernandez , Alexander Wong

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

Convolutional Neural Networks (CNNs) are frequently and successfully used in medical prediction tasks. They are often used in combination with transfer learning, leading to improved performance when training data for the task are scarce.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Marta Oliveira , Rick Wilming , Benedict Clark , Céline Budding , Fabian Eitel , Kerstin Ritter , Stefan Haufe

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

Artificial Intelligence · Computer Science 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

Deep learning models have achieved remarkable success across diverse domains. However, the intricate nature of these models often impedes a clear understanding of their decision-making processes. This is where Explainable AI (XAI) becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Soham Mitra , Atri Sukul , Swalpa Kumar Roy , Pravendra Singh , Vinay Verma

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Despite the growing interest in Explainable Artificial Intelligence (XAI), explainability is rarely considered during hyperparameter tuning or neural architecture optimization, where the focus remains primarily on minimizing predictive…

Machine Learning · Computer Science 2025-05-26 Alexander Hinterleitner , Thomas Bartz-Beielstein

Explainable AI (XAI) methods identify which features are relevant to a model's predictions but often fail to clarify why certain decisions are made. In this work, we present a novel method that integrates causality with argument-based…

Artificial Intelligence · Computer Science 2026-05-22 Henry Salgado , Meagan R. Kendall , Martine Ceberio

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Although modern machine learning and deep learning methods allow for complex and in-depth data analytics, the predictive models generated by these methods are often highly complex, and lack transparency. Explainable AI (XAI) methods are…

Machine Learning · Computer Science 2021-06-17 Mythreyi Velmurugan , Chun Ouyang , Catarina Moreira , Renuka Sindhgatta

Gradient-based attribution methods can aid in the understanding of convolutional neural networks (CNNs). However, the redundancy of attribution features and the gradient saturation problem, which weaken the ability to identify significant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 An Zhang , Xiang Wang , Chengfang Fang , Jie Shi , Tat-seng Chua , Zehua Chen

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

Good quality explanations strengthen the understanding of language models and data. Feature attribution methods, such as Integrated Gradient, are a type of post-hoc explainer that can provide token-level insights. However, explanations on…

Computation and Language · Computer Science 2026-04-21 Jonathan Kamp , Roos Bakker , Dominique Blok

Explainable artificial intelligence (XAI) methods shed light on the predictions of machine learning algorithms. Several different approaches exist and have already been applied in climate science. However, usually missing ground truth…

Machine Learning · Computer Science 2024-03-25 Philine Bommer , Marlene Kretschmer , Anna Hedström , Dilyara Bareeva , Marina M. -C. Höhne

Attribution methods reveal which input features a neural network uses for a prediction, adding transparency to their decisions. A common problem is that these attributions seem unspecific, highlighting both important and irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Nils Philipp Walter , Jilles Vreeken , Jonas Fischer
‹ Prev 1 3 4 5 6 7 10 Next ›