English
Related papers

Related papers: Improving Deep Neural Network Classification Confi…

200 papers

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Junlin Hou , Sicen Liu , Yequan Bie , Hongmei Wang , Andong Tan , Luyang Luo , Hao Chen

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

With the increased usage of artificial intelligence (AI), it is imperative to understand how these models work internally. These needs have led to the development of a new field called eXplainable artificial intelligence (XAI). This field…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Miquel Miró-Nicolau , Antoni Jaume-i-Capó , Gabriel Moyà-Alcover

Counterfactual explanations have emerged as a popular solution for the eXplainable AI (XAI) problem of elucidating the predictions of black-box deep-learning systems due to their psychological validity, flexibility across problem domains…

Machine Learning · Computer Science 2022-12-20 Eoin Delaney , Arjun Pakrashi , Derek Greene , Mark T. Keane

In the ever-evolving field of Artificial Intelligence, a critical challenge has been to decipher the decision-making processes within the so-called "black boxes" in deep learning. Over recent years, a plethora of methods have emerged,…

Artificial Intelligence · Computer Science 2024-02-15 Karam Dawoud , Wojciech Samek , Peter Eisert , Sebastian Lapuschkin , Sebastian Bosse

The surge in black-box AI models has prompted the need to explain the internal mechanism and justify their reliability, especially in high-stakes applications, such as healthcare and autonomous driving. Due to the lack of a rigorous…

Artificial Intelligence · Computer Science 2024-03-18 Yongjie Wang , Tong Zhang , Xu Guo , Zhiqi Shen

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

For head and neck cancer (HNC) patients, prognostic outcome prediction can support personalized treatment strategy selection. Improving prediction performance of HNC outcomes has been extensively explored by using advanced artificial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Baoqiang Ma , Djennifer K. Madzia-Madzou , Rosa C. J. Kraaijveld , Jin Ouyang

The trustworthiness of neural networks is often challenged because they lack the ability to express uncertainty and explain their skill. This can be problematic given the increasing use of neural networks in high stakes decision-making such…

Atmospheric and Oceanic Physics · Physics 2022-12-07 Mariana C. A. Clare , Maike Sonnewald , Redouane Lguensat , Julie Deshayes , Venkatramani Balaji

The deployment of Machine Learning models intraoperatively for tissue characterisation can assist decision making and guide safe tumour resections. For image classification models, pixel attribution methods are popular to infer…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Alfie Roddan , Chi Xu , Serine Ajlouni , Irini Kakaletri , Patra Charalampaki , Stamatia Giannarou

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

The field of eXplainable artificial intelligence (XAI) has produced a plethora of methods (e.g., saliency-maps) to gain insight into artificial intelligence (AI) models, and has exploded with the rise of deep learning (DL). However,…

Human-Computer Interaction · Computer Science 2024-04-12 Marvin Pafla , Kate Larson , Mark Hancock

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

The increasing reliance on Deep Learning models, combined with their inherent lack of transparency, has spurred the development of a novel field of study known as eXplainable AI (XAI) methods. These methods seek to enhance the trust of…

We present a comprehensive analysis of quantitatively evaluating explainable artificial intelligence (XAI) techniques for remote sensing image classification. Our approach leverages state-of-the-art machine learning approaches to perform…

Machine Learning · Computer Science 2023-12-06 Akshatha Mohan , Joshua Peeples

The growing adoption of artificial intelligence in healthcare has raised concerns about the transparency and trustworthiness of AI-driven medical diagnosis systems. Many existing models operate as black boxes, limiting clinicians' ability…

Human-Computer Interaction · Computer Science 2026-04-21 Altynbek Seitenov , Ainur Nurzhanova , Azhar Bekbussinova , Yerassyl Bolatkan

Computer Vision, and hence Artificial Intelligence-based extraction of information from images, has increasingly received attention over the last years, for instance in medical diagnostics. While the algorithms' complexity is a reason for…

Human-Computer Interaction · Computer Science 2020-07-14 Christian Meske , Enrico Bunde

Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely…

Machine Learning · Computer Science 2021-03-09 Jamie Andrew Duell

We present a computational explainability approach for human comparison tasks, using Alignment Importance Score (AIS) heatmaps derived from deep-vision models. The AIS reflects a feature-map's unique contribution to the alignment between…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Nhut Truong , Dario Pesenti , Uri Hasson