English
Related papers

Related papers: EvalAttAI: A Holistic Approach to Evaluating Attri…

200 papers

The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-20 Cristiano Patrício , João C. Neves , Luís F. Teixeira

Deep Neural Networks have been successfully used for the task of Visual Question Answering for the past few years owing to the availability of relevant large scale datasets. However these datasets are created in artificial settings and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Shaunak Halbe

The impressive capabilities of deep learning models are often counterbalanced by their inherent opacity, commonly termed the "black box" problem, which impedes their widespread acceptance in high-trust domains. In response, the intersecting…

Machine Learning · Computer Science 2025-09-16 Mitali Raj

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

We are used to the availability of big data generated in nearly all fields of science as a consequence of technological progress. However, the analysis of such data possess vast challenges. One of these relates to the explainability of…

Artificial Intelligence · Computer Science 2022-09-14 Frank Emmert-Streib , Olli Yli-Harja , Matthias Dehmer

Deep visual models have widespread applications in high-stake domains. Hence, their black-box nature is currently attracting a large interest of the research community. We present the first survey in Explainable AI that focuses on the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Naveed Akhtar

Explainability features are intended to provide insight into the internal mechanisms of an AI device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and…

Artificial Intelligence · Computer Science 2025-06-18 Miguel A. Lago , Ghada Zamzmi , Brandon Eich , Jana G. Delfino

Predictive uncertainties in classification tasks are often a consequence of model inadequacy or insufficient training data. In popular applications, such as image processing, we are often required to scrutinise these uncertainties by…

Machine Learning · Computer Science 2022-11-10 Iker Perez , Piotr Skalski , Alec Barns-Graham , Jason Wong , David Sutton

Ensuring trust and accountability in Artificial Intelligence systems demands explainability of its outcomes. Despite significant progress in Explainable AI, human biases still taint a substantial portion of its training data, raising…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Philipp Ratz , François Hu , Arthur Charpentier

Different users of machine learning methods require different explanations, depending on their goals. To make machine learning accountable to society, one important goal is to get actionable options for recourse, which allow an affected…

Machine Learning · Statistics 2023-12-21 Hidde Fokkema , Rianne de Heide , Tim van Erven

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

Understanding the flow of information in Deep Neural Networks (DNNs) is a challenging problem that has gain increasing attention over the last few years. While several methods have been proposed to explain network predictions, there have…

Machine Learning · Computer Science 2018-03-08 Marco Ancona , Enea Ceolini , Cengiz Öztireli , Markus Gross

In recent years, there has been a significant surge in malware attacks, necessitating more advanced preventive measures and remedial strategies. While several successful AI-based malware classification approaches exist categorized into…

Cryptography and Security · Computer Science 2024-04-22 Quincy Card , Daniel Simpson , Kshitiz Aryal , Maanak Gupta , Sheikh Rabiul Islam

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

The lack of explainability of a decision from an Artificial Intelligence (AI) based "black box" system/model, despite its superiority in many real-world applications, is a key stumbling block for adopting AI in many high stakes applications…

Artificial Intelligence · Computer Science 2021-01-26 Sheikh Rabiul Islam , William Eberle , Sheikh Khaled Ghafoor , Mohiuddin Ahmed

As the request for deep learning solutions increases, the need for explainability is even more fundamental. In this setting, particular attention has been given to visualization techniques, that try to attribute the right relevance to each…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Samuele Poppi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Recent years have witnessed the widespread use of artificial intelligence (AI) algorithms and machine learning (ML) models. Despite their tremendous success, a number of vital problems like ML model brittleness, their fairness, and the lack…

Artificial Intelligence · Computer Science 2023-08-29 Jinqiang Yu , Alexey Ignatiev , Peter J. Stuckey

As machine learning and algorithmic decision making systems are increasingly being leveraged in high-stakes human-in-the-loop settings, there is a pressing need to understand the rationale of their predictions. Researchers have responded to…

Machine Learning · Computer Science 2020-12-07 Jonathan Dinu , Jeffrey Bigham , J. Zico Kolter

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake