English
Related papers

Related papers: EvalAttAI: A Holistic Approach to Evaluating Attri…

200 papers

Interpretable machine learning offers insights into what factors drive a certain prediction of a black-box system. A large number of interpreting methods focus on identifying explanatory input features, which generally fall into two main…

Machine Learning · Computer Science 2023-06-02 Vy Vo , Van Nguyen , Trung Le , Quan Hung Tran , Gholamreza Haffari , Seyit Camtepe , Dinh Phung

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely…

Machine Learning · Computer Science 2021-03-09 Jamie Andrew Duell

The development of explainable artificial intelligence (xAI) methods for scene classification problems has attracted great attention in remote sensing (RS). Most xAI methods and the related evaluation metrics in RS are initially developed…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Jonas Klotz , Tom Burgert , Begüm Demir

Attribution methods can provide powerful insights into the reasons for a classifier's decision. We argue that a key desideratum of an explanation method is its robustness to input hyperparameters which are often randomly set or empirically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Naman Bansal , Chirag Agarwal , Anh Nguyen

Deep learning (DL) methods where interpretability is intrinsically considered as part of the model are required to better understand the relationship of clinical and imaging-based attributes with DL outcomes, thus facilitating their use in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-13 Irem Cetin , Maialen Stephens , Oscar Camara , Miguel Angel Gonzalez Ballester

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

Deep learning methods have been very effective for a variety of medical diagnostic tasks and has even beaten human experts on some of those. However, the black-box nature of the algorithms has restricted clinical use. Recent explainability…

Computer Vision and Pattern Recognition · Computer Science 2020-05-29 Amitojdeep Singh , Sourya Sengupta , Vasudevan Lakshminarayanan

Transparency of Machine Learning models used for decision support in various industries becomes essential for ensuring their ethical use. To that end, feature attribution methods such as SHAP (SHapley Additive exPlanations) are widely used…

Machine Learning · Computer Science 2022-12-08 Anna Bogdanova , Akira Imakura , Tetsuya Sakurai , Tomoya Fujii , Teppei Sakamoto , Hiroyuki Abe

Not only automation of manufacturing processes but also automation of automation procedures itself become increasingly relevant to automation research. In this context, automated capability assessment, mainly leveraged by deep learning…

Artificial Intelligence · Computer Science 2022-01-31 Raoul Schönhof , Artem Werner , Jannes Elstner , Boldizsar Zopcsak , Ramez Awad , Marco Huber

The integration of artificial intelligence into business processes has significantly enhanced decision-making capabilities across various industries such as finance, healthcare, and retail. However, explaining the decisions made by these AI…

Artificial Intelligence · Computer Science 2024-10-29 Arne Grobrugge , Nidhi Mishra , Johannes Jakubik , Gerhard Satzger

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

While there has been a recent explosion of work on ExplainableAI ExAI on deep models that operate on imagery and tabular data, textual datasets present new challenges to the ExAI community. Such challenges can be attributed to the lack of…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mariette Awad

Adversarial images highlight how vulnerable modern image classifiers are to perturbations outside of their training set. Human oversight might mitigate this weakness, but depends on humans understanding the AI well enough to predict when it…

Artificial Intelligence · Computer Science 2021-06-18 Tomas Folke , ZhaoBin Li , Ravi B. Sojitra , Scott Cheng-Hsin Yang , Patrick Shafto

eXplainable Artificial Intelligence (XAI) aims at providing understandable explanations of black box models. In this paper, we evaluate current XAI methods by scoring them based on ground truth simulations and sensitivity analysis. To this…

Novel AI-based arc fault diagnosis models have demonstrated outstanding performance in terms of classification accuracy. However, an inherent problem is whether these models can actually be trusted to find arc faults. In this light, this…

Artificial Intelligence · Computer Science 2025-07-22 Qianchao Wang , Yuxuan Ding , Chuanzhen Jia , Zhe Li , Yaping Du

Uncertainty is a key feature of any machine learning model and is particularly important in neural networks, which tend to be overconfident. This overconfidence is worrying under distribution shifts, where the model performance silently…

Machine Learning · Computer Science 2024-03-18 Arthur Thuy , Dries F. Benoit

Attribution methods shed light on the explainability of data-driven approaches such as deep learning models by uncovering the most influential features in a to-be-explained decision. While determining feature attributions via gradients…

Machine Learning · Computer Science 2024-05-15 Yi Cai , Gerhard Wunder

The use of deep learning in computer vision tasks such as image classification has led to a rapid increase in the performance of such systems. Due to this substantial increment in the utility of these systems, the use of artificial…

Image and Video Processing · Electrical Eng. & Systems 2023-04-05 Vinay Jogani , Joy Purohit , Ishaan Shivhare , Seema C Shrawne