English
Related papers

Related papers: Explaining and visualizing black-box models throug…

200 papers

We examine counterfactual explanations for explaining the decisions made by model-based AI systems. The counterfactual approach we consider defines an explanation as a set of the system's data inputs that causally drives the decision (i.e.,…

Machine Learning · Computer Science 2021-10-14 Carlos Fernández-Loría , Foster Provost , Xintian Han

There has been considerable recent interest in explainability in AI, especially with black-box machine learning models. As correctly observed by the planning community, when the application at hand is not a single-shot decision or…

Artificial Intelligence · Computer Science 2025-02-14 Vaishak Belle

With the rising necessity of explainable artificial intelligence (XAI), we see an increase in task-dependent XAI methods on varying abstraction levels. XAI techniques on a global level explain model behavior and on a local level explain…

Human-Computer Interaction · Computer Science 2023-07-18 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

Explainable artificial intelligence (XAI) is an emerging new domain in which a set of processes and tools allow humans to better comprehend the decisions generated by black box models. However, most of the available XAI tools are often…

Machine Learning · Computer Science 2021-07-22 Zoumpolia Dikopoulou , Serafeim Moustakidis , Patrik Karlsson

Explainable artificial intelligence (XAI) has become increasingly important in biomedical image analysis to promote transparency, trust, and clinical adoption of DL models. While several surveys have reviewed XAI techniques, they often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Getamesay Haile Dagnaw , Yanming Zhu , Muhammad Hassan Maqsood , Wencheng Yang , Xingshuai Dong , Xuefei Yin , Alan Wee-Chung Liew

Neural Networks are ubiquitous in high energy physics research. However, these highly nonlinear parameterized functions are treated as \textit{black boxes}- whose inner workings to convey information and build the desired input-output…

High Energy Physics - Experiment · Physics 2022-06-15 Mark S. Neubauer , Avik Roy

To understand the black-box characteristics of deep networks, counterfactual explanation that deduces not only the important features of an input space but also how those features should be modified to classify input as a target class has…

Machine Learning · Computer Science 2022-08-15 Hong-Gyu Jung , Sin-Han Kang , Hee-Dong Kim , Dong-Ok Won , Seong-Whan Lee

Counterfactual Explanations (cf-XAI) describe the smallest changes in feature values necessary to change an outcome from one class to another. However, many cf-XAI methods neglect the feasibility of those changes. In this paper, we…

Artificial Intelligence · Computer Science 2023-10-04 Pedram Salimi , Nirmalie Wiratunga , David Corsar , Anjana Wijekoon

Explainable Artificial Intelligence (XAI) methods help to understand the internal mechanism of machine learning models and how they reach a specific decision or made a specific action. The list of informative features is one of the most…

Artificial Intelligence · Computer Science 2024-06-18 Ahmed M Salih

Artificial intelligence (AI) systems utilizing deep neural networks (DNNs) and machine learning (ML) algorithms are widely used for solving important problems in bioinformatics, biomedical informatics, and precision medicine. However,…

Quantitative Methods · Quantitative Biology 2023-02-24 Md. Rezaul Karim , Tanhim Islam , Oya Beyan , Christoph Lange , Michael Cochez , Dietrich Rebholz-Schuhmann , Stefan Decker

Understanding the reasoning behind deep learning model predictions is crucial in cheminformatics and drug discovery, where molecular design determines their properties. However, current evaluation frameworks for Explainable AI (XAI) in this…

Machine Learning · Computer Science 2025-05-29 Magdalena Proszewska , Tomasz Danel , Dawid Rymarczyk

The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the…

Machine Learning · Computer Science 2024-08-14 Gregory Yampolsky , Dhruv Desai , Mingshu Li , Stefano Pasquali , Dhagash Mehta

Artificial intelligence systems are widely used by people with sensory disabilities, like loss of vision or hearing, to help perceive or navigate the world around them. This includes tasks like describing an image or object they cannot…

Human-Computer Interaction · Computer Science 2026-03-04 Shadab H. Choudhury

Ensuring transparency and trust in artificial intelligence (AI) models is essential as they are increasingly deployed in safety-critical and high-stakes domains. Explainable AI (XAI) has emerged as a promising approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Reem Hammoud , Abdul Karim Gizzini , Ali J. Ghandour

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

Computation and Language · Computer Science 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

We introduce a novel methodology for identifying adversarial attacks on deepfake detectors using eXplainable Artificial Intelligence (XAI). In an era characterized by digital advancement, deepfakes have emerged as a potent tool, creating a…

Cryptography and Security · Computer Science 2024-08-20 Ben Pinhasov , Raz Lapid , Rony Ohayon , Moshe Sipper , Yehudit Aperstein

Post-hoc explainability methods are a subset of Machine Learning (ML) that aim to provide a reason for why a model behaves in a certain way. In this paper, we show a new black-box model-agnostic adversarial attack for post-hoc explainable…

Machine Learning · Computer Science 2025-11-14 Leonardo Pesce , Jiawen Wei , Gianmarco Mengaldo

Recent advances in deep learning have improved multivariate time series (MTS) classification and regression by capturing complex patterns, but their lack of transparency hinders decision-making. Explainable AI (XAI) methods offer partial…

Machine Learning · Computer Science 2025-11-25 Alan G. Paredes Cetina , Kaouther Benguessoum , Raoni Lourenço , Sylvain Kubler

EXplainable Artificial Intelligence (XAI) is a vibrant research topic in the artificial intelligence community, with growing interest across methods and domains. Much has been written about the subject, yet XAI still lacks shared…

Artificial Intelligence · Computer Science 2023-06-16 Matteo Rizzo , Alberto Veneri , Andrea Albarelli , Claudio Lucchese , Marco Nobile , Cristina Conati

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel