English
Related papers

Related papers: A Comparative Study of Explainable AI Methods: Mod…

200 papers

This paper presents a comprehensive theoretical investigation into the parameterized complexity of explanation problems in various machine learning (ML) models. Contrary to the prevalent black-box perception, our study focuses on models…

Artificial Intelligence · Computer Science 2025-11-06 Sebastian Ordyniak , Giacomo Paesani , Mateusz Rychlicki , Stefan Szeider

Advancements in high-throughput technologies have led to a shift from traditional hypothesis-driven methodologies to data-driven approaches. Multi-omics refers to the integrative analysis of data derived from multiple 'omes', such as…

Genomics · Quantitative Biology 2024-10-17 Ahmad Hussein , Mukesh Prasad , Ali Braytee

Post-hoc explainability methods are a subset of Machine Learning (ML) that aim to provide a reason for why a model behaves in a certain way. In this paper, we show a new black-box model-agnostic adversarial attack for post-hoc explainable…

Machine Learning · Computer Science 2025-11-14 Leonardo Pesce , Jiawen Wei , Gianmarco Mengaldo

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Given the pressing need for assuring algorithmic transparency, Explainable AI (XAI) has emerged as one of the key areas of AI research. In this paper, we develop a novel Bayesian extension to the LIME framework, one of the most widely used…

Artificial Intelligence · Computer Science 2021-06-01 Xingyu Zhao , Wei Huang , Xiaowei Huang , Valentin Robu , David Flynn

Explainable AI (XAI) helps users interpret model behavior and identify potential faults. Agentic XAI systems use Large Language Models (LLMs) to make explanations more accessible through natural-language interaction, but they can also…

Artificial Intelligence · Computer Science 2026-05-28 Jaechang Kim , Sunung Mun , Seungjoon Lee , Jaewoong Cho , Jungseul Ok

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

In Multiple Instance Learning (MIL), models are trained using bags of instances, where only a single label is provided for each bag. A bag label is often only determined by a handful of key instances within a bag, making it difficult to…

Machine Learning · Computer Science 2022-03-16 Joseph Early , Christine Evers , Sarvapali Ramchurn

Ensuring both transparency and safety is critical when deploying Deep Neural Networks (DNNs) in high-risk applications, such as medicine. The field of explainable AI (XAI) has proposed various methods to comprehend the decision-making…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maximilian Dreyer , Reduan Achtibat , Wojciech Samek , Sebastian Lapuschkin

The application of machine learning based decision making systems in safety critical areas requires reliable high certainty predictions. Reject options are a common way of ensuring a sufficiently high certainty of predictions made by the…

Artificial Intelligence · Computer Science 2022-05-17 André Artelt , Roel Visser , Barbara Hammer

The black-box nature of large language models (LLMs) necessitates the development of eXplainable AI (XAI) techniques for transparency and trustworthiness. However, evaluating these techniques remains a challenge. This study presents a…

Computation and Language · Computer Science 2025-03-14 Melkamu Abay Mersha , Mesay Gemeda Yigezu , Jugal Kalita

Explainable AI (XAI) techniques are necessary to help clinicians make sense of AI predictions and integrate predictions into their decision-making workflow. In this work, we conduct a survey study to understand clinician preference among…

Computation and Language · Computer Science 2025-08-28 Jun Hou , Lucy Lu Wang

Despite the progress observed with model-agnostic explainable AI (XAI), it is the case that model-agnostic XAI can produce incorrect explanations. One alternative are the so-called formal approaches to XAI, that include PI-explanations.…

Machine Learning · Computer Science 2022-07-12 Yacine Izza , Joao Marques-Silva

A particular class of Explainable AI (XAI) methods provide saliency maps to highlight part of the image a Convolutional Neural Network (CNN) model looks at to classify the image as a way to explain its working. These methods provide an…

Machine Learning · Computer Science 2021-06-25 Sam Zabdiel Sunder Samuel , Vidhya Kamakshi , Namrata Lodhi , Narayanan C Krishnan

Increasingly complex learning methods such as boosting, bagging and deep learning have made ML models more accurate, but harder to understand and interpret. A tradeoff between performance and intelligibility is often to be faced, especially…

Machine Learning · Computer Science 2023-12-18 Enea Parimbelli , Giovanna Nicora , Szymon Wilk , Wojtek Michalowski , Riccardo Bellazzi

In the meantime, a wide variety of terminologies, motivations, approaches, and evaluation criteria have been developed within the research field of explainable artificial intelligence (XAI). With the amount of XAI methods vastly growing, a…

Machine Learning · Computer Science 2023-01-10 Gesina Schwalbe , Bettina Finzel

Deep Learning (DL) models processing images to recognize the health state of large infrastructure components can exhibit biases and rely on non-causal shortcuts. eXplainable Artificial Intelligence (XAI) can address these issues but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Giovanni Floreale , Piero Baraldi , Enrico Zio , Olga Fink

Deep neural networks form the backbone of artificial intelligence research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy

EXplainable AI (XAI) is an essential topic to improve human understanding of deep neural networks (DNNs) given their black-box internals. For computer vision tasks, mainstream pixel-based XAI methods explain DNN decisions by identifying…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Ao Sun , Pingchuan Ma , Yuanyuan Yuan , Shuai Wang

This paper delves into the contrasting roles of data within academic and industrial spheres, highlighting the divergence between Data-Centric AI and Model-Agnostic AI approaches. We argue that while Data-Centric AI focuses on the primacy of…

Artificial Intelligence · Computer Science 2024-03-05 Chanjun Park , Minsoo Khang , Dahyun Kim