English
Related papers

Related papers: What Do You See? Evaluation of Explainable Artific…

200 papers

Despite the recent, widespread focus on eXplainable AI (XAI), explanations computed by XAI methods tend to provide little insight into the functioning of Neural Networks (NNs). We propose a novel framework for obtaining (local) explanations…

Artificial Intelligence · Computer Science 2021-06-15 Emanuele Albini , Piyawat Lertvittayakumjorn , Antonio Rago , Francesca Toni

The need for interpretable and accountable intelligent systems grows along with the prevalence of artificial intelligence applications used in everyday life. Explainable intelligent systems are designed to self-explain the reasoning behind…

Human-Computer Interaction · Computer Science 2020-08-06 Sina Mohseni , Niloofar Zarei , Eric D. Ragan

Deep Learning has already been successfully applied to analyze industrial sensor data in a variety of relevant use cases. However, the opaque nature of many well-performing methods poses a major obstacle for real-world deployment.…

Machine Learning · Computer Science 2023-10-20 Thomas Decker , Michael Lebacher , Volker Tresp

Deep neural networks form the backbone of artificial intelligence research, with potential to transform the human experience in areas ranging from autonomous driving to personal assistants, healthcare to education. However, their…

Machine Learning · Computer Science 2025-05-29 Vinitra Swamy

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

Explainable AI (XAI) methods are commonly evaluated with functional metrics such as correctness, which computationally estimate how accurately an explanation reflects the model's reasoning. Higher correctness is assumed to produce better…

Human-Computer Interaction · Computer Science 2026-03-27 Gregor Baer , Chao Zhang , Isel Grau , Pieter Van Gorp

Explainable AI (XAI) has revolutionized the field of deep learning by empowering users to have more trust in neural network models. The field of XAI allows users to probe the inner workings of these algorithms to elucidate their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Prithwijit Chowdhury , Mohit Prabhushankar , Ghassan AlRegib , Mohamed Deriche

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

A Network Intrusion Detection System (NIDS) monitors networks for cyber attacks and other unwanted activities. However, NIDS solutions often generate an overwhelming number of alerts daily, making it challenging for analysts to prioritize…

Cryptography and Security · Computer Science 2025-06-10 Rajesh Kalakoti , Risto Vaarandi , Hayretdin Bahsi , Sven Nõmm

Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years. Among various approaches to XAI, argumentative models have been advocated in both the AI and social…

Artificial Intelligence · Computer Science 2021-05-25 Kristijonas Čyras , Antonio Rago , Emanuele Albini , Pietro Baroni , Francesca Toni

XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have…

Understanding the reasons behind the predictions made by deep neural networks is critical for gaining human trust in many important applications, which is reflected in the increasing demand for explainability in AI (XAI) in recent years.…

Human-Computer Interaction · Computer Science 2021-08-31 Xiaotian Lu , Arseny Tolmachev , Tatsuya Yamamoto , Koh Takeuchi , Seiji Okajima , Tomoyoshi Takebayashi , Koji Maruhashi , Hisashi Kashima

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

Deep neural networks (DNNs) are increasingly being used as controllers in reactive systems. However, DNNs are highly opaque, which renders it difficult to explain and justify their actions. To mitigate this issue, there has been a surge of…

Artificial Intelligence · Computer Science 2023-10-06 Shahaf Bassan , Guy Amir , Davide Corsi , Idan Refaeli , Guy Katz

Attribution methods compute importance scores for input features to explain model predictions. However, assessing the faithfulness of these methods remains challenging due to the absence of attribution ground truth to model predictions. In…

Cryptography and Security · Computer Science 2025-10-02 Peiyu Yang , Naveed Akhtar , Jiantong Jiang , Ajmal Mian

Explainable Artificial Intelligence (XAI) emerged to reveal the internal mechanism of machine learning models and how the features affect the prediction outcome. Collinearity is one of the big issues that XAI methods face when identifying…

Machine Learning · Computer Science 2024-11-05 Ahmed M Salih

Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely…

Machine Learning · Computer Science 2021-03-09 Jamie Andrew Duell

Explainable AI (XAI) is the study on how humans can be able to understand the cause of a model's prediction. In this work, the problem of interest is Scene Text Recognition (STR) Explainability, using XAI to understand the cause of an STR…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Mark Vincent Ty , Rowel Atienza

In the meantime, a wide variety of terminologies, motivations, approaches, and evaluation criteria have been developed within the research field of explainable artificial intelligence (XAI). With the amount of XAI methods vastly growing, a…

Machine Learning · Computer Science 2023-01-10 Gesina Schwalbe , Bettina Finzel