English
Related papers

Related papers: Explainable but Vulnerable: Adversarial Attacks on…

200 papers

The field of "explainable artificial intelligence" (XAI) seemingly addresses the desire that decisions of machine learning systems should be human-understandable. However, in its current state, XAI itself needs scrutiny. Popular methods…

Machine Learning · Computer Science 2026-04-09 Stefan Haufe , Rick Wilming , Benedict Clark , Rustam Zhumagambetov , Ahcène Boubekki , Jörg Martin , Danny Panknin

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

We share observations and challenges from an ongoing effort to implement Explainable AI (XAI) in a domain-specific workflow for cybersecurity analysts. Specifically, we briefly describe a preliminary case study on the use of XAI for source…

Human-Computer Interaction · Computer Science 2024-08-12 Ashley Suh , Harry Li , Caitlin Kenney , Kenneth Alperin , Steven R. Gomez

Explainable Artificial Intelligence (XAI) is increasingly required in computational economics, where machine-learning forecasters can outperform classical econometric models but remain difficult to audit and use for policy. This survey…

General Economics · Economics 2025-12-16 Agustín García-García , Pablo Hidalgo , Julio E. Sandubete

Strategies based on Explainable Artificial Intelligence (XAI) have promoted better human interpretability of the results of black box models. This opens up the possibility of questioning whether explanations created by XAI methods meet…

Machine Learning · Computer Science 2024-07-08 José Ribeiro , Níkolas Carneiro , Ronnie Alves

Explainable Artificial Intelligence (XAI) aims to uncover the decision-making processes of AI models. However, the data used for such explanations can pose security and privacy risks. Existing literature identifies attacks on machine…

Machine Learning · Computer Science 2024-07-10 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

There have been several research works proposing new Explainable AI (XAI) methods designed to generate model explanations having specific properties, or desiderata, such as fidelity, robustness, or human-interpretability. However,…

Artificial Intelligence · Computer Science 2021-01-25 Sérgio Jesus , Catarina Belém , Vladimir Balayan , João Bento , Pedro Saleiro , Pedro Bizarro , João Gama

Explainable AI (XAI) holds significant promise for enhancing the transparency and trustworthiness of AI-driven threat detection in Security Operations Centers (SOCs). However, identifying the appropriate level and format of explanation,…

Cryptography and Security · Computer Science 2025-07-22 Nidhi Rastogi , Shirid Pant , Devang Dhanuka , Amulya Saxena , Pranjal Mairal

EXplainable Artificial Intelligence (XAI) aims to help users to grasp the reasoning behind the predictions of an Artificial Intelligence (AI) system. Many XAI approaches have emerged in recent years. Consequently, a subfield related to the…

Industrial Cyber-Physical Systems (CPS) are sensitive infrastructure from both safety and economics perspectives, making their reliability critically important. Machine Learning (ML), specifically deep learning, is increasingly integrated…

Machine Learning · Computer Science 2026-04-09 Annemarie Jutte , Uraz Odyurt

The critical need for transparent and trustworthy machine learning in cybersecurity operations drives the development of this integrated Explainable AI (XAI) framework. Our methodology addresses three fundamental challenges in deploying AI…

Cryptography and Security · Computer Science 2026-02-24 Norrakith Srisumrith , Sunantha Sodsee

Artificial intelligence (AI) systems utilizing deep neural networks (DNNs) and machine learning (ML) algorithms are widely used for solving important problems in bioinformatics, biomedical informatics, and precision medicine. However,…

Quantitative Methods · Quantitative Biology 2023-02-24 Md. Rezaul Karim , Tanhim Islam , Oya Beyan , Christoph Lange , Michael Cochez , Dietrich Rebholz-Schuhmann , Stefan Decker

Given the sheer volume of surgical procedures and the significant rate of postoperative fatalities, assessing and managing surgical complications has become a critical public health concern. Existing artificial intelligence (AI) tools for…

Explainable Artificial Intelligence (XAI) is a set of techniques that allows the understanding of both technical and non-technical aspects of Artificial Intelligence (AI) systems. XAI is crucial to help satisfying the increasingly important…

Artificial Intelligence · Computer Science 2021-11-09 Riccardo Crupi , Alessandro Castelnovo , Daniele Regoli , Beatriz San Miguel Gonzalez

Artificial Intelligence (AI) shows promising applications for the perception and planning tasks in autonomous driving (AD) due to its superior performance compared to conventional methods. However, inscrutable AI systems exacerbate the…

Robotics · Computer Science 2024-11-12 Anton Kuznietsov , Balint Gyevnar , Cheng Wang , Steven Peters , Stefano V. Albrecht

Artificial intelligence (AI) is being applied in almost every field. At the same time, the currently dominant deep learning methods are fundamentally black-box systems that lack explanations for their inferences, significantly limiting…

Artificial Intelligence · Computer Science 2025-10-06 Martina Mattioli , Eike Petersen , Aasa Feragen , Marcello Pelillo , Siavash A. Bigdeli

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

In recent years, Explainable AI (xAI) attracted a lot of attention as various countries turned explanations into a legal right. xAI allows for improving models beyond the accuracy metric by, e.g., debugging the learned pattern and…

Software Engineering · Computer Science 2022-10-05 Mohamed Karim Belaid , Eyke Hüllermeier , Maximilian Rabus , Ralf Krestel

Counterfactual explanations are increasingly used as an Explainable Artificial Intelligence (XAI) technique to provide stakeholders of complex machine learning algorithms with explanations for data-driven decisions. The popularity of…

Artificial Intelligence · Computer Science 2023-04-26 Dieter Brughmans , Lissa Melis , David Martens

Explainable Artificial Intelligence (XAI) has emerged as a pillar of Trustworthy AI and aims to bring transparency in complex models that are opaque by nature. Despite the benefits of incorporating explanations in models, an urgent need is…

Artificial Intelligence · Computer Science 2025-12-04 Sonal Allana , Mohan Kankanhalli , Rozita Dara