English
Related papers

Related papers: Foiling Explanations in Deep Neural Networks

200 papers

In this paper, we demonstrate the feasibility of alterfactual explanations for black box image classifiers. Traditional explanation mechanisms from the field of Counterfactual Thinking are a widely-used paradigm for Explainable Artificial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Silvan Mertes , Tobias Huber , Christina Karle , Katharina Weitz , Ruben Schlagowski , Cristina Conati , Elisabeth André

Deep learning (DL) has revolutionized the field of document image analysis, showcasing superhuman performance across a diverse set of tasks. However, the inherent black-box nature of deep learning models still presents a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Saifullah Saifullah , Stefan Agne , Andreas Dengel , Sheraz Ahmed

Recent research has shown Deep Neural Networks (DNNs) to be vulnerable to adversarial examples that induce desired misclassifications in the models. Such risks impede the application of machine learning in security-sensitive domains.…

Machine Learning · Computer Science 2021-03-23 Raj Vardhan , Ninghao Liu , Phakpoom Chinprutthiwong , Weijie Fu , Zhenyu Hu , Xia Ben Hu , Guofei Gu

Interpretability of Deep Learning (DL) is a barrier to trustworthy AI. Despite great efforts made by the Explainable AI (XAI) community, explanations lack robustness -- indistinguishable input perturbations may lead to different XAI…

Machine Learning · Computer Science 2023-08-01 Wei Huang , Xingyu Zhao , Gaojie Jin , Xiaowei Huang

Artificial intelligence is creating one of the biggest revolution across technology driven application fields. For the finance sector, it offers many opportunities for significant market innovation and yet broad adoption of AI systems…

Risk Management · Quantitative Finance 2022-12-07 Marc Wildi , Branka Hadji Misheva

Black-box nature of Artificial Intelligence (AI) models do not allow users to comprehend and sometimes trust the output created by such model. In AI applications, where not only the results but also the decision paths to the results are…

Artificial Intelligence · Computer Science 2024-10-28 Ibrahim Kok , Feyza Yildirim Okay , Ozgecan Muyanli , Suat Ozdemir

Explainable Artificial Intelligence (XAI) aims to make learning machines less opaque, and offers researchers and practitioners various tools to reveal the decision-making strategies of neural networks. In this work, we investigate how XAI…

Machine Learning · Computer Science 2023-11-15 Dennis Grinwald , Kirill Bykov , Shinichi Nakajima , Marina M. -C. Höhne

Large Language Models (LLMs) have played a pivotal role in advancing Artificial Intelligence (AI). However, despite their achievements, LLMs often struggle to explain their decision-making processes, making them a 'black box' and presenting…

Computation and Language · Computer Science 2025-06-30 Avash Palikhe , Zhenyu Yu , Zichong Wang , Wenbin Zhang

Artificial intelligence is reshaping science and industry, yet many users still regard its models as opaque "black boxes". Conventional explainable artificial-intelligence methods clarify individual predictions but overlook the upstream…

Machine Learning · Computer Science 2025-08-18 George Paterakis , Andrea Castellani , George Papoutsoglou , Tobias Rodemann , Ioannis Tsamardinos

Artificial Intelligence (AI) is rapidly expanding and integrating more into daily life to automate tasks, guide decision making, and enhance efficiency. However, complex AI models, which make decisions without providing clear explanations…

Software Engineering · Computer Science 2025-09-03 Lakshit Arora , Sanjay Surendranath Girija , Shashank Kapoor , Aman Raj , Dipen Pradhan , Ankit Shetgaonkar

Deep neural networks (DNNs) have demonstrated impressive performance on a wide array of tasks, but they are usually considered opaque since internal structure and learned parameters are not interpretable. In this paper, we re-examine the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yinpeng Dong , Hang Su , Jun Zhu , Fan Bao

In recent years, Explainable AI (xAI) attracted a lot of attention as various countries turned explanations into a legal right. xAI allows for improving models beyond the accuracy metric by, e.g., debugging the learned pattern and…

Software Engineering · Computer Science 2022-10-05 Mohamed Karim Belaid , Eyke Hüllermeier , Maximilian Rabus , Ralf Krestel

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable…

Machine Learning · Statistics 2020-06-03 Jie Chen , Joel Vaughan , Vijayan N. Nair , Agus Sudjianto

Artificial intelligence has become pervasive across disciplines and fields, and biomedical image and signal processing is no exception. The growing and widespread interest on the topic has triggered a vast research activity that is…

Machine Learning · Computer Science 2022-07-12 Guang Yang , Arvind Rao , Christine Fernandez-Maloigne , Vince Calhoun , Gloria Menegaz

We introduce a novel methodology for identifying adversarial attacks on deepfake detectors using eXplainable Artificial Intelligence (XAI). In an era characterized by digital advancement, deepfakes have emerged as a potent tool, creating a…

Cryptography and Security · Computer Science 2024-08-20 Ben Pinhasov , Raz Lapid , Rony Ohayon , Moshe Sipper , Yehudit Aperstein

In numerous high-stakes domains, training novices via conventional learning systems does not suffice. To impart tacit knowledge, experts' hands-on guidance is imperative. However, training novices by experts is costly and time-consuming,…

Human-Computer Interaction · Computer Science 2024-06-04 Philipp Spitzer , Niklas Kühl , Marc Goutier , Manuel Kaschura , Gerhard Satzger

In addition to the impressive predictive power of machine learning (ML) models, more recently, explanation methods have emerged that enable an interpretation of complex non-linear learning models such as deep neural networks. Gaining a…

Machine Learning · Computer Science 2023-01-18 Simon Letzgus , Patrick Wagner , Jonas Lederer , Wojciech Samek , Klaus-Robert Müller , Gregoire Montavon

The focus of recent research has shifted from merely improving the metrics based performance of Deep Neural Networks (DNNs) to DNNs which are more interpretable to humans. The field of eXplainable Artificial Intelligence (XAI) has observed…

Artificial Intelligence · Computer Science 2024-03-26 Avani Gupta , P J Narayanan

Explainable AI (XAI) is a research area whose objective is to increase trustworthiness and to enlighten the hidden mechanism of opaque machine learning techniques. This becomes increasingly important in case such models are applied to the…

Machine Learning · Computer Science 2021-04-19 Danilo Numeroso , Davide Bacciu

For strategic problems, intelligent systems based on Deep Reinforcement Learning (DRL) have demonstrated an impressive ability to learn advanced solutions that can go far beyond human capabilities, especially when dealing with complex…

Artificial Intelligence · Computer Science 2020-11-16 Jonas Andrulis , Ole Meyer , Grégory Schott , Samuel Weinbach , Volker Gruhn