English
Related papers

Related papers: Explainable but Vulnerable: Adversarial Attacks on…

200 papers

Explainable Artificial Intelligence (XAI) is an emerging area of research in the field of Artificial Intelligence (AI). XAI can explain how AI obtained a particular solution (e.g., classification or object detection) and can also answer…

Machine Learning · Computer Science 2021-07-16 Prashant Gohel , Priyanka Singh , Manoranjan Mohanty

Explainable AI (XAI) aims to improve user understanding and decisions when using AI models. However, despite innovations in XAI, recent user evaluations reveal that this goal remains elusive. Understanding human cognition can help explain…

Artificial Intelligence · Computer Science 2026-05-01 Louth Bin Rawshan , Zhuoyu Wang , Brian Y. Lim

Explainable artificial intelligence (XAI) is concerned with producing explanations indicating the inner workings of models. For a Rashomon set of similarly performing models, explanations provide a way of disambiguating the behavior of…

Artificial Intelligence · Computer Science 2026-01-14 Kaivalya Rawal , Eoin Delaney , Zihao Fu , Sandra Wachter , Chris Russell

The simulation of complex systems increasingly relies on sophisticated but fundamentally opaque computational black-box simulators. Surrogate models play a central role in reducing the computational cost of complex systems simulations…

The growing adoption of artificial intelligence in healthcare has raised concerns about the transparency and trustworthiness of AI-driven medical diagnosis systems. Many existing models operate as black boxes, limiting clinicians' ability…

Human-Computer Interaction · Computer Science 2026-04-21 Altynbek Seitenov , Ainur Nurzhanova , Azhar Bekbussinova , Yerassyl Bolatkan

With Artificial Intelligence (AI) becoming ubiquitous in every application domain, the need for explanations is paramount to enhance transparency and trust among non-technical users. Despite the potential shown by Explainable AI (XAI) for…

Human-Computer Interaction · Computer Science 2024-02-05 Aditya Bhattacharya

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

Artificial Intelligence · Computer Science 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

As AI systems increasingly mediate decisions in domains such as credit scoring and financial forecasting, their lack of transparency and bias raises critical concerns for fairness and public trust. Existing explainable AI (XAI) approaches…

Artificial Intelligence · Computer Science 2026-01-28 Kausik Lakkaraju , Siva Likitha Valluru , Biplav Srivastava

To make Explainable AI (XAI) systems trustworthy, understanding harmful effects is just as important as producing well-designed explanations. In this paper, we address an important yet unarticulated type of negative effect in XAI. We…

Human-Computer Interaction · Computer Science 2021-09-28 Upol Ehsan , Mark O. Riedl

The evolving landscape of explainable artificial intelligence (XAI) aims to improve the interpretability of intricate machine learning (ML) models, yet faces challenges in formalisation and empirical validation, being an inherently…

A central goal of explainable artificial intelligence (XAI) is to improve the trust relationship in human-AI interaction. One assumption underlying research in transparent AI systems is that explanations help to better assess predictions of…

Artificial Intelligence · Computer Science 2021-06-23 Felix Biessmann , Viktor Treu

Most adversarial threats in artificial intelligence (AI) target the computational behavior of models rather than the humans who rely on them. Yet modern AI systems increasingly operate within human decision loops, where users interpret and…

Artificial Intelligence · Computer Science 2026-05-18 Shutong Fan , Lan Zhang , Xiaoyong Yuan

Deep learning (DL) has significantly improved automatic modulation classification (AMC) by leveraging neural networks as the feature extractor.However, as the DL-based AMC becomes increasingly widespread, it is faced with the severe secure…

Signal Processing · Electrical Eng. & Systems 2024-10-16 Jingchun Wang , Peihao Dong , Fuhui Zhou , Qihui Wu

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is no consensus…

Artificial Intelligence · Computer Science 2021-06-02 Elvio G. Amparore , Alan Perotti , Paolo Bajardi

Artificial intelligence now outperforms humans in several scientific and engineering tasks, yet its internal representations often remain opaque. In this Perspective, we argue that explainable artificial intelligence (XAI), combined with…

Artificial Intelligence · Computer Science 2026-02-17 Ricardo Vinuesa , Steven L. Brunton , Gianmarco Mengaldo

Machine learning (ML) methods can effectively analyse data, recognize patterns in them, and make high-quality predictions. Good predictions usually come along with "black-box" models that are unable to present the detected patterns in a…

Human-Computer Interaction · Computer Science 2022-08-25 Jacqueline Wastensteiner , Tobias M. Weiss , Felix Haag , Konstantin Hopf

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

Understanding the decisions made and actions taken by increasingly complex AI system remains a key challenge. This has led to an expanding field of research in explainable artificial intelligence (XAI), highlighting the potential of…

Explainable artificial intelligence (XAI) methods are currently evaluated with approaches mostly originated in interpretable machine learning (IML) research that focus on understanding models such as comparison against existing attribution…

Machine Learning · Computer Science 2020-11-20 Shideh Shams Amiri , Rosina O. Weber , Prateek Goel , Owen Brooks , Archer Gandley , Brian Kitchell , Aaron Zehm

The need for interpretable and accountable intelligent systems grows along with the prevalence of artificial intelligence applications used in everyday life. Explainable intelligent systems are designed to self-explain the reasoning behind…

Human-Computer Interaction · Computer Science 2020-08-06 Sina Mohseni , Niloofar Zarei , Eric D. Ragan