English
Related papers

Related papers: Explainable Black-Box Attacks Against Model-based …

200 papers

Feature attribution methods have become a staple method to disentangle the complex behavior of black box models. Despite their success, some scholars have argued that such methods suffer from a serious flaw: they do not allow a reliable…

As cyber threats continue to evolve, securing edge networks has become increasingly challenging due to their distributed nature and resource limitations. Many AI-driven threat detection systems rely on complex deep learning models, which,…

Cryptography and Security · Computer Science 2025-04-24 Milad Rahmati

The applications of Artificial Intelligence (AI) methods especially machine learning techniques have increased in recent years. Classification algorithms have been successfully applied to different problems such as requirement…

Software Engineering · Computer Science 2023-02-13 Behnaz Jamasb , Reza Akbari , Seyed Raouf Khayami

Deep learning systems are known to be vulnerable to adversarial examples. In particular, query-based black-box attacks do not require knowledge of the deep learning model, but can compute adversarial examples over the network by submitting…

Cryptography and Security · Computer Science 2022-06-10 Huiying Li , Shawn Shan , Emily Wenger , Jiayun Zhang , Haitao Zheng , Ben Y. Zhao

Machine learning systems increasingly make life-changing decisions about individuals, such as loan approvals, hiring, and cheating detection, raising a pressing question: how can individuals respond to negative decisions made by these…

Machine Learning · Statistics 2026-05-18 Timo Freiesleben , Kristof Meding , Gunnar König

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Explainable machine learning holds great potential for analyzing and understanding learning-based systems. These methods can, however, be manipulated to present unfaithful explanations, giving rise to powerful and stealthy adversaries. In…

Cryptography and Security · Computer Science 2022-04-21 Maximilian Noppel , Lukas Peter , Christian Wressnegger

The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the…

Machine Learning · Computer Science 2024-08-14 Gregory Yampolsky , Dhruv Desai , Mingshu Li , Stefano Pasquali , Dhagash Mehta

Large Language Models (LLMs) offer a promising approach to enhancing Explainable AI (XAI) by transforming complex machine learning outputs into easy-to-understand narratives, making model predictions more accessible to users, and helping…

Artificial Intelligence · Computer Science 2025-04-02 Ahsan Bilal , David Ebert , Beiyu Lin

Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy. Many intelligent systems, such as electronic payment and identity verification, rely on face forgery detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Zhaoyu Chen , Bo Li , Kaixun Jiang , Shuang Wu , Shouhong Ding , Wenqiang Zhang

As artificial intelligence systems become integral across domains, the demand for explainability grows, the called eXplainable artificial intelligence (XAI). Existing efforts primarily focus on generating and evaluating explanations for…

Artificial Intelligence · Computer Science 2025-06-17 Iván Sevillano-García , Julián Luengo , Francisco Herrera

Most explainable AI (XAI) techniques are concerned with the design of algorithms to explain the AI's decision. However, the data that is used to train these algorithms may contain features that are often incomprehensible to an end-user even…

Computers and Society · Computer Science 2019-06-12 Ajay Chander , Ramya Srinivasan

This chapter discusses the opportunities of eXplainable Artificial Intelligence (XAI) within the realm of spatial analysis. A key objective in spatial analysis is to model spatial relationships and infer spatial processes to generate…

Machine Learning · Computer Science 2025-05-02 Ziqi Li

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

This review paper provides an integrated perspective of Explainable Artificial Intelligence techniques applied to Brain-Computer Interfaces. BCIs use predictive models to interpret brain signals for various high-stake applications. However,…

Human-Computer Interaction · Computer Science 2023-12-21 Param Rajpura , Hubert Cecotti , Yogesh Kumar Meena

A core assumption of Explainable AI (XAI) is that explanations are useful to users -- that is, users will do something with the explanations. Prior work, however, does not clearly connect the information provided in explanations to user…

Human-Computer Interaction · Computer Science 2026-01-29 Gennie Mansi , Julia Kim , Mark Riedl

Social Explainable AI (SAI) is a new direction in artificial intelligence that emphasises decentralisation, transparency, social context, and focus on the human users. SAI research is still at an early stage. Consequently, it concentrates…

Multiagent Systems · Computer Science 2023-10-20 Damian Kurpiewski , Wojciech Jamroga , Teofil Sidoruk

Model explanations provide transparency into a trained machine learning model's blackbox behavior to a model builder. They indicate the influence of different input attributes to its corresponding model prediction. The dependency of…

Cryptography and Security · Computer Science 2022-09-09 Vasisht Duddu , Antoine Boutet

The lack of explainability of Artificial Intelligence (AI) is one of the first obstacles that the industry and regulators must overcome to mitigate the risks associated with the technology. The need for eXplainable AI (XAI) is evident in…

Computers and Society · Computer Science 2025-02-24 Georgios Pavlidis

eXplainable Artificial Intelligence (XAI) is a sub-field of Artificial Intelligence (AI) that is at the forefront of AI research. In XAI, feature attribution methods produce explanations in the form of feature importance. People often use…

Artificial Intelligence · Computer Science 2022-02-09 Jamie Duell , Monika Seisenberger , Gert Aarts , Shangming Zhou , Xiuyi Fan