English
Related papers

Related papers: Hacking a surrogate model approach to XAI

200 papers

This work studies black-box adversarial attacks against deep neural networks (DNNs), where the attacker can only access the query feedback returned by the attacked DNN model, while other information such as model parameters or the training…

Cryptography and Security · Computer Science 2021-03-19 Yan Feng , Baoyuan Wu , Yanbo Fan , Li Liu , Zhifeng Li , Shutao Xia

Explainable AI (XAI) has been proposed as a valuable tool to assist in downstream tasks involving human and AI collaboration. Perhaps the most psychologically valid XAI techniques are case based approaches which display 'whole' exemplars to…

Artificial Intelligence · Computer Science 2023-11-07 Eoin Kenny , Eoin Delaney , Mark Keane

Cybersecurity vendors consistently apply AI (Artificial Intelligence) to their solutions and many cybersecurity domains can benefit from AI technology. However, black-box AI techniques present some difficulties in comprehension and adoption…

Cryptography and Security · Computer Science 2023-03-03 Carlos Mendes , Tatiane Nogueira Rios

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

Recent AI algorithms are black box models whose decisions are difficult to interpret. eXplainable AI (XAI) is a class of methods that seek to address lack of AI interpretability and trust by explaining to customers their AI decisions. The…

Artificial Intelligence · Computer Science 2024-04-02 Behnam Mohammadi , Nikhil Malik , Tim Derdenger , Kannan Srinivasan

With the advances in computationally efficient artificial Intelligence (AI) techniques and their numerous applications in our everyday life, there is a pressing need to understand the computational details hidden in black box AI techniques…

Machine Learning · Computer Science 2023-11-13 Mrutyunjaya Panda , Soumya Ranjan Mahanta

Explainable Artificial Intelligence (XAI) systems, including intelligent agents, must be able to explain their internal decisions, behaviours and reasoning that produce their choices to the humans (or other systems) with which they…

Artificial Intelligence · Computer Science 2020-09-15 Mariela Morveli-Espinoza , Ayslan Possebom , Cesar Augusto Tacla

Most commonly used non-linear machine learning methods are closed-box models, uninterpretable to humans. The field of explainable artificial intelligence (XAI) aims to develop tools to examine the inner workings of these closed boxes. An…

Machine Learning · Computer Science 2026-05-26 Lauri Seppäläinen , Mudong Guo , Kai Puolamäki

Recent work has investigated the concept of adversarial attacks on explainable AI (XAI) in the NLP domain with a focus on examining the vulnerability of local surrogate methods such as Lime to adversarial perturbations or small changes on…

Machine Learning · Computer Science 2025-01-07 Christopher Burger , Charles Walter , Thai Le , Lingwei Chen

Black-box Artificial Intelligence (AI) methods, e.g. deep neural networks, have been widely utilized to build predictive models that can extract complex relationships in a dataset and make predictions for new unseen data records. However,…

Artificial Intelligence · Computer Science 2020-09-22 Milad Moradi , Matthias Samwald

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

We introduce the concept of decision-focused surrogate modeling for solving computationally challenging nonlinear optimization problems in real-time settings. The proposed data-driven framework seeks to learn a simpler, e.g. convex,…

Optimization and Control · Mathematics 2023-12-27 Rishabh Gupta , Qi Zhang

The past decade has seen significant progress in artificial intelligence (AI), which has resulted in algorithms being adopted for resolving a variety of problems. However, this success has been met by increasing model complexity and…

Machine Learning · Computer Science 2021-11-15 Waddah Saeed , Christian Omlin

Explainable artificial intelligence (XAI) is an important and rapidly expanding research topic. The goal of XAI is to gain trust in a machine learning (ML) model through clear insights into how the model arrives at its predictions. Genetic…

Neural and Evolutionary Computing · Computer Science 2022-03-28 E. M. C. Sijben , T. Alderliesten , P. A. N. Bosman

This research presents an innovative approach to cancer diagnosis and prediction using explainable Artificial Intelligence (XAI) and deep learning techniques. With cancer causing nearly 10 million deaths globally in 2020, early and accurate…

Artificial Intelligence · Computer Science 2024-12-24 Badaru I. Olumuyiwa , The Anh Han , Zia U. Shamszaman

Surrogate models are frequently employed as efficient substitutes for the costly execution of real-world processes. However, constructing a high-quality surrogate model often demands extensive data acquisition. A solution to this issue is…

Machine Learning · Computer Science 2025-05-05 Shuaiqun Pan , Diederick Vermetten , Manuel López-Ibáñez , Thomas Bäck , Hao Wang

The results showed that XAI could indeed be used as a proof of concept to begin discussions on the implementation of assistive AI systems within the clinical community.

Image and Video Processing · Electrical Eng. & Systems 2023-10-31 Michele La Ferla , Matthew Montebello , Dylan Seychell

Deep learning models have recently demonstrated remarkable results in a variety of tasks, which is why they are being increasingly applied in high-stake domains, such as industry, medicine, and finance. Considering that automatic…

Machine Learning · Computer Science 2021-08-19 Ilija Šimić , Vedran Sabol , Eduardo Veas

Not only automation of manufacturing processes but also automation of automation procedures itself become increasingly relevant to automation research. In this context, automated capability assessment, mainly leveraged by deep learning…

Artificial Intelligence · Computer Science 2022-01-31 Raoul Schönhof , Artem Werner , Jannes Elstner , Boldizsar Zopcsak , Ramez Awad , Marco Huber

Black box deep learning models trained on genomic sequences excel at predicting the outcomes of different gene regulatory mechanisms. Therefore, interpreting these models may provide novel insights into the underlying biology, supporting…

Machine Learning · Computer Science 2024-07-18 Pedro Barbosa , Rosina Savisaar , Alcides Fonseca