English
Related papers

Related papers: Hacking a surrogate model approach to XAI

200 papers

EXplainable Artificial Intelligence (XAI) is a vibrant research topic in the artificial intelligence community, with growing interest across methods and domains. Much has been written about the subject, yet XAI still lacks shared…

Artificial Intelligence · Computer Science 2023-06-16 Matteo Rizzo , Alberto Veneri , Andrea Albarelli , Claudio Lucchese , Marco Nobile , Cristina Conati

The vision of personalized medicine is to identify interventions that maintain or restore a person's health based on their individual biology. Medical digital twins, computational models that integrate a wide range of health-related data…

Quantitative Methods · Quantitative Biology 2025-10-21 Luis L. Fonseca , Lucas Böttcher , Borna Mehrad , Reinhard C. Laubenbacher

Language Models (LMs) have significantly advanced natural language processing and enabled remarkable progress across diverse domains, yet their black-box nature raises critical concerns about the interpretability of their internal…

Computation and Language · Computer Science 2025-09-29 Avash Palikhe , Zichong Wang , Zhipeng Yin , Rui Guo , Qiang Duan , Jie Yang , Wenbin Zhang

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant…

Artificial intelligence methods are being increasingly applied across various domains, but their often opaque nature has raised concerns about accountability and trust. In response, the field of explainable AI (XAI) has emerged to address…

Neural and Evolutionary Computing · Computer Science 2024-10-18 Ryan Zhou , Jaume Bacardit , Alexander Brownlee , Stefano Cagnoni , Martin Fyvie , Giovanni Iacca , John McCall , Niki van Stein , David Walker , Ting Hu

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

With the rapid growth of machine learning, deep neural networks (DNNs) are now being used in numerous domains. Unfortunately, DNNs are "black-boxes", and cannot be interpreted by humans, which is a substantial concern in safety-critical…

Machine Learning · Computer Science 2023-02-10 Shahaf Bassan , Guy Katz

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

As artificial intelligence systems become integral across domains, the demand for explainability grows, the called eXplainable artificial intelligence (XAI). Existing efforts primarily focus on generating and evaluating explanations for…

Artificial Intelligence · Computer Science 2025-06-17 Iván Sevillano-García , Julián Luengo , Francisco Herrera

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

Decision explanations of machine learning black-box models are often generated by applying Explainable AI (XAI) techniques. However, many proposed XAI methods produce unverified outputs. Evaluation and verification are usually achieved with…

Machine Learning · Computer Science 2020-12-09 Udo Schlegel , Daniela Oelke , Daniel A. Keim , Mennatallah El-Assady

As cannabis use has increased in recent years, researchers have come to rely on sophisticated machine learning models to predict cannabis use behavior and its impact on health. However, many artificial intelligence (AI) models lack…

Human-Computer Interaction · Computer Science 2025-03-11 Tongze Zhang , Tammy Chung , Anind Dey , Sang Won Bae

Explainable Artificial Intelligence (XAI) has re-emerged in response to the development of modern AI and ML systems. These systems are complex and sometimes biased, but they nevertheless make decisions that impact our lives. XAI systems are…

Artificial Intelligence · Computer Science 2021-02-10 Shane T. Mueller , Elizabeth S. Veinott , Robert R. Hoffman , Gary Klein , Lamia Alam , Tauseef Mamun , William J. Clancey

Recent applications of autonomous agents and robots, such as self-driving cars, scenario-based trainers, exploration robots, and service robots have brought attention to crucial trust-related challenges associated with the current…

Robotics · Computer Science 2022-09-26 Fatai Sado , Chu Kiong Loo , Wei Shiung Liew , Matthias Kerzel , Stefan Wermter

Black box systems for automated decision making, often based on machine learning over (big) data, map a user's features into a class or a score without exposing the reasons why. This is problematic not only for lack of transparency, but…

Artificial Intelligence · Computer Science 2018-06-27 Dino Pedreschi , Fosca Giannotti , Riccardo Guidotti , Anna Monreale , Luca Pappalardo , Salvatore Ruggieri , Franco Turini

We consider the paradigm of a black box AI system that makes life-critical decisions. We propose an "arguing machines" framework that pairs the primary AI system with a secondary one that is independently trained to perform the same task.…

Artificial Intelligence · Computer Science 2018-09-25 Lex Fridman , Li Ding , Benedikt Jenik , Bryan Reimer

The advances in artificial intelligence enabled by deep learning architectures are undeniable. In several cases, deep neural network driven models have surpassed human level performance in benchmark autonomy tasks. The underlying policies…

Artificial Intelligence · Computer Science 2021-06-11 Jeff Druce , James Niehaus , Vanessa Moody , David Jensen , Michael L. Littman

In the past few years, artificial intelligence (AI) techniques have been implemented in almost all verticals of human life. However, the results generated from the AI models often lag explainability. AI models often appear as a blackbox…

Recent machine learning approaches have been effective in Artificial Intelligence (AI) applications. They produce robust results with a high level of accuracy. However, most of these techniques do not provide human-understandable…

Artificial Intelligence · Computer Science 2022-10-03 Quoc Hung Ngo , Tahar Kechadi , Nhien-An Le-Khac

Modern AI agents such as large language models are trained on diverse tasks -- translation, code generation, mathematical reasoning, and text prediction -- simultaneously. A key question is how to quantify the influence of each individual…

Machine Learning · Computer Science 2026-05-12 Zhenshuo Zhang , Minxuan Duan , Hongyang R. Zhang