English
Related papers

Related papers: bLIMEy: Surrogate Prediction Explanations Beyond L…

200 papers

Black box neural networks are an indispensable part of modern robots. Nevertheless, deploying such high-stakes systems in real-world scenarios poses significant challenges when the stakeholders, such as engineers and legislative bodies,…

Robotics · Computer Science 2025-10-10 Som Sagar , Aditya Taparia , Harsh Mankodiya , Pranav Bidare , Yifan Zhou , Ransalu Senanayake

This paper addresses trust issues created from the ubiquity of black box algorithms and surrogate explainers in Explainable Intrusion Detection Systems (X-IDS). While Explainable Artificial Intelligence (XAI) aims to enhance transparency,…

Cryptography and Security · Computer Science 2024-01-19 Jesse Ables , Nathaniel Childers , William Anderson , Sudip Mittal , Shahram Rahimi , Ioana Banicescu , Maria Seale

Explainable AI (XAI) techniques have been widely used to help explain and understand the output of deep learning models in fields such as image classification and Natural Language Processing. Interest in using XAI techniques to explain deep…

Computation and Language · Computer Science 2023-05-30 Xiaoliang Wu , Peter Bell , Ajitha Rajan

Numerous algorithms have been proposed for detecting anomalies (outliers, novelties) in an unsupervised manner. Unfortunately, it is not trivial, in general, to understand why a given sample (record) is labelled as an anomaly and thus…

Machine Learning · Computer Science 2021-10-19 Nikolaos Myrtakis , Ioannis Tsamardinos , Vassilis Christophides

Explainability has been a challenge in AI for as long as AI has existed. With the recently increased use of AI in society, it has become more important than ever that AI systems would be able to explain the reasoning behind their results…

Artificial Intelligence · Computer Science 2020-09-30 Kary Främling

Recently, Logic Explained Networks (LENs) have been proposed as explainable-by-design neural models providing logic explanations for their predictions. However, these models have only been applied to vision and tabular data, and they mostly…

Computation and Language · Computer Science 2023-09-28 Rishabh Jain , Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Davide Buffelli , Pietro Lio

Black box deep learning models trained on genomic sequences excel at predicting the outcomes of different gene regulatory mechanisms. Therefore, interpreting these models may provide novel insights into the underlying biology, supporting…

Machine Learning · Computer Science 2024-07-18 Pedro Barbosa , Rosina Savisaar , Alcides Fonseca

While designing inductive bias in neural architectures has been widely studied, we hypothesize that transformer networks are flexible enough to learn inductive bias from suitable generic tasks. Here, we replace architecture engineering by…

Machine Learning · Computer Science 2022-03-17 Yuhuai Wu , Markus Rabe , Wenda Li , Jimmy Ba , Roger Grosse , Christian Szegedy

The increasing difficulty to distinguish language-model-generated from human-written text has led to the development of detectors of machine-generated text (MGT). However, in many contexts, a black-box prediction is not sufficient, it is…

Machine Learning · Computer Science 2026-01-21 Loris Schoenegger , Yuxi Xia , Benjamin Roth

Surrogate algorithms such as Bayesian optimisation are especially designed for black-box optimisation problems with expensive objectives, such as hyperparameter tuning or simulation-based optimisation. In the literature, these algorithms…

Machine Learning · Computer Science 2024-03-14 Laurens Bliek , Arthur Guijt , Rickard Karlsson , Sicco Verwer , Mathijs de Weerdt

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

Adoption and deployment of robotic and autonomous systems in industry are currently hindered by the lack of transparency, required for safety and accountability. Methods for providing explanations are needed that are agnostic to the…

Robotics · Computer Science 2023-06-01 Konstantinos Gavriilidis , Andrea Munafo , Wei Pang , Helen Hastie

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

As Large Language Models (LLMs) scale to handle massive context windows, achieving surgical feature-level interpretation is essential for high-stakes tasks like legal auditing and code debugging. However, existing local model-agnostic…

Computation and Language · Computer Science 2026-02-05 Junhao Liu , Haonan Yu , Zhenyu Yan , Xin Zhang

As black box models and pretrained models gain traction in time series applications, understanding and explaining their predictions becomes increasingly vital, especially in high-stakes domains where interpretability and trust are…

Machine Learning · Computer Science 2026-01-16 Khalid Oublal , Quentin Bouniot , Qi Gan , Stephan Clémençon , Zeynep Akata

This paper analyses the fundamental ingredients behind surrogate explanations to provide a better understanding of their inner workings. We start our exposition by considering global surrogates, describing the trade-off between complexity…

Machine Learning · Computer Science 2021-07-12 Rafael Poyiadzi , Xavier Renard , Thibault Laugel , Raul Santos-Rodriguez , Marcin Detyniecki

In many machine learning applications, it is important to explain the predictions of a black-box classifier. For example, why does a deep neural network assign an image to a particular class? We cast interpretability of black-box…

Machine Learning · Statistics 2017-11-27 Ethan R. Elenberg , Alexandros G. Dimakis , Moran Feldman , Amin Karbasi

EXplainable AI has received significant attention in recent years. Machine learning models often operate as black boxes, lacking explainability and transparency while supporting decision-making processes. Local post-hoc explainability…

Artificial Intelligence · Computer Science 2024-05-24 Gianvincenzo Alfano , Sergio Greco , Domenico Mandaglio , Francesco Parisi , Reza Shahbazian , Irina Trubitsyna

Modern time series forecasting increasingly relies on complex ensemble models generated by AutoML systems like AutoGluon, delivering superior accuracy but with significant costs to transparency and interpretability. This paper introduces a…

Machine Learning · Computer Science 2025-10-13 Yikai Zhao , Jiekai Ma

Artificial Intelligence (AI) has created the single biggest technology revolution the world has ever seen. For the finance sector, it provides great opportunities to enhance customer experience, democratize financial services, ensure…

Risk Management · Quantitative Finance 2021-03-02 Branka Hadji Misheva , Joerg Osterrieder , Ali Hirsa , Onkar Kulkarni , Stephen Fung Lin