English
Related papers

Related papers: Programs as Black-Box Explanations

200 papers

Methods for interpreting machine learning black-box models increase the outcomes' transparency and in turn generates insight into the reliability and fairness of the algorithms. However, the interpretations themselves could contain…

Machine Learning · Computer Science 2019-06-05 Yujia Zhang , Kuangyan Song , Yiming Sun , Sarah Tan , Madeleine Udell

In the context of some machine learning applications, obtaining data instances is a relatively easy process but labeling them could become quite expensive or tedious. Such scenarios lead to datasets with few labeled instances and a larger…

Machine Learning · Computer Science 2020-07-21 Isel Grau , Dipankar Sengupta , Maria M. Garcia Lorenzo , Ann Nowe

Interpretable representations are the backbone of many explainers that target black-box predictive systems based on artificial intelligence and machine learning algorithms. They translate the low-level data representation necessary for good…

Machine Learning · Computer Science 2024-04-29 Kacper Sokol , Peter Flach

A rich line of research attempts to make deep neural networks more transparent by generating human-interpretable 'explanations' of their decision process, especially for interactive tasks like Visual Question Answering (VQA). In this work,…

Artificial Intelligence · Computer Science 2018-10-31 Arjun Chandrasekaran , Viraj Prabhu , Deshraj Yadav , Prithvijit Chattopadhyay , Devi Parikh

From self-driving vehicles and back-flipping robots to virtual assistants who book our next appointment at the hair salon or at that restaurant for dinner - machine learning systems are becoming increasingly ubiquitous. The main reason for…

Machine Learning · Computer Science 2018-08-16 Milo Honegger

We are used to the availability of big data generated in nearly all fields of science as a consequence of technological progress. However, the analysis of such data possess vast challenges. One of these relates to the explainability of…

Artificial Intelligence · Computer Science 2022-09-14 Frank Emmert-Streib , Olli Yli-Harja , Matthias Dehmer

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

In recent years, a number of artificial intelligent services have been developed such as defect detection system or diagnosis system for customer services. Unfortunately, the core in these services is a black-box in which human cannot…

Artificial Intelligence · Computer Science 2017-09-20 Jaedeok Kim , Jingoo Seo

Several explainable AI methods allow a Machine Learning user to get insights on the classification process of a black-box model in the form of local linear explanations. With such information, the user can judge which features are locally…

Machine Learning · Computer Science 2023-02-16 Francesco Lomuscio , Paolo Bajardi , Alan Perotti , Elvio G. Amparore

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

With the prevalence of deep learning based embedding approaches, recommender systems have become a proven and indispensable tool in various information filtering applications. However, many of them remain difficult to diagnose what aspects…

Information Retrieval · Computer Science 2021-10-29 Yao Zhou , Haonan Wang , Jingrui He , Haixun Wang

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transparent and their…

Artificial Intelligence · Computer Science 2019-11-28 Vanessa Buhrmester , David Münch , Michael Arens

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

There has been a recent push in making machine learning models more interpretable so that their performance can be trusted. Although successful, these methods have mostly focused on the deep learning methods while the fundamental…

Machine Learning · Computer Science 2022-06-16 David Steinmann , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

Binary classifiers are traditionally studied by propositional logic (PL). PL can only represent them as white boxes, under the assumption that the underlying Boolean function is fully known. Binary classifiers used in practical applications…

Logic in Computer Science · Computer Science 2024-03-04 Xinghan Liu , Emiliano Lorini

In the context of human-in-the-loop Machine Learning applications, like Decision Support Systems, interpretability approaches should provide actionable insights without making the users wait. In this paper, we propose Accelerated…

Machine Learning · Computer Science 2021-12-24 David Dandolo , Chiara Masiero , Mattia Carletti , Davide Dalle Pezze , Gian Antonio Susto

With the advancement of technology for artificial intelligence (AI) based solutions and analytics compute engines, machine learning (ML) models are getting more complex day by day. Most of these models are generally used as a black box…

Machine Learning · Computer Science 2022-10-11 P. Sai Ram Aditya , Mayukha Pal

A main drawback of eXplainable Artificial Intelligence (XAI) approaches is the feature independence assumption, hindering the study of potential variable dependencies. This leads to approximating black box behaviors by analyzing the effects…

Artificial Intelligence · Computer Science 2024-10-16 Martina Cinquini , Riccardo Guidotti

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some…

Software Engineering · Computer Science 2020-08-31 Joymallya Chakraborty , Kewen Peng , Tim Menzies