中文
相关论文

相关论文: "Why did you do that?": Explaining black box model…

200 篇论文

In recent years, the use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Although these models can often bring substantial improvements in the accuracy and efficiency of…

机器学习 · 计算机科学 2021-04-13 Alfredo Carrillo , Luis F. Cantú , Alejandro Noriega

Existing algorithms for explaining the output of image classifiers use different definitions of explanations and a variety of techniques to find them. However, none of the existing tools use a principled approach based on formal definitions…

人工智能 · 计算机科学 2026-02-23 Hana Chockler , David A. Kelly , Daniel Kroening , Youcheng Sun

Neural networks are commonly regarded as black boxes performing incomprehensible functions. For classification problems networks provide maps from high dimensional feature space to K-dimensional image space. Images of training vector are…

神经与进化计算 · 计算机科学 2018-02-26 Wlodzislaw Duch

Machine learning and especially deep learning have garneredtremendous popularity in recent years due to their increased performanceover other methods. The availability of large amount of data has aidedin the progress of deep learning.…

机器学习 · 计算机科学 2019-09-06 Sharath M. Shankaranarayana , Davor Runje

Explaining opaque Machine Learning (ML) models has become an increasingly important challenge. However, current eXplanation in AI (XAI) methods suffer several shortcomings, including insufficient abstraction, limited user interactivity, and…

计算机与社会 · 计算机科学 2026-03-02 Laura State , Salvatore Ruggieri , Franco Turini

The rapid development of artificial intelligence methods contributes to their wide applications for forecasting various financial risks in recent years. This study introduces a novel explainable case-based reasoning (CBR) approach without a…

计算金融 · 定量金融 2021-07-20 Wei Li , Florentina Paraschiv , Georgios Sermpinis

Despite their impact on the society, deep neural networks are often regarded as black-box models due to their intricate structures and the absence of explanations for their decisions. This opacity poses a significant challenge to AI systems…

机器学习 · 计算机科学 2024-07-18 Biagio La Rosa

Machine learning software is being used in many applications (finance, hiring, admissions, criminal justice) having a huge social impact. But sometimes the behavior of this software is biased and it shows discrimination based on some…

软件工程 · 计算机科学 2020-08-31 Joymallya Chakraborty , Kewen Peng , Tim Menzies

Many methods to explain black-box models, whether local or global, are additive. In this paper, we study global additive explanations for non-additive models, focusing on four explanation methods: partial dependence, Shapley explanations…

机器学习 · 统计学 2023-08-02 Sarah Tan , Giles Hooker , Paul Koch , Albert Gordo , Rich Caruana

Existing methods for visual reasoning attempt to directly map inputs to outputs using black-box architectures without explicitly modeling the underlying reasoning processes. As a result, these black-box models often learn to exploit biases…

计算机视觉与模式识别 · 计算机科学 2017-05-11 Justin Johnson , Bharath Hariharan , Laurens van der Maaten , Judy Hoffman , Li Fei-Fei , C. Lawrence Zitnick , Ross Girshick

We propose a novel eXplainable AI algorithm to compute faithful, easy-to-understand, and complete global decision rules from local explanations for tabular data by combining XAI methods with closed frequent itemset mining. Our method can be…

机器学习 · 计算机科学 2025-04-02 Sebastian Müller , Vanessa Toborek , Tamás Horváth , Christian Bauckhage

Locally interpretable model agnostic explanations (LIME) method is one of the most popular methods used to explain black-box models at a per example level. Although many variants have been proposed, few provide a simple way to produce high…

机器学习 · 计算机科学 2023-10-04 Amit Dhurandhar , Karthikeyan Ramamurthy , Kartik Ahuja , Vijay Arya

Procedural Content Generation via Machine Learning (PCGML) refers to a group of methods for creating game content (e.g. platformer levels, game maps, etc.) using machine learning models. PCGML approaches rely on black box models, which can…

人工智能 · 计算机科学 2020-10-06 Faraz Khadivpour , Matthew Guzdial

In science and medicine, model interpretations may be reported as discoveries of natural phenomena or used to guide patient treatments. In such high-stakes tasks, false discoveries may lead investigators astray. These applications would…

机器学习 · 统计学 2020-08-18 Collin Burns , Jesse Thomason , Wesley Tansey

The increasing usage of machine learning models raises the question of the reliability of these models. The current practice of testing with limited data is often insufficient. In this paper, we provide a framework for automated test data…

机器学习 · 计算机科学 2021-11-04 Diptikalyan Saha , Aniya Aggarwal , Sandeep Hans

ML model design either starts with an interpretable model or a Blackbox and explains it post hoc. Blackbox models are flexible but difficult to explain, while interpretable models are inherently explainable. Yet, interpretable models…

机器学习 · 计算机科学 2023-07-13 Shantanu Ghosh , Ke Yu , Forough Arabshahi , Kayhan Batmanghelich

Rule-based models offer a human-understandable representation, i.e. they are interpretable. For this reason, they are used to explain the decisions of non-interpretable complex models, referred to as black box models. The generation of such…

人工智能 · 计算机科学 2025-03-03 Michał Kozielski , Marek Sikora , Łukasz Wawrowski

We introduce a new model-agnostic explanation technique which explains the prediction of any classifier called CLE. CLE gives an faithful and interpretable explanation to the prediction, by approximating the model locally using an…

机器学习 · 计算机科学 2019-10-03 Zijian Zhang , Fan Yang , Haofan Wang , Xia Hu

Learned knowledge graph representations supporting robots contain a wealth of domain knowledge that drives robot behavior. However, there does not exist an inference reconciliation framework that expresses how a knowledge graph…

人工智能 · 计算机科学 2022-05-05 Angel Daruna , Devleena Das , Sonia Chernova

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

机器学习 · 计算机科学 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser