English
Related papers

Related papers: "Why did you do that?": Explaining black box model…

200 papers

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

Despite the tremendous advances that have been made in the last decade on developing useful machine-learning applications, their wider adoption has been hindered by the lack of strong assurance guarantees that can be made about their…

Machine Learning · Computer Science 2019-07-18 He Zhu , Zikang Xiong , Stephen Magill , Suresh Jagannathan

Image classification based on machine learning is being commonly used. However, a classification result given by an advanced method, including deep learning, is often hard to interpret. This problem of interpretability is one of the major…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Yuhki Hatakeyama , Hiroki Sakuma , Yoshinori Konishi , Kohei Suenaga

Despite recent advancements in Instruct-based Image Editing models for generating high-quality images, they are known as black boxes and a significant barrier to transparency and user trust. To solve this issue, we introduce SMILE…

Artificial Intelligence · Computer Science 2024-12-24 Zeinab Dehghani , Koorosh Aslansefat , Adil Khan , Adín Ramírez Rivera , Franky George , Muhammad Khalid

Explainable artificial intelligence (XAI) is an emerging new domain in which a set of processes and tools allow humans to better comprehend the decisions generated by black box models. However, most of the available XAI tools are often…

Machine Learning · Computer Science 2021-07-22 Zoumpolia Dikopoulou , Serafeim Moustakidis , Patrik Karlsson

Explainable machine learning (XML) has emerged as a major challenge in artificial intelligence (AI). Although black-box models such as Deep Neural Networks and Gradient Boosting often exhibit exceptional predictive accuracy, their lack of…

Methodology · Statistics 2024-06-18 Evgenii Kuriabov , Jia Li

Model interpretability plays a central role in human-AI decision-making systems. Ideally, explanations should be expressed using human-interpretable semantic concepts. Moreover, the causal relations between these concepts should be captured…

Machine Learning · Computer Science 2024-01-29 Ricardo Moreira , Jacopo Bono , Mário Cardoso , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

The significant advances in autonomous systems together with an immensely wider application domain have increased the need for trustable intelligent systems. Explainable artificial intelligence is gaining considerable attention among…

Artificial Intelligence · Computer Science 2020-06-02 Sule Anjomshoae , Kary Främling , Amro Najjar

Explaining opaque Machine Learning (ML) models is an increasingly relevant problem. Current explanation in AI (XAI) methods suffer several shortcomings, among others an insufficient incorporation of background knowledge, and a lack of…

Artificial Intelligence · Computer Science 2023-09-04 Laura State , Salvatore Ruggieri , Franco Turini

Algorithmic approaches to interpreting machine learning models have proliferated in recent years. We carry out human subject tests that are the first of their kind to isolate the effect of algorithmic explanations on a key aspect of model…

Computation and Language · Computer Science 2020-05-06 Peter Hase , Mohit Bansal

Deep Learning is a state-of-the-art technique to make inference on extensive or complex data. As a black box model due to their multilayer nonlinear structure, Deep Neural Networks are often criticized to be non-transparent and their…

Artificial Intelligence · Computer Science 2019-11-28 Vanessa Buhrmester , David Münch , Michael Arens

As artificial intelligence (AI) systems become increasingly integrated into critical decision-making processes, the need for transparent and interpretable models has become paramount. In this article we present a new ruleset creation method…

Machine Learning · Computer Science 2024-07-30 Mario Parrón Verdasco , Esteban García-Cuesta

Explainable AI has emerged to be a key component for black-box machine learning approaches in domains with a high demand for reliability or transparency. Examples are medical assistant systems, and applications concerned with the General…

Machine Learning · Computer Science 2021-05-18 Johannes Rabold , Gesina Schwalbe , Ute Schmid

Interpreting the inner function of neural networks is crucial for the trustworthy development and deployment of these black-box models. Prior interpretability methods focus on correlation-based measures to attribute model decisions to…

Machine Learning · Computer Science 2023-06-21 Ola Ahmad , Nicolas Bereux , Loïc Baret , Vahid Hashemi , Freddy Lecue

Deep neural perception and control networks have become key components of self-driving vehicles. User acceptance is likely to benefit from easy-to-interpret textual explanations which allow end-users to understand what triggered a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Jinkyu Kim , Anna Rohrbach , Trevor Darrell , John Canny , Zeynep Akata

We propose Black Box Explanations through Transparent Approximations (BETA), a novel model agnostic framework for explaining the behavior of any black-box classifier by simultaneously optimizing for fidelity to the original model and…

Artificial Intelligence · Computer Science 2017-07-06 Himabindu Lakkaraju , Ece Kamar , Rich Caruana , Jure Leskovec

(Artificial) neural networks have become increasingly popular in mechanics to accelerate computations with model order reduction techniques and as universal models for a wide variety of materials. However, the major disadvantage of neural…

Machine Learning · Computer Science 2021-07-13 Arnd Koeppe , Franz Bamer , Michael Selzer , Britta Nestler , Bernd Markert

Interpretability has become incredibly important as machine learning is increasingly used to inform consequential decisions. We propose to construct global explanations of complex, blackbox models in the form of a decision tree…

Machine Learning · Computer Science 2019-01-28 Osbert Bastani , Carolyn Kim , Hamsa Bastani

Interpretable Machine Learning faces a recurring challenge of explaining the predictions made by opaque classifiers such as ensemble models, kernel methods, or neural networks in terms that are understandable to humans. When the model is…

Machine Learning · Computer Science 2024-11-14 Frederic Koriche , Jean-Marie Lagniez , Stefan Mengel , Chi Tran

The financial industry faces a significant challenge modeling and risk portfolios: balancing the predictability of advanced machine learning models, neural network models, and explainability required by regulatory entities (such as Office…

Machine Learning · Computer Science 2025-11-10 Rongbin Ye , Jiaqi Chen