English
Related papers

Related papers: Multiple Different Black Box Explanations for Imag…

200 papers

Image classification based on machine learning is being commonly used. However, a classification result given by an advanced method, including deep learning, is often hard to interpret. This problem of interpretability is one of the major…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Yuhki Hatakeyama , Hiroki Sakuma , Yoshinori Konishi , Kohei Suenaga

In science and medicine, model interpretations may be reported as discoveries of natural phenomena or used to guide patient treatments. In such high-stakes tasks, false discoveries may lead investigators astray. These applications would…

Machine Learning · Statistics 2020-08-18 Collin Burns , Jesse Thomason , Wesley Tansey

Deep networks have shown impressive performance in the image restoration tasks, such as image colorization. However, we find that previous approaches rely on the digital representation from single color model with a specific mapping…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Xiangcheng Du , Zhao Zhou , Yanlong Wang , Zhuoyao Wang , Yingbin Zheng , Cheng Jin

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

Predicting all applicable labels for a given image is known as multi-label classification. Compared to the standard multi-class case (where each image has only one label), it is considerably more challenging to annotate training data for…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Elijah Cole , Oisin Mac Aodha , Titouan Lorieul , Pietro Perona , Dan Morris , Nebojsa Jojic

In this paper, we propose to build a stylish image captioning model through a Multi-style Multi modality mechanism (2M). We demonstrate that with 2M, we can build an effective stylish captioner and that multi-references produced by the…

Computation and Language · Computer Science 2021-11-19 Chengxi Li , Brent Harrison

Causal approaches to post-hoc explainability for black-box prediction models (e.g., deep neural networks trained on image pixel data) have become increasingly popular. However, existing approaches have two important shortcomings: (i) the…

Machine Learning · Computer Science 2025-08-12 Numair Sani , Daniel Malinsky , Ilya Shpitser

The increased interest in deep learning applications, and their hard-to-detect biases result in the need to validate and explain complex models. However, current explanation methods are limited as far as both the explanation of the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Weronika Hryniewska , Adrianna Grudzień , Przemysław Biecek

While deep neural networks are extremely effective at classifying images, they remain opaque and hard to interpret. We introduce local and global explanation methods for black-box models that generate explanations in terms of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Bhavan Vasu , Giuseppe Raffa , Prasad Tadepalli

Understanding the interpretation of machine learning (ML) models has been of paramount importance when making decisions with societal impacts such as transport control, financial activities, and medical diagnosis. While current model…

Human-Computer Interaction · Computer Science 2024-05-07 Jun Yuan , Gromit Yeuk-Yin Chan , Brian Barr , Kyle Overton , Kim Rees , Luis Gustavo Nonato , Enrico Bertini , Claudio T. Silva

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

Explainable artificial intelligence is proposed to provide explanations for reasoning performed by an Artificial Intelligence. There is no consensus on how to evaluate the quality of these explanations, since even the definition of…

Artificial Intelligence · Computer Science 2025-06-17 Iván Sevillano-García , Julián Luengo-Martín , Francisco Herrera

Most state-of-the-art machine learning algorithms induce black-box models, preventing their application in many sensitive domains. Hence, many methodologies for explaining machine learning models have been proposed to address this problem.…

Machine Learning · Computer Science 2020-09-15 Tiago Botari , Frederik Hvilshøj , Rafael Izbicki , Andre C. P. L. F. de Carvalho

Progress in image generation raises significant public security concerns. We argue that fake image detection should not operate as a "black box". Instead, an ideal approach must ensure both strong generalization and transparency. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Yikun Ji , Yan Hong , Jiahui Zhan , Haoxing Chen , jun lan , Huijia Zhu , Weiqiang Wang , Liqing Zhang , Jianfu Zhang

Natural language explanations provide an inherently human-understandable way to explain black-box models, closely reflecting how radiologists convey their diagnoses in textual reports. Most works explicitly supervise the explanation…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira

As machine learning methods see greater adoption and implementation in high stakes applications such as medical image diagnosis, the need for model interpretability and explanation has become more critical. Classical approaches that assess…

Machine Learning · Computer Science 2020-02-12 Sumedha Singla , Brian Pollack , Junxiang Chen , Kayhan Batmanghelich

Concept-based models aim to explain model decisions with human-understandable concepts. However, most existing approaches treat concepts as numerical attributes, without providing complementary visual explanations that could localize the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Machine learning (ML) applications have automated numerous real-life tasks, improving both private and public life. However, the black-box nature of many state-of-the-art models poses the challenge of model verification; how can one be sure…

Machine Learning · Computer Science 2022-01-19 Ioannis Papantonis , Vaishak Belle

An outstanding image-text retrieval model depends on high-quality labeled data. While the builders of existing image-text retrieval datasets strive to ensure that the caption matches the linked image, they cannot prevent a caption from…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Xu Yan , Chunhui Ai , Ziqiang Cao , Min Cao , Sujian Li , Wenjie Li , Guohong Fu