English
Related papers

Related papers: Interpreting Undesirable Pixels for Image Classifi…

200 papers

Despite their high accuracies, modern complex image classifiers cannot be trusted for sensitive tasks due to their unknown decision-making process and potential biases. Counterfactual explanations are very effective in providing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Kamran Alipour , Aditya Lahiri , Ehsan Adeli , Babak Salimi , Michael Pazzani

Mitigating bias in machine learning models is a critical endeavor for ensuring fairness and equity. In this paper, we propose a novel approach to address bias by leveraging pixel image attributions to identify and regularize regions of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Sander De Coninck , Sam Leroux , Pieter Simoens

Understanding the decision-making process of machine learning models provides valuable insights into the task, the data, and the reasons behind a model's failures. In this work, we propose a method that performs inherently interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Moritz Vandenhirtz , Julia E. Vogt

Detecting traversable road areas ahead a moving vehicle is a key process for modern autonomous driving systems. A common approach to road detection consists of exploiting color features to classify pixels as road or background. These…

Computer Vision and Pattern Recognition · Computer Science 2014-12-19 Jose M. Alvarez , Theo Gevers , Antonio M. Lopez

Despite recent advancements in Instruct-based Image Editing models for generating high-quality images, they are known as black boxes and a significant barrier to transparency and user trust. To solve this issue, we introduce SMILE…

Artificial Intelligence · Computer Science 2024-12-24 Zeinab Dehghani , Koorosh Aslansefat , Adil Khan , Adín Ramírez Rivera , Franky George , Muhammad Khalid

Deep learning models are used in safety-critical tasks such as automated driving and face recognition. However, small perturbations in the model input can significantly change the predictions. Adversarial attacks are used to identify small…

Cryptography and Security · Computer Science 2025-12-03 Issa Oe , Keiichiro Yamamura , Hiroki Ishikura , Ryo Hamahira , Katsuki Fujisawa

Existing tools for explaining the output of image classifiers can be divided into white-box, which rely on access to the model internals, and black-box, agnostic to the model. As the usage of AI in the medical domain grows, so too does the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Nathan Blake , Hana Chockler , David A. Kelly , Santiago Calderon Pena , Akchunya Chanchal

Although deep learning models are powerful among various applications, most deep learning models are still a black box, lacking verifiability and interpretability, which means the decision-making process that human beings cannot understand.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Qianmengke Zhao , Ye Wang , Qun Liu

When an image classifier makes a prediction, which parts of the image are relevant and why? We can rephrase this question to ask: which parts of the image, if they were not seen by the classifier, would most change its decision? Producing…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Chun-Hao Chang , Elliot Creager , Anna Goldenberg , David Duvenaud

One-pixel attack is a curious way of deceiving neural network classifier by changing only one pixel in the input image. The full potential and boundaries of this attack method are not yet fully understood. In this research, the successful…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Janne Alatalo , Joni Korpihalkola , Tuomo Sipola , Tero Kokkonen

Deep neural networks are vulnerable to adversarial attacks and hard to interpret because of their black-box nature. The recently proposed invertible network is able to accurately reconstruct the inputs to a layer from its outputs, thus has…

Machine Learning · Computer Science 2019-10-16 Juntang Zhuang , Nicha C. Dvornek , Xiaoxiao Li , Junlin Yang , James S. Duncan

Deep Neural Networks have often been called the black box because of the complex, deep architecture and non-transparency presented by the inner layers. There is a lack of trust to use Artificial Intelligence in critical and high-precision…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Frincy Clement , Ji Yang , Irene Cheng

Recent works find that AI algorithms learn biases from data. Therefore, it is urgent and vital to identify biases in AI algorithms. However, the previous bias identification pipeline overly relies on human experts to conjecture potential…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Zhiheng Li , Chenliang Xu

Artificial neural networks have proven to be extremely useful models that have allowed for multiple recent breakthroughs in the field of Artificial Intelligence and many others. However, they are typically regarded as black boxes, given how…

Artificial Intelligence · Computer Science 2023-03-07 Manuel de Sousa Ribeiro , João Leite

In recent years, deep learning has become prevalent to solve applications from multiple domains. Convolutional Neural Networks (CNNs) particularly have demonstrated state of the art performance for the task of image classification. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Meghna P Ayyar , Jenny Benois-Pineau , Akka Zemmari

While many image colorization algorithms have recently shown the capability of producing plausible color versions from gray-scale photographs, they still suffer from the problems of context confusion and edge color bleeding. To address…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Jiaojiao Zhao , Li Liu , Cees G. M. Snoek , Jungong Han , Ling Shao

Understanding the predictions made by deep learning models remains a central challenge, especially in high-stakes applications. A promising approach is to equip models with the ability to answer counterfactual questions -- hypothetical…

Machine Learning · Computer Science 2025-10-28 Inwoo Hwang , Yushu Pan , Elias Bareinboim

Adversarial attacks have proved to be the major impediment in the progress on research towards reliable machine learning solutions. Carefully crafted perturbations, imperceptible to human vision, can be added to images to force…

Artificial Intelligence · Computer Science 2020-11-24 Nandish Chattopadhyay , Lionell Yip En Zhi , Bryan Tan Bing Xing , Anupam Chattopadhyay

The causal explanation of image misclassifications is an understudied niche, which can potentially provide valuable insights in model interpretability and increase prediction accuracy. This study trains CIFAR-10 on six modern CNN…

Machine Learning · Computer Science 2020-06-30 Yan Min , Miles Bennett

In recent years, deep neural networks have been widely used for building high-performance Artificial Intelligence (AI) systems for computer vision applications. Object detection is a fundamental task in computer vision, which has been…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari