English
Related papers

Related papers: Interpreting Medical Image Classifiers by Optimiza…

200 papers

Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Julius Adebayo , Justin Gilmer , Michael Muelly , Ian Goodfellow , Moritz Hardt , Been Kim

Attribution-based explanation techniques capture key patterns to enhance visual interpretability; however, these patterns often lack the granularity needed for insight in fine-grained tasks, particularly in cases of model misclassification,…

Artificial Intelligence · Computer Science 2025-11-12 Lintong Zhang , Kang Yin , Seong-Whan Lee

Recent work uncovered potential flaws in \eg attribution or heatmap based saliency methods. A typical flaw is a confirmations bias, where the scores are compared to human expectation. Since measuring the quality of saliency methods is hard…

Machine Learning · Computer Science 2025-01-27 Leonid Schwenke , Martin Atzmueller

With the ongoing rise of machine learning, the need for methods for explaining decisions made by artificial intelligence systems is becoming a more and more important topic. Especially for image classification tasks, many state-of-the-art…

Machine Learning · Computer Science 2022-05-10 Silvan Mertes , Tobias Huber , Katharina Weitz , Alexander Heimerl , Elisabeth André

Existing saliency-guided training approaches improve model generalization by incorporating a loss term that compares the model's class activation map (CAM) for a sample's true-class ({\it i.e.}, correct-label class) against a human…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Jacob Piland , Chris Sweet , Adam Czajka

Image classifiers are typically scored on their test set accuracy, but high accuracy can mask a subtle type of model failure. We find that high scoring convolutional neural networks (CNNs) on popular benchmarks exhibit troubling pathologies…

Machine Learning · Computer Science 2021-12-08 Brandon Carter , Siddhartha Jain , Jonas Mueller , David Gifford

Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yuzhi Zhao , Lai-Man Po , Kwok-Wai Cheung , Wing-Yin Yu , Yasar Abbas Ur Rehman

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Image captioning has been recently gaining a lot of attention thanks to the impressive achievements shown by deep captioning architectures, which combine Convolutional Neural Networks to extract image representations, and Recurrent Neural…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Marcella Cornia , Lorenzo Baraldi , Giuseppe Serra , Rita Cucchiara

Saliency map detection, as a method for detecting important regions of an image, is used in many applications such as image classification and recognition. We propose that context detection could have an essential role in image saliency…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Mahdi Ahmadi , Mohsen Hajabdollahi , Nader Karimi , Shadrokh Samavi

We consider active learning for binary classification in the agnostic pool-based setting. The vast majority of works in active learning in the agnostic setting are inspired by the CAL algorithm where each query is uniformly sampled from the…

Machine Learning · Computer Science 2021-05-17 Julian Katz-Samuels , Jifan Zhang , Lalit Jain , Kevin Jamieson

In machine learning, classification tasks serve as the cornerstone of a wide range of real-world applications. Reliable, trustworthy classification is particularly intricate in biomedical settings, where the ground truth is often inherently…

Machine Learning · Computer Science 2023-11-14 Aina Tersol Montserrat , Alexander R. Loftus , Yael Daihes

In the last few years, deep learning classifiers have shown promising results in image-based medical diagnosis. However, interpreting the outputs of these models remains a challenge. In cancer diagnosis, interpretability can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Kangning Liu , Yiqiu Shen , Nan Wu , Jakub Chłędowski , Carlos Fernandez-Granda , Krzysztof J. Geras

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

Although self-supervised learning enables us to bootstrap the training by exploiting unlabeled data, the generic self-supervised methods for natural images do not sufficiently incorporate the context. For medical images, a desirable method…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Li Sun , Ke Yu , Kayhan Batmanghelich

Saliency maps can explain a neural model's predictions by identifying important input features. They are difficult to interpret for laypeople, especially for instances with many features. In order to make them more accessible, we formalize…

Computation and Language · Computer Science 2023-06-08 Nils Feldhus , Leonhard Hennig , Maximilian Dustin Nasert , Christopher Ebert , Robert Schwarzenberg , Sebastian Möller

Advances in image-based dietary assessment methods have allowed nutrition professionals and researchers to improve the accuracy of dietary assessment, where images of food consumed are captured using smartphones or wearable devices. These…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Sri Kalyan Yarlagadda , Daniel Mas Montserrat , David Guerra , Carol J. Boushey , Deborah A. Kerr , Fengqing Zhu

With their increase in performance, neural network architectures also become more complex, necessitating explainability. Therefore, many new and improved methods are currently emerging, which often generate so-called saliency maps in order…

Machine Learning · Computer Science 2024-12-24 Leonid Schwenke , Martin Atzmueller

Medical image quality assessment is an important aspect of image acquisition, as poor-quality images may lead to misdiagnosis. Manual labelling of image quality is a tedious task for population studies and can lead to misleading results.…

Image and Video Processing · Electrical Eng. & Systems 2023-03-28 Caner Ozer , Arda Guler , Aysel Turkvatan Cansever , Ilkay Oksuz

This paper proposes an unsupervised bottom-up saliency detection approach by aggregating complementary background template with refinement. Feature vectors are extracted from each superpixel to cover regional color, contrast and texture…

Computer Vision and Pattern Recognition · Computer Science 2017-06-15 Chenxing Xia , Hanling Zhang , Xiuju Gao