English
Related papers

Related papers: Comparing radiologists' gaze and saliency maps gen…

200 papers

Deep learning models have great potential in medical imaging, including orthodontics and skeletal maturity assessment. However, applying a model to data different from its training set can lead to unreliable predictions that may impact…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Omid Halimi Milani , Amanda Nikho , Lauren Mills , Marouane Tliba , Ahmet Enis Cetin , Mohammed H. Elnagar

Purpose: To investigate chest radiograph (CXR) classification performance of vision transformers (ViT) and interpretability of attention-based saliency using the example of pneumothorax classification. Materials and Methods: In this…

Image and Video Processing · Electrical Eng. & Systems 2023-05-09 Alessandro Wollek , Robert Graf , Saša Čečatka , Nicola Fink , Theresa Willem , Bastian O. Sabel , Tobias Lasser

Saliency maps have become a widely used method to assess which areas of the input image are most pertinent to the prediction of a trained neural network. However, in the context of medical imaging, there is no study to our knowledge that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Nishanth Thumbavanam Arun , Nathan Gaw , Praveer Singh , Ken Chang , Katharina Viktoria Hoebel , Jay Patel , Mishka Gidwani , Jayashree Kalpathy-Cramer

CAM-based methods are widely-used post-hoc interpretability method that produce a saliency map to explain the decision of an image classification model. The saliency map highlights the important areas of the image relevant to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Magamed Taimeskhanov , Ronan Sicre , Damien Garreau

Methods based on class activation maps (CAM) provide a simple mechanism to interpret predictions of convolutional neural networks by using linear combinations of feature maps as saliency maps. By contrast, masking-based methods optimize a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Hanwei Zhang , Felipe Torres , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Saliency maps are a popular approach for explaining classifications of (convolutional) neural networks. However, it remains an open question as to how best to evaluate salience maps, with three families of evaluation methods commonly being…

Human-Computer Interaction · Computer Science 2025-04-25 Felix Kares , Timo Speith , Hanwei Zhang , Markus Langer

As AI-based medical devices are becoming more common in imaging fields like radiology and histology, interpretability of the underlying predictive models is crucial to expand their use in clinical practice. Existing heatmap-based…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Kathryn Schutte , Olivier Moindrot , Paul Hérent , Jean-Baptiste Schiratti , Simon Jégou

In recent years, several advances have been observed in Deep Learning with surprising results. Models in this area have been increasingly used in numerous applications, including those sensitive to human life, which require clear…

Machine Learning · Computer Science 2026-05-05 Daniel da Silva Costa , Pedro Nuno de Souza Moura , Adriana C. F. Alvim

The introduction of saliency map algorithms as an approach for assessing the interoperability of images has allowed for a deeper understanding of current black-box models with Artificial Intelligence. Their rise in popularity has led to…

Image and Video Processing · Electrical Eng. & Systems 2023-06-29 Evan Kellener , Ihina Nath , An Ngo , Thomas Nguyen , Joshua Schuman , Coen Adler , Arnav Kartikeya

Class activation map (CAM) helps to formulate saliency maps that aid in interpreting the deep neural network's prediction. Gradient-based methods are generally faster than other branches of vision interpretability and independent of human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Masud An Nur Islam Fahim , Nazmus Saqib , Shafkat Khan Siam , Ho Yub Jung

Attention--or attribution--maps methods are methods designed to highlight regions of the model's input that were discriminative for its predictions. However, different attention maps methods can highlight different regions of the input,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Ali Mirzazadeh , Florian Dubost , Maxwell Pike , Krish Maniar , Max Zuo , Christopher Lee-Messer , Daniel Rubin

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Zhenyue Qin , Jie Wu

This work proposes a saliency-based attribution framework to evaluate and compare 10 state-of-the-art explainability methods for deep learning models in astronomy, focusing on the classification of radio galaxy images. While previous work…

Instrumentation and Methods for Astrophysics · Physics 2025-02-25 M. T. Atemkeng , C. Chuma , S. Zaza , C. D. Nunhokee , O. M. Smirnov

Integrating heterogeneous biomedical data including imaging, omics, and clinical records supports accurate diagnosis and personalised care. Graph-based models fuse such non-Euclidean data by capturing spatial and relational structure, yet…

Genomics · Quantitative Biology 2025-05-06 Alireza Sadeghi , Farshid Hajati , Ahmadreza Argha , Nigel H Lovell , Min Yang , Hamid Alinejad-Rokny

Medical image analysis often faces significant challenges due to limited expert-annotated data, hindering both model generalization and clinical adoption. We propose an expert-guided explainable few-shot learning framework that integrates…

Image and Video Processing · Electrical Eng. & Systems 2025-09-12 Ifrat Ikhtear Uddin , Longwei Wang , KC Santosh

Eye-tracking analysis plays a vital role in medical imaging, providing key insights into how radiologists visually interpret and diagnose clinical cases. In this work, we first analyze radiologists' attention and agreement by measuring the…

The interpretability of deep neural networks has become a subject of great interest within the medical and healthcare domain. This attention stems from concerns regarding transparency, legal and ethical considerations, and the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Mahbub Ul Alam , Jaakko Hollmén , Jón Rúnar Baldvinsson , Rahim Rahmani

Saliency maps have become a widely used method to make deep learning models more interpretable by providing post-hoc explanations of classifiers through identification of the most pertinent areas of the input medical image. They are…

Interpreting the decisions of deep learning models has been actively studied since the explosion of deep neural networks. One of the most convincing interpretation approaches is salience-based visual interpretation, such as Grad-CAM, where…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yiming Lei , Zilong Li , Yangyang Li , Junping Zhang , Hongming Shan

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan
‹ Prev 1 2 3 10 Next ›