English
Related papers

Related papers: Comparing radiologists' gaze and saliency maps gen…

200 papers

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Gaze estimation is pivotal in human scene comprehension tasks, particularly in medical diagnostic analysis. Eye-tracking technology facilitates the recording of physicians' ocular movements during image interpretation, thereby elucidating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Shaonan Liu , Wenting Chen , Jie Liu , Xiaoling Luo , Linlin Shen

X-ray imaging is the most widely used medical imaging modality. However, in the common practice, inconsistency in the initial presentation of X-ray images is a common complaint by radiologists. Different patient positions, patient habitus…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Hongxu Yang , Najib Akram Aboobacker , Xiaomeng Dong , German Gonzalez , Lehel Ferenczi , Gopal Avinash

As deep learning is widely used in the radiology field, the explainability of such models is increasingly becoming essential to gain clinicians' trust when using the models for diagnosis. In this research, three experiment sets were…

Image and Video Processing · Electrical Eng. & Systems 2022-07-04 Akino Watanabe , Sara Ketabi , Khashayar , Namdar , Farzad Khalvati

Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ekrem Aksoy , Ahmet Yazıcı , Mahmut Kasap

Cardiovascular disease is a large worldwide healthcare issue; symptoms often present suddenly with minimal warning. The electrocardiogram (ECG) is a fast, simple and reliable method of evaluating the health of the heart, by measuring…

Signal Processing · Electrical Eng. & Systems 2022-01-15 Yola Jones , Fani Deligianni , Jeff Dalton

Saliency methods are a common class of machine learning interpretability techniques that calculate how important each input feature is to a model's output. We find that, with the rapid pace of development, users struggle to stay informed of…

Machine Learning · Computer Science 2023-06-01 Angie Boggust , Harini Suresh , Hendrik Strobelt , John V. Guttag , Arvind Satyanarayan

Explaining machine learning (ML) models using eXplainable AI (XAI) techniques has become essential to make them more transparent and trustworthy. This is especially important in high-stakes domains like healthcare, where understanding model…

Machine Learning · Computer Science 2025-12-04 Felix Tempel , Daniel Groos , Espen Alexander F. Ihlen , Lars Adde , Inga Strümke

Convolutional neural networks have become state-of-the-art in a wide range of image recognition tasks. The interpretation of their predictions, however, is an active area of research. Whereas various interpretation methods have been…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Kira Vinogradova , Alexandr Dibrov , Gene Myers

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

Visual attention refers to the human brain's ability to select relevant sensory information for preferential processing, improving performance in visual and cognitive tasks. It proceeds in two phases. One in which visual feature maps are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-02 Dario Zanca , Marco Gori , Stefano Melacci , Alessandra Rufa

We examined whether embedding human attention knowledge into saliency-based explainable AI (XAI) methods for computer vision models could enhance their plausibility and faithfulness. We first developed new gradient-based XAI methods for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Guoyang Liu , Jindi Zhang , Antoni B. Chan , Janet H. Hsiao

Medical image segmentation is a difficult but important task for many clinical operations such as cardiac bi-ventricular volume estimation. More recently, there has been a shift to utilizing deep learning and fully convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Jesse Sun , Fatemeh Darbehani , Mark Zaidi , Bo Wang

This paper studies interpretability of convolutional networks by means of saliency maps. Most approaches based on Class Activation Maps (CAM) combine information from fully connected layers and gradient through variants of backpropagation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Felipe Torres Figueroa , Hanwei Zhang , Ronan Sicre , Yannis Avrithis , Stephane Ayache

Most existing saliency models use low-level features or task descriptions when generating attention predictions. However, the link between observer characteristics and gaze patterns is rarely investigated. We present a novel saliency…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Bingqing Yu , James J. Clark

Incorporating human domain knowledge for breast tumor diagnosis is challenging, since shape, boundary, curvature, intensity, or other common medical priors vary significantly across patients and cannot be employed. This work proposes a new…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Aleksandar Vakanski , Min Xian , Phoebe Freer

Explainable Artificial Intelligence (XAI) techniques, such as Gradient-weighted Class Activation Mapping (Grad-CAM), have become indispensable for visualizing the reasoning process of deep neural networks in medical image analysis. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Teerapong Panboonyuen

We describe an explainable AI saliency map method for use with deep convolutional neural networks (CNN) that is much more efficient than popular fine-resolution gradient methods. It is also quantitatively similar or better in accuracy. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 T. Nathan Mundhenk , Barry Y. Chen , Gerald Friedland

This paper proposes a novel simultaneous localization and mapping (SLAM) approach, namely Attention-SLAM, which simulates human navigation mode by combining a visual saliency model (SalNavNet) with traditional monocular visual SLAM. Most…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Jinquan Li , Ling Pei , Danping Zou , Songpengcheng Xia , Qi Wu , Tao Li , Zhen Sun , Wenxian Yu

Traffic accident anticipation is a vital function of Automated Driving Systems (ADSs) for providing a safety-guaranteed driving experience. An accident anticipation model aims to predict accidents promptly and accurately before they occur.…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Muhammad Monjurul Karim , Yu Li , Ruwen Qin