English
Related papers

Related papers: Attention-based Saliency Maps Improve Interpretabi…

200 papers

Chest X-ray (CXR) images are commonly compressed to a lower resolution and bit depth to reduce their size, potentially altering subtle diagnostic features. Radiologists use windowing operations to enhance image contrast, but the impact of…

Image and Video Processing · Electrical Eng. & Systems 2023-08-04 Alessandro Wollek , Sardi Hyska , Bastian Sabel , Michael Ingrisch , Tobias Lasser

Recent studies show that Vision Transformers(ViTs) exhibit strong robustness against various corruptions. Although this property is partly attributed to the self-attention mechanism, there is still a lack of systematic understanding. In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Daquan Zhou , Zhiding Yu , Enze Xie , Chaowei Xiao , Anima Anandkumar , Jiashi Feng , Jose M. Alvarez

Human eyes concentrate different facial regions during distinct cognitive activities. We study utilising facial visual saliency maps to classify different facial expressions into different emotions. Our results show that our novel method of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-13 Zhenyue Qin , Jie Wu

Chest x-rays are the most common radiology studies for diagnosing lung and heart disease. Hence, a system for automated pre-reporting of pathologic findings on chest x-rays would greatly enhance radiologists' productivity. To this end, we…

Image and Video Processing · Electrical Eng. & Systems 2020-06-15 Adora M. DSouza , Anas Z. Abidin , Axel Wismüller

Recently, due to the strength of deep convolutional neural networks (CNN), many CNN-based image quality assessment (IQA) models have been studied. However, previous CNN-based IQA models likely have yet to utilize the characteristics of the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Soomin Seo , Sehwan Ki , Munchurl Kim

Vision Transformers (ViTs) have recently taken computer vision by storm. However, the softmax attention underlying ViTs comes with a quadratic complexity in time and memory, hindering the application of ViTs to high-resolution images. We…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Chuanyang Zheng

Optical Coherence Tomography (OCT) scan yields all possible cross-section images of a retina for detecting biomarkers linked to optical defects. Due to the high volume of data generated, an automated and reliable biomarker detection…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Haz Sameen Shahgir , Tanjeem Azwad Zaman , Khondker Salman Sayeed , Md. Asif Haider , Sheikh Saifur Rahman Jony , M. Sohel Rahman

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

Age estimation from facial images is a complex and multifaceted challenge in computer vision. In this study, we present a novel hybrid architecture that combines ConvNeXt, a state-of-the-art advancement of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Gaby Maroun , Salah Eddine Bekhouche , Fadi Dornaika

Vision Transformers have shown great promise recently for many vision tasks due to the insightful architecture design and attention mechanism. By revisiting the self-attention responses in Transformers, we empirically observe two…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Xu Ma , Huan Wang , Can Qin , Kunpeng Li , Xingchen Zhao , Jie Fu , Yun Fu

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

Purpose: To develop a machine learning model to classify the severity grades of pulmonary edema on chest radiographs. Materials and Methods: In this retrospective study, 369,071 chest radiographs and associated radiology reports from 64,581…

Image and Video Processing · Electrical Eng. & Systems 2021-01-08 Steven Horng , Ruizhi Liao , Xin Wang , Sandeep Dalal , Polina Golland , Seth J Berkowitz

Visual recognition has been dominated by convolutional neural networks (CNNs) for years. Though recently the prevailing vision transformers (ViTs) have shown great potential of self-attention based models in ImageNet classification, their…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Li Yuan , Qibin Hou , Zihang Jiang , Jiashi Feng , Shuicheng Yan

Mechanistic interpretability improves the safety, reliability, and robustness of large AI models. This study examined individual attention heads in vision transformers (ViTs) fine tuned on distorted 2D spectrogram images containing non…

Machine Learning · Computer Science 2025-03-25 Nooshin Bahador

Due to the lack of automated methods, to diagnose cerebrovascular disease, time-of-flight magnetic resonance angiography (TOF-MRA) is assessed visually, making it time-consuming. The commonly used encoder-decoder architectures for…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Syed Farhan Abbas , Nguyen Thanh Duc , Yoonguu Song , Kyungwon Kim , Ekta Srivastava , Boreom Lee

Vision Transformer (ViT) has recently demonstrated promise in computer vision problems. However, unlike Convolutional Neural Networks (CNN), it is known that the performance of ViT saturates quickly with depth increasing, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Peihao Wang , Wenqing Zheng , Tianlong Chen , Zhangyang Wang

Pneumonia remains a leading cause of morbidity and mortality worldwide. Chest X-ray (CXR) imaging is a fundamental diagnostic tool, but traditional analysis relies on time-intensive expert evaluation. Recently, deep learning has shown…

Image and Video Processing · Electrical Eng. & Systems 2024-01-05 Sandeep Angara , Nishith Reddy Mannuru , Aashrith Mannuru , Sharath Thirunagaru

Early and accurate classification of Alzheimers disease (AD) from brain MRI scans is essential for timely clinical intervention and improved patient outcomes. This study presents a comprehensive comparative analysis of five CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Md Mahmudul Hoque , Shuvo Karmaker , Md. Hadi Al-Amin , Md Modabberul Islam , Jisun Junayed , Farha Ulfat Mahi

The success of deep convolutional neural networks on image classification and recognition tasks has led to new applications in very diversified contexts, including the field of medical imaging. In this paper we investigate and propose…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Alexey A. Novikov , Dimitrios Lenis , David Major , Jiri Hladůvka , Maria Wimmer , Katja Bühler

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

Machine Learning · Computer Science 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi