English
Related papers

Related papers: Sanity Simulations for Saliency Methods

200 papers

The majority of current salient object detection (SOD) models are focused on designing a series of decoders based on fully convolutional networks (FCNs) or Transformer architectures and integrating them in a skillful manner. These models…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Ailing Pan , Chao Dai , Chen Pan , Dongping Zhang , Yunchao Xu

In the area of human fixation prediction, dozens of computational saliency models are proposed to reveal certain saliency characteristics under different assumptions and definitions. As a result, saliency model benchmarking often requires…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Changqun Xia , Jia Li , Jinming Su , Ali Borji

Existing salient object detection methods are capable of predicting binary maps that highlight visually salient regions. However, these methods are limited in their ability to differentiate the relative importance of multiple objects and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Mengke Song , Linfeng Li , Dunquan Wu , Wenfeng Song , Chenglizhao Chen

In machine learning, classification tasks serve as the cornerstone of a wide range of real-world applications. Reliable, trustworthy classification is particularly intricate in biomedical settings, where the ground truth is often inherently…

Machine Learning · Computer Science 2023-11-14 Aina Tersol Montserrat , Alexander R. Loftus , Yael Daihes

Accurate semantic segmentation models typically require significant computational resources, inhibiting their use in practical applications. Recent works rely on well-crafted lightweight models to achieve fast inference. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Danna Xue , Fei Yang , Pei Wang , Luis Herranz , Jinqiu Sun , Yu Zhu , Yanning Zhang

Spontaneous speech emotion data usually contain perceptual grades where graders assign emotion score after listening to the speech files. Such perceptual grades introduce uncertainty in labels due to grader opinion variation. Grader…

Sound · Computer Science 2025-04-01 Vikramjit Mitra , Amrit Romana , Dung T. Tran , Erdrin Azemi

Backpropagation image saliency aims at explaining model predictions by estimating model-centric importance of individual pixels in the input. However, class-insensitivity of the earlier layers in a network only allows saliency computation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Mohammad A. A. K. Jalwana , Naveed Akhtar , Mohammed Bennamoun , Ajmal Mian

We describe an explainable AI saliency map method for use with deep convolutional neural networks (CNN) that is much more efficient than popular fine-resolution gradient methods. It is also quantitatively similar or better in accuracy. Our…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 T. Nathan Mundhenk , Barry Y. Chen , Gerald Friedland

Tables provide valuable knowledge that can be used to verify textual statements. While a number of works have considered table-based fact verification, direct alignments of tabular data with tokens in textual statements are rarely…

Computation and Language · Computer Science 2021-09-10 Fei Wang , Kexuan Sun , Jay Pujara , Pedro Szekely , Muhao Chen

Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated…

Robotics · Computer Science 2022-03-25 Ajith Anil Meera , Filip Novicky , Thomas Parr , Karl Friston , Pablo Lanillos , Noor Sajid

As the applications of Natural Language Processing (NLP) in sensitive areas like Political Profiling, Review of Essays in Education, etc. proliferate, there is a great need for increasing transparency in NLP models to build trust with…

Computation and Language · Computer Science 2022-11-29 Adel Rahimi , Shaurya Jain

While the capabilities and utility of AI systems have advanced, rigorous norms for evaluating these systems have lagged. Grand claims, such as models achieving general reasoning capabilities, are supported with model performance on narrow…

Saliency maps have shown to be both useful and misleading for explaining model predictions especially in the context of images. In this paper, we perform sanity checks for text modality and show that the conclusions made for image do not…

Machine Learning · Computer Science 2021-06-15 Narine Kokhlikyan , Vivek Miglani , Bilal Alsallakh , Miguel Martin , Orion Reblitz-Richardson

Deep Neural Networks are powerful tools for understanding complex patterns and making decisions. However, their black-box nature impedes a complete understanding of their inner workings. Saliency-Guided Training (SGT) methods try to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

Image summary, an abridged version of the original visual content, can be used to represent the scene. Thus, tasks such as scene classification, identification, indexing, etc., can be performed efficiently using the unique summary. Saliency…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Preeti Meena , Himanshu Kumar , Sandeep Yadav

Deep learning dominates image classification tasks, yet understanding how models arrive at predictions remains a challenge. Much research focuses on local explanations of individual predictions, such as saliency maps, which visualise the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 James Hinns , David Martens

This paper proposes a new end-to-end trainable model for lossy image compression, which includes several novel components. The method incorporates 1) an adequate perceptual similarity metric; 2) saliency in the images; 3) a hierarchical…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 Yash Patel , Srikar Appalaraju , R. Manmatha

In recent years, an abundance of feature attribution methods for explaining neural networks have been developed. Especially in the field of computer vision, many methods for generating saliency maps providing pixel attributions exist.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Yannik Mahlau , Christian Nolde

We propose a novel neural network architecture for visual saliency detections, which utilizes neurophysiologically plausible mechanisms for extraction of salient regions. The model has been significantly inspired by recent findings from…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Natalia Efremova , Sergey Tarasenko

Traditional saliency map methods, popularized in computer vision, highlight individual points (pixels) of the input that contribute the most to the model's output. However, in time series, they offer limited insights, as semantically…

Machine Learning · Computer Science 2026-05-08 Christodoulos Kechris , Jonathan Dan , David Atienza