English
Related papers

Related papers: What Do Deep Saliency Models Learn about Visual At…

200 papers

We present a model for predicting visual attention during the free viewing of graphic design documents. While existing works on this topic have aimed at predicting static saliency of graphic designs, our work is the first attempt to predict…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Souradeep Chakraborty , Zijun Wei , Conor Kelton , Seoyoung Ahn , Aruna Balasubramanian , Gregory J. Zelinsky , Dimitris Samaras

Accounting for individual differences can improve the effectiveness of visualization design. While the role of visual attention in visualization interpretation is well recognized, existing work often overlooks how this behavior varies based…

Human-Computer Interaction · Computer Science 2025-08-07 Minsuk Chang , Yao Wang , Huichen Will Wang , Yuanhong Zhou , Andreas Bulling , Cindy Xiong Bearfield

Nearly all existing visual saliency models by far have focused on predicting a universal saliency map across all observers. Yet psychology studies suggest that visual attention of different observers can vary significantly under specific…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Yanyu Xu , Shenghua Gao , Junru Wu , Nianyi Li , Jingyi Yu

Saliency modeling has been an active research area in computer vision for about two decades. Existing state of the art models perform very well in predicting where people look in natural scenes. There is, however, the risk that these models…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Ali Borji , Laurent Itti

This paper introduces a Unified Model of Saliency and Importance (UMSI), which learns to predict visual importance in input graphic designs, and saliency in natural images, along with a new dataset and applications. Previous methods for…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Camilo Fosco , Vincent Casser , Amish Kumar Bedi , Peter O'Donovan , Aaron Hertzmann , Zoya Bylinskii

Saliency methods aim to explain the predictions of deep neural networks. These methods lack reliability when the explanation is sensitive to factors that do not contribute to the model prediction. We use a simple and common pre-processing…

Recently, a considerable number of studies in computer vision involves deep neural architectures called vision transformers. Visual processing in these models incorporates computational models that are claimed to implement attention…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Paria Mehrani , John K. Tsotsos

We propose a novel neural network architecture for visual saliency detections, which utilizes neurophysiologically plausible mechanisms for extraction of salient regions. The model has been significantly inspired by recent findings from…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Natalia Efremova , Sergey Tarasenko

Recently, video streams have occupied a large proportion of Internet traffic, most of which contain human faces. Hence, it is necessary to predict saliency on multiple-face videos, which can provide attention cues for many content based…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yufan Liu , Minglang Qiao , Mai Xu , Bing Li , Weiming Hu , Ali Borji

Deep learning models have achieved remarkable success in natural language inference (NLI) tasks. While these models are widely explored, they are hard to interpret and it is often unclear how and why they actually work. In this paper, we…

Computation and Language · Computer Science 2019-05-21 Reza Ghaeini , Xiaoli Z. Fern , Prasad Tadepalli

Feed-forward only convolutional neural networks (CNNs) may ignore intrinsic relationships and potential benefits of feedback connections in vision tasks such as saliency detection, despite their significant representation capabilities. In…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Guanqun Ding , Nevrez Imamoglu , Ali Caglayan , Masahiro Murakawa , Ryosuke Nakamura

Learning implicit templates as neural fields has recently shown impressive performance in unsupervised shape correspondence. Despite the success, we observe current approaches, which solely rely on geometric information, often learn…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Sihyeon Kim , Minseok Joo , Jaewon Lee , Juyeon Ko , Juhan Cha , Hyunwoo J. Kim

Deep learning techniques have proven highly effective in image classification, but their deployment in resourceconstrained environments remains challenging due to high computational demands. Furthermore, their interpretability is of high…

Machine Learning · Computer Science 2024-12-06 Alireza Maleki , Mahsa Lavaei , Mohsen Bagheritabar , Salar Beigzad , Zahra Abadi

Interpretation and improvement of deep neural networks relies on better understanding of their underlying mechanisms. In particular, gradients of classes or concepts with respect to the input features (e.g., pixels in images) are often used…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Lennart Brocki , Neo Christopher Chung

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

Recent advances in the field of saliency have concentrated on fixation prediction, with benchmarks reaching saturation. However, there is an extensive body of works in psychology and neuroscience that describe aspects of human visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Iuliia Kotseruba , Calden Wloka , Amir Rasouli , John K. Tsotsos

The success of current deep saliency detection methods heavily depends on the availability of large-scale supervision in the form of per-pixel labeling. Such supervision, while labor-intensive and not always possible, tends to hinder the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Jing Zhang , Tong Zhang , Yuchao Dai , Mehrtash Harandi , Richard Hartley

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Yifei Zhang , Siyi Gu , Bo Pan , Guangji Bai , Meikang Qiu , Xiaofeng Yang , Liang Zhao

This paper presents a holistic approach to saliency-guided visual attention modeling (SVAM) for use by autonomous underwater robots. Our proposed model, named SVAM-Net, integrates deep visual features at various scales and semantics for…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Md Jahidul Islam , Ruobing Wang , Junaed Sattar

The prediction of salient areas in images has been traditionally addressed with hand-crafted features based on neuroscience principles. This paper, however, addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 Junting Pan , Kevin McGuinness , Elisa Sayrol , Noel O'Connor , Xavier Giro-i-Nieto