English
Related papers

Related papers: A Reverse Hierarchy Model for Predicting Eye Fixat…

200 papers

Most models of visual attention aim at predicting either top-down or bottom-up control, as studied using different visual search and free-viewing tasks. In this paper we propose the Human Attention Transformer (HAT), a single model that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhibo Yang , Sounak Mondal , Seoyoung Ahn , Ruoyu Xue , Gregory Zelinsky , Minh Hoai , Dimitris Samaras

Recent efforts to improve the interpretability of deep neural networks use saliency to characterize the importance of input features to predictions made by models. Work on interpretability using saliency-based methods on Recurrent Neural…

Machine Learning · Computer Science 2019-10-29 Aya Abdelsalam Ismail , Mohamed Gunady , Luiz Pessoa , Héctor Corrada Bravo , Soheil Feizi

Deep hashing methods have been proved to be effective for the large-scale medical image search assisting reference-based diagnosis for clinicians. However, when the salient region plays a maximal discriminative role in ophthalmic image,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Jiansheng Fang , Yanwu Xu , Xiaoqing Zhang , Yan Hu , Jiang Liu

Various saliency detection algorithms from color images have been proposed to mimic eye fixation or attentive object detection response of human observers for the same scenes. However, developments on hyperspectral imaging systems enable us…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Nevrez Imamoglu , Guanqun Ding , Yuming Fang , Asako Kanezaki , Toru Kouyama , Ryosuke Nakamura

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

Recent results suggest that state-of-the-art saliency models perform far from optimal in predicting fixations. This lack in performance has been attributed to an inability to model the influence of high-level image features such as objects.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-10 Matthias Kümmerer , Lucas Theis , Matthias Bethge

Deep learning has achieved outstanding performance for face recognition benchmarks, but performance reduces significantly for low resolution (LR) images. We propose an attention similarity knowledge distillation approach, which transfers…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Sungho Shin , Joosoon Lee , Junseok Lee , Yeonguk Yu , Kyoobin Lee

The saliency ranking task is recently proposed to study the visual behavior that humans would typically shift their attention over different objects of a scene based on their degrees of saliency. Existing approaches focus on learning either…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xin Tian , Ke Xu , Xin Yang , Lin Du , Baocai Yin , Rynson W. H. Lau

We propose a novel recurrent attentional structure to localize and recognize objects jointly. The network can learn to extract a sequence of local observations with detailed appearance and rough context, instead of sliding windows or…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Jie Lyu , Zejian Yuan , Dapeng Chen

Visual attention is a field with a considerable history, with eye movement control and prediction forming an important subfield. Fixation modeling in the past decades has been largely dominated computationally by a number of highly…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Calden Wloka , Iuliia Kotseruba , John K. Tsotsos

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

Saliency modeling has been an active research area in computer vision for about two decades. Existing state of the art models perform very well in predicting where people look in natural scenes. There is, however, the risk that these models…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Ali Borji , Laurent Itti

State-of-the-art saliency prediction methods develop upon model architectures or loss functions; while training to generate one target saliency map. However, publicly available saliency prediction datasets can be utilized to create more…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Sandeep Mishra , Oindrila Saha

We propose to employ a saliency-driven hierarchical neural image compression network for a machine-to-machine communication scenario following the compress-then-analyze paradigm. By that, different areas of the image are coded at different…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Kristian Fischer , Fabian Brand , Christian Blum , André Kaup

We propose a state of the art method for intelligent object recognition and video surveillance based on human visual attention. Bottom up and top down attention are applied respectively in the process of acquiring interested object(saliency…

Computer Vision and Pattern Recognition · Computer Science 2013-08-26 Panqu Wang , Yan Zhang

Understanding human visual attention is important for multimedia applications. Many studies have attempted to learn from eye-tracking data and build computational saliency prediction models. However, limited efforts have been devoted to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 Yujun Gu , Jie Chang , Ya Zhang , Yanfeng Wang

One of the key challenges in machine learning is to design a computationally efficient multi-class classifier while maintaining the output accuracy and performance. In this paper, we present a tree-based classifier: Attention Tree (ATree)…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Priyadarshini Panda , Kaushik Roy

We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of {\it non-saliency}. Third, we simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Jian Li , Martin Levine , Xiangjing An , Xin Xu , Hangen He

We present a novel approach for saliency prediction in images, leveraging parallel decoding in transformers to learn saliency solely from fixation maps. Models typically rely on continuous saliency maps, to overcome the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yasser Abdelaziz Dahou Djilali , Kevin McGuiness , Noel O'Connor

Predicting where people look in natural scenes has attracted a lot of interest in computer vision and computational neuroscience over the past two decades. Two seemingly contrasting categories of cues have been proposed to influence where…

Computer Vision and Pattern Recognition · Computer Science 2015-04-01 Ali Borji , James Tanner