English
Related papers

Related papers: Learning Saliency From Fixations

200 papers

Deep convolutional neural networks have demonstrated high performances for fixation prediction in recent years. How they achieve this, however, is less explored and they remain to be black box models. Here, we attempt to shed light on the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Ali Borji , Yang Mi , Nicolas Pugeault

Visual saliency prediction using transformers - Convolutional neural networks (CNNs) have significantly advanced computational modelling for saliency prediction. However, accurately simulating the mechanisms of visual attention in the human…

Multimedia · Computer Science 2022-06-30 Jianxun Lou , Hanhe Lin , David Marshall , Dietmar Saupe , Hantao Liu

Salient object detection, which aims to identify and locate the most salient pixels or regions in images, has been attracting more and more interest due to its various real-world applications. However, this vision task is quite challenging,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Pingping Zhang , Wei Liu , Huchuan Lu , Chunhua Shen

In this paper, we propose a fast deep learning method for object saliency detection using convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify the input images based on the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2016-02-02 Hengyue Pan , Hui Jiang

We introduce a saliency-based distortion layer for convolutional neural networks that helps to improve the spatial sampling of input data for a given task. Our differentiable layer can be added as a preprocessing block to existing task…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Adrià Recasens , Petr Kellnhofer , Simon Stent , Wojciech Matusik , Antonio Torralba

Visual saliency detection tries to mimic human vision psychology which concentrates on sparse, important areas in natural image. Saliency prediction research has been traditionally based on low level features such as contrast, edge, etc.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-05 Avisek Lahiri , Sourya Roy , Anirban Santara , Pabitra Mitra , Prabir Kumar Biswas

Recently, data-driven deep saliency models have achieved high performance and have outperformed classical saliency models, as demonstrated by results on datasets such as the MIT300 and SALICON. Yet, there remains a large gap between the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Sen He , Hamed R. Tavakoli , Ali Borji , Yang Mi , Nicolas Pugeault

Deep saliency prediction algorithms complement the object recognition features, they typically rely on additional information, such as scene context, semantic relationships, gaze direction, and object dissimilarity. However, none of these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Bahar Aydemir , Ludo Hoffstetter , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

Saliency prediction models are constrained by the limited diversity and quantity of labeled data. Standard data augmentation techniques such as rotating and cropping alter scene composition, affecting saliency. We propose a novel data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Bahar Aydemir , Deblina Bhattacharjee , Tong Zhang , Mathieu Salzmann , Sabine Süsstrunk

In this paper we propose a novel method for detecting adversarial examples by training a binary classifier with both origin data and saliency data. In the case of image classification model, saliency simply explain how the model make…

Machine Learning · Computer Science 2018-03-26 Chiliang Zhang , Zhimou Yang , Zuochang Ye

Understanding and predicting the human visual attentional mechanism is an active area of research in the fields of neuroscience and computer vision. In this work, we propose DeepFix, a first-of-its-kind fully convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2015-10-13 Srinivas S. S. Kruthiventi , Kumar Ayush , R. Venkatesh Babu

Existing state-of-the-art saliency detection methods heavily rely on CNN-based architectures. Alternatively, we rethink this task from a convolution-free sequence-to-sequence perspective and predict saliency by modeling long-range…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Nian Liu , Ni Zhang , Kaiyuan Wan , Ling Shao , Junwei Han

The prediction of salient areas in images has been traditionally addressed with hand-crafted features based on neuroscience principles. This paper, however, addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2016-03-03 Junting Pan , Kevin McGuinness , Elisa Sayrol , Noel O'Connor , Xavier Giro-i-Nieto

Most of the saliency methods are evaluated on their ability to generate saliency maps, and not on their functionality in a complete vision pipeline, like for instance, image classification. In the current paper, we propose an approach which…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Carola Figueroa-Flores , Bogdan Raducanu , David Berga , Joost van de Weijer

We propose a framework inspired by biological vision systems to produce saliency maps of digital images. Well-known computational models for receptive fields of areas in the visual cortex that are specialized for color and orientation…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Reza Hojjaty Saeedy , Richard A. Messner

In this paper we propose a Kalman filter aided saliency detection model which is based on the conjecture that salient regions are considerably different from our "visual expectation" or they are "visually surprising" in nature. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-04-19 Sourya Roy , Pabitra Mitra

We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of {\it non-saliency}. Third, we simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Jian Li , Martin Levine , Xiangjing An , Xin Xu , Hangen He

In the area of human fixation prediction, dozens of computational saliency models are proposed to reveal certain saliency characteristics under different assumptions and definitions. As a result, saliency model benchmarking often requires…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Changqun Xia , Jia Li , Jinming Su , Ali Borji

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister