English
Related papers

Related papers: How close are we to understanding image-based sali…

200 papers

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein

Photo collections and its applications today attempt to reflect user interactions in various forms. Moreover, photo collections aim to capture the users' intention with minimum effort through applications capturing user intentions. Human…

Computer Vision and Pattern Recognition · Computer Science 2016-01-13 Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Recent advances in the field of saliency have concentrated on fixation prediction, with benchmarks reaching saturation. However, there is an extensive body of works in psychology and neuroscience that describe aspects of human visual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Iuliia Kotseruba , Calden Wloka , Amir Rasouli , John K. Tsotsos

Eye movements are crucial in understanding complex scenes. By predicting where humans look in natural scenes, we can understand how they percieve scenes and priotriaze information for further high-level processing. Here, we study the effect…

Computer Vision and Pattern Recognition · Computer Science 2015-05-15 Ali Borji , Mengyang Feng , Huchuan Lu

The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection methods mostly treat…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Joshua Krinsky , Alan Bettis , Qiuyu Tang , Daniel Moreira , Aparna Bharati

Dozens of new models on fixation prediction are published every year and compared on open benchmarks such as MIT300 and LSUN. However, progress in the field can be difficult to judge because models are compared using a variety of…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Matthias Kümmerer , Thomas S. A. Wallis , Matthias Bethge

Selective attention is an essential mechanism to filter sensory input and to select only its most important components, allowing the capacity-limited cognitive structures of the brain to process them in detail. The saliency map model,…

Image and Video Processing · Electrical Eng. & Systems 2024-01-11 Camille Simon Chane , Ernst Niebur , Ryad Benosman , Sio-Hoi Ieng

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of {\it non-saliency}. Third, we simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Jian Li , Martin Levine , Xiangjing An , Xin Xu , Hangen He

Substantial research has been done in saliency modeling to develop intelligent machines that can perceive and interpret their surroundings. But existing models treat videos as merely image sequences excluding any audio information, unable…

Image and Video Processing · Electrical Eng. & Systems 2023-02-27 Maryam Qamar Butt , Anis Ur Rahman

In this paper, we model the salient object detection problem under a probabilistic framework encoding the boundary connectivity saliency cue and smoothness constraints in an optimization problem. We show that this problem has a closed form…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Caglar Aytekin , Alexandros Iosifidis , Moncef Gabbouj

Decision processes of computer vision models - especially deep neural networks - are opaque in nature, meaning that these decisions cannot be understood by humans. Thus, over the last years, many methods to provide human-understandable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Benjamin Fresz , Lena Lörcher , Marco Huber

A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shafin Rahman , Sejuti Rahman , Omar Shahid , Md. Tahmeed Abdullah , Jubair Ahmed Sourov

The performance of convolutional neural networks has continued to improve over the last decade. At the same time, as model complexity grows, it becomes increasingly more difficult to explain model decisions. Such explanations may be of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Colton Crum , Patrick Tinsley , Aidan Boyd , Jacob Piland , Christopher Sweet , Timothy Kelley , Kevin Bowyer , Adam Czajka

Of later years, numerous bottom-up attention models have been proposed on different assumptions. However, the produced saliency maps may be different from each other even from the same input image. We also observe that human fixation map…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Jian Li

In this paper we address the problem of unsupervised localization of objects in single images. Compared to previous state-of-the-art method our method is fully unsupervised in the sense that there is no prior instance level or category…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Hakan Karaoguz , Patric Jensfelt

Here we present DeepGaze II, a model that predicts where people look in images. The model uses the features from the VGG-19 deep neural network trained to identify objects in images. Contrary to other saliency models that use deep features,…

Computer Vision and Pattern Recognition · Computer Science 2016-10-06 Matthias Kümmerer , Thomas S. A. Wallis , Matthias Bethge

Data-driven saliency detection has attracted strong interest as a result of applying convolutional neural networks to the detection of eye fixations. Although a number of imagebased salient object and fixation detection models have been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Meijun Sun , Ziqi Zhou , QinGhua Hu , Zheng Wang , Jianmin Jiang

Salient object detection or salient region detection models, diverging from fixation prediction models, have traditionally been dealing with locating and segmenting the most salient object or region in a scene. While the notion of most…

Computer Vision and Pattern Recognition · Computer Science 2015-06-23 Ali Borji

Clinical applicability of automated decision support systems depends on a robust, well-understood classification interpretation. Artificial neural networks while achieving class-leading scores fall short in this regard. Therefore, numerous…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 David Major , Dimitrios Lenis , Maria Wimmer , Gert Sluiter , Astrid Berg , Katja Bühler