English
Related papers

Related papers: Saliency for free: Saliency prediction as a side-e…

200 papers

Since the early 2000s, computational visual saliency has been a very active research area. Each year, more and more new models are published in the main computer vision conferences. Nowadays, one of the big challenges is to find a way to…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Nicolas Riche , Matthieu Duvinage , Matei Mancas , Bernard Gosselin , Thierry Dutoit

Humans' ability to detect and locate salient objects on images is remarkably fast and successful. Performing this process by using eye tracking equipment is expensive and cannot be easily applied, and computer modeling of this human…

Computer Vision and Pattern Recognition · Computer Science 2014-03-03 Hamdi Yalin Yalic

The human visual system employs a selective attention mechanism to understand the visual world in an eficient manner. In this paper, we show how computational models of this mechanism can be exploited for the computer vision application of…

Computer Vision and Pattern Recognition · Computer Science 2013-07-23 Samuel F. Dodge , Lina J. Karam

Using only a model that was trained to predict where people look at images, and no additional training data, we can produce a range of powerful editing effects for reducing distraction in images. Given an image and a mask specifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Kfir Aberman , Junfeng He , Yossi Gandelsman , Inbar Mosseri , David E. Jacobs , Kai Kohlhoff , Yael Pritch , Michael Rubinstein

Various saliency detection algorithms from color images have been proposed to mimic eye fixation or attentive object detection response of human observers for the same scenes. However, developments on hyperspectral imaging systems enable us…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Nevrez Imamoglu , Guanqun Ding , Yuming Fang , Asako Kanezaki , Toru Kouyama , Ryosuke Nakamura

Video classification is productive in many practical applications, and the recent deep learning has greatly improved its accuracy. However, existing works often model video frames indiscriminately, but from the view of motion, video frames…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunzhen Zhao , Yuxin Peng

UNet-based methods have shown outstanding performance in salient object detection (SOD), but are problematic in two aspects. 1) Indiscriminately integrating the encoder feature, which contains spatial information for multiple objects, and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Chaewon Park , Minhyeok Lee , MyeongAh Cho , Sangyoun Lee

The prediction of Visual Attention data from any kind of media is of valuable use to content creators and used to efficiently drive encoding algorithms. With the current trend in the Virtual Reality (VR) field, adapting known techniques to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Rafael Monroy , Sebastian Lutz , Tejo Chalasani , Aljosa Smolic

Image saliency detection is crucial in understanding human gaze patterns from visual stimuli. The escalating demand for research in image saliency detection is driven by the growing necessity to incorporate such techniques into various…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Zhanxuan Mei , Yun-Cheng Wang , C. -C. Jay Kuo

In high-stakes applications of machine learning models, interpretability methods provide guarantees that models are right for the right reasons. In medical imaging, saliency maps have become the standard tool for determining whether a…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Jacob Pfau , Albert T. Young , Maria L. Wei , Michael J. Keiser

Data-driven saliency detection has attracted strong interest as a result of applying convolutional neural networks to the detection of eye fixations. Although a number of imagebased salient object and fixation detection models have been…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Meijun Sun , Ziqi Zhou , QinGhua Hu , Zheng Wang , Jianmin Jiang

Saliency maps have become one of the most widely used interpretability techniques for convolutional neural networks (CNN) due to their simplicity and the quality of the insights they provide. However, there are still some doubts about…

Artificial Intelligence · Computer Science 2023-09-25 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda

A deep feature based saliency model (DeepFeat) is developed to leverage the understanding of the prediction of human fixations. Traditional saliency models often predict the human visual attention relying on few level image cues. Although…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Ali Mahdi , Jun Qin

We tackle the problem of predicting saliency maps for videos of dynamic scenes. We note that the accuracy of the maps reconstructed from the gaze data of a fixed number of observers varies with the frame, as it depends on the content of the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ekta Prashnani , Orazio Gallo , Joohwan Kim , Josef Spjut , Pradeep Sen , Iuri Frosio

Saliency maps are often used in computer vision to provide intuitive interpretations of what input regions a model has used to produce a specific prediction. A number of approaches to saliency map generation are available, but most require…

Machine Learning · Computer Science 2020-01-31 Mamuku Mokuwe , Michael Burke , Anna Sergeevna Bosman

Deep neural networks, especially convolutional deep neural networks, are state-of-the-art methods to classify, segment or even generate images, movies, or sounds. However, these methods lack of a good semantic understanding of what happens…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Jens Bayer , David Münch , Michael Arens

Deep neural networks (DNNs) are being increasingly used to make predictions from functional magnetic resonance imaging (fMRI) data. However, they are widely seen as uninterpretable "black boxes", as it can be difficult to discover what…

Machine Learning · Computer Science 2020-12-18 Patrick McClure , Dustin Moraczewski , Ka Chun Lam , Adam Thomas , Francisco Pereira

Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated…

Robotics · Computer Science 2022-03-25 Ajith Anil Meera , Filip Novicky , Thomas Parr , Karl Friston , Pablo Lanillos , Noor Sajid

Predicting attention is a popular topic at the intersection of human and computer vision. However, even though most of the available video saliency data sets and models claim to target human observers' fixations, they fail to differentiate…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Mikhail Startsev , Michael Dorr

Conventional saliency maps highlight input features to which neural network predictions are highly sensitive. We take a different approach to saliency, in which we identify and analyze the network parameters, rather than inputs, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Roman Levin , Manli Shu , Eitan Borgnia , Furong Huang , Micah Goldblum , Tom Goldstein