English
Related papers

Related papers: Noise-Aware Video Saliency Prediction

200 papers

Event-based sensors offer significant advantages over traditional frame-based cameras, especially in scenarios involving rapid motion or challenging lighting conditions. However, event data frequently suffers from considerable noise,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Marcin Kowalczyk , Kamil Jeziorek , Tomasz Kryjak

During multi-party interactions, gaze direction is a key indicator of interest and intent, making it essential for social robots to direct their attention appropriately. Understanding the social context is crucial for robots to engage…

Robotics · Computer Science 2026-02-12 Ramtin Tabatabaei , Alireza Taheri

Identifying the regions of a learning resource that a learner pays attention to is crucial for assessing the material's impact and improving its design and related support systems. Saliency detection in videos addresses the automatic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Evelyn Navarrete , Ralph Ewerth , Anett Hoppe

Traditional eye tracking requires specialized hardware, which means collecting gaze data from many observers is expensive, tedious and slow. Therefore, existing saliency prediction datasets are order-of-magnitudes smaller than typical…

Computer Vision and Pattern Recognition · Computer Science 2015-05-21 Pingmei Xu , Krista A Ehinger , Yinda Zhang , Adam Finkelstein , Sanjeev R. Kulkarni , Jianxiong Xiao

This work adapts a deep neural model for image saliency prediction to the temporal domain of egocentric video. We compute the saliency map for each video frame, firstly with an off-the-shelf model trained from static images, secondly by…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Panagiotis Linardos , Eva Mohedano , Monica Cherto , Cathal Gurrin , Xavier Giro-i-Nieto

Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixels, such an adaptive inference paradigm reduces the spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yizeng Han , Zhihang Yuan , Yifan Pu , Chenhao Xue , Shiji Song , Guangyu Sun , Gao Huang

Benefiting from deep learning research and large-scale datasets, saliency prediction has achieved significant success in the past decade. However, it still remains challenging to predict saliency maps on images in new domains that lack…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

An important problem in multiview representation learning is finding the optimal combination of views with respect to the specific task at hand. To this end, we introduce NAM: a Neural Attentive Multiview machine that learns multiview item…

Machine Learning · Computer Science 2020-02-19 Oren Barkan , Ori Katz , Noam Koenigstein

With the growing availability of databases for face presentation attack detection, researchers are increasingly focusing on video-based face anti-spoofing methods that involve hundreds to thousands of images for training the models.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Usman Muhammad , Mourad Oussalah , Jorma Laaksonen

Recently, there has been a growing interest in developing saliency methods that provide visual explanations of network predictions. Still, the usability of existing methods is limited to image classification models. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Lukas Hoyer , Mauricio Munoz , Prateek Katiyar , Anna Khoreva , Volker Fischer

A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shafin Rahman , Sejuti Rahman , Omar Shahid , Md. Tahmeed Abdullah , Jubair Ahmed Sourov

We address the issue of visual saliency from three perspectives. First, we consider saliency detection as a frequency domain analysis problem. Second, we achieve this by employing the concept of {\it non-saliency}. Third, we simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-09 Jian Li , Martin Levine , Xiangjing An , Xin Xu , Hangen He

Convolutional neural networks (CNNs) are commonly used for image classification. Saliency methods are examples of approaches that can be used to interpret CNNs post hoc, identifying the most relevant pixels for a prediction following the…

Machine Learning · Computer Science 2020-10-01 Nicholas Halliwell , Freddy Lecue

The active search for objects of interest in an unknown environment has many robotics applications including search and rescue, detecting gas leaks or locating animal poachers. Existing algorithms often prioritize the location accuracy of…

Robotics · Computer Science 2021-03-23 Ramina Ghods , William J. Durkin , Jeff Schneider

Quantization has become a predominant approach for model compression, enabling deployment of large models trained on GPUs onto smaller form-factor devices for inference. Quantization-aware training (QAT) optimizes model parameters with…

Machine Learning · Computer Science 2022-12-13 Zheng Wang , Juncheng B Li , Shuhui Qu , Florian Metze , Emma Strubell

Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Sina Mohammadi , Mehrdad Noori , Ali Bahri , Sina Ghofrani Majelan , Mohammad Havaei

Video Anomaly Detection (VAD) finds widespread applications in security surveillance, traffic monitoring, industrial monitoring, and healthcare. Despite extensive research efforts, there remains a lack of concise reviews that provide…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Liyun Zhu , Lei Wang , Arjun Raj , Tom Gedeon , Chen Chen

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Understanding the simultaneously very diverse and intricately fine-grained set of possible human actions is a critical open problem in computer vision. Manually labeling training videos is feasible for some action classes but doesn't scale…

Computer Vision and Pattern Recognition · Computer Science 2017-06-12 Serena Yeung , Vignesh Ramanathan , Olga Russakovsky , Liyue Shen , Greg Mori , Li Fei-Fei