English
Related papers

Related papers: Video Saliency Prediction Using Enhanced Spatiotem…

200 papers

Video Salient Document Detection (VSDD) is an essential task of practical computer vision, which aims to highlight visually salient document regions in video frames. Previous techniques for VSDD focus on learning features without…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Hemraj Singh , Mridula Verma , Ramalingaswamy Cheruku

Different from salient object detection methods for still images, a key challenging for video saliency detection is how to extract and combine spatial and temporal features. In this paper, we present a novel and effective approach for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-13 Guanqun Ding , Yuming Fang

Self-supervised VO methods have shown great success in jointly estimating camera pose and depth from videos. However, like most data-driven methods, existing VO networks suffer from a notable decrease in performance when confronted with…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Shunkai Li , Xin Wang , Yingdian Cao , Fei Xue , Zike Yan , Hongbin Zha

Predicting salient regions in natural images requires the detection of objects that are present in a scene. To develop robust representations for this challenging task, high-level visual features at multiple spatial scales must be extracted…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Alexander Kroner , Mario Senden , Kurt Driessens , Rainer Goebel

We propose a Spatiotemporal Sampling Network (STSN) that uses deformable convolutions across time for object detection in videos. Our STSN performs object detection in a video frame by learning to spatially sample features from the adjacent…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Gedas Bertasius , Lorenzo Torresani , Jianbo Shi

Saliency computation models aim to imitate the attention mechanism in the human visual system. The application of deep neural networks for saliency prediction has led to a drastic improvement over the last few years. However, deep models…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Saman Zabihi , Hamed Rezazadegan Tavakoli , Ali Borji

This paper studies the task of matching image and sentence, where learning appropriate representations across the multi-modal data appears to be the main challenge. Unlike previous approaches that predominantly deploy symmetrical…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Zhong Ji , Haoran Wang , Jungong Han , Yanwei Pang

Omnidirectional videos (ODVs) provide an immersive visual experience by capturing the 360{\deg} scene. With the rapid advancements in virtual/augmented reality, metaverse, and generative artificial intelligence, the demand for high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Hongyu An , Xinfeng Zhang , Shijie Zhao , Li Zhang , Ruiqin Xiong

Visual saliency detection aims at identifying the most visually distinctive parts in an image, and serves as a pre-processing step for a variety of computer vision and image processing tasks. To this end, the saliency detection procedure…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Xuanyang Xi , Yongkang Luo , Fengfu Li , Peng Wang , Hong Qiao

Convolutional-deconvolution networks can be adopted to perform end-to-end saliency detection. But, they do not work well with objects of multiple scales. To overcome such a limitation, in this work, we propose a recurrent attentional…

Computer Vision and Pattern Recognition · Computer Science 2016-04-13 Jason Kuen , Zhenhua Wang , Gang Wang

Traditional saliency models usually adopt hand-crafted image features and human-designed mechanisms to calculate local or global contrast. In this paper, we propose a novel computational saliency model, i.e., deep spatial contextual…

Computer Vision and Pattern Recognition · Computer Science 2016-10-07 Nian Liu , Junwei Han

Video prediction models based on convolutional networks, recurrent networks, and their combinations often result in blurry predictions. We identify an important contributing factor for imprecise predictions that has not been studied…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Wonmin Byeon , Qin Wang , Rupesh Kumar Srivastava , Petros Koumoutsakos

Computational saliency models for still images have gained significant popularity in recent years. Saliency prediction from videos, on the other hand, has received relatively little interest from the community. Motivated by this, in this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Cagdas Bak , Aysun Kocak , Erkut Erdem , Aykut Erdem

The spherical domain representation of 360 video/image presents many challenges related to the storage, processing, transmission and rendering of omnidirectional videos (ODV). Models of human visual attention can be used so that only a…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Yasser Dahou , Marouane Tliba , Kevin McGuinness , Noel O'Connor

Incorporating the audio stream enables Video Saliency Prediction (VSP) to imitate the selective attention mechanism of human brain. By focusing on the benefits of joint auditory and visual information, most VSP methods are capable of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Junwen Xiong , Ganglai Wang , Peng Zhang , Wei Huang , Yufei Zha , Guangtao Zhai

Low-light images, characterized by inadequate illumination, pose challenges of diminished clarity, muted colors, and reduced details. Low-light image enhancement, an essential task in computer vision, aims to rectify these issues by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Hossein Shakibania , Sina Raoufi , Hassan Khotanlou

In this work, we propose a 3D fully convolutional architecture for video saliency prediction that employs hierarchical supervision on intermediate maps (referred to as conspicuity maps) generated using features extracted at different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Giovanni Bellitto , Federica Proietto Salanitri , Simone Palazzo , Francesco Rundo , Daniela Giordano , Concetto Spampinato

Saliency prediction can benefit from training that involves scene understanding that may be tangential to the central task; this may include understanding places, spatial layout, objects or involve different datasets and their bias. One can…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Sen Jia , Neil D. B. Bruce

The prediction of saliency areas in images has been traditionally addressed with hand crafted features based on neuroscience principles. This paper however addresses the problem with a completely data-driven approach by training a…

Computer Vision and Pattern Recognition · Computer Science 2015-07-07 Junting Pan , Xavier Giró-i-Nieto

The role of long- and short-term dynamics towards salient object detection in videos is under-researched. We present a Transformer-based approach to learn a joint representation of video frames and past saliency information. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Theodor Wulff , Fares Abawi , Philipp Allgeuer , Stefan Wermter