English
Related papers

Related papers: Saliency Tubes: Visual Explanations for Spatio-Tem…

200 papers

This paper investigates the role of saliency to improve the classification accuracy of a Convolutional Neural Network (CNN) for the case when scarce training data is available. Our approach consists in adding a saliency branch to an…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Carola Figueroa Flores , Abel Gonzalez-García , Joost van de Weijer , Bogdan Raducanu

In videos, the human's actions are of three-dimensional (3D) signals. These videos investigate the spatiotemporal knowledge of human behavior. The promising ability is investigated using 3D convolution neural networks (CNNs). The 3D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Arslan Syed , Eman A. Aldhahri , Muhammad Munawar Iqbal , Abid Ali , Ammar Muthanna , Harun Jamil , Faisal Jamil

The performance of video saliency estimation techniques has achieved significant advances along with the rapid development of Convolutional Neural Networks (CNNs). However, devices like cameras and drones may have limited computational…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Jia Li , Kui Fu , Shengwei Zhao , Shiming Ge

We propose a simple, yet effective approach for spatiotemporal feature learning using deep 3-dimensional convolutional networks (3D ConvNets) trained on a large scale supervised video dataset. Our findings are three-fold: 1) 3D ConvNets are…

Computer Vision and Pattern Recognition · Computer Science 2015-10-08 Du Tran , Lubomir Bourdev , Rob Fergus , Lorenzo Torresani , Manohar Paluri

Convolutional neural networks (CNNs) define the current state-of-the-art for image recognition. With their emerging popularity, especially for critical applications like medical image analysis or self-driving cars, confirmability is…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Keyang Zhou , Bernhard Kainz

Object detection in video is crucial for many applications. Compared to images, video provides additional cues which can help to disambiguate the detection problem. Our goal in this paper is to learn discriminative models for the temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Tuan-Hung Vu , Anton Osokin , Ivan Laptev

Facial expressions are one of the most powerful ways for depicting specific patterns in human behavior and describing human emotional state. Despite the impressive advances of affective computing over the last decade, automatic video-based…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Thomas Teixeira , Eric Granger , Alessandro Lameiras Koerich

Deep convolutional neural networks have achieved impressive performance on a broad range of problems, beating prior art on established benchmarks, but it often remains unclear what are the representations learnt by those systems and how…

Computer Vision and Pattern Recognition · Computer Science 2018-03-23 Sen He , Nicolas Pugeault

Developing a technique for the automatic analysis of surveillance videos in order to identify the presence of violence is of broad interest. In this work, we propose a deep neural network for the purpose of recognizing violent videos. A…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Swathikiran Sudhakaran , Oswald Lanz

TASED-Net is a 3D fully-convolutional network architecture for video saliency detection. It consists of two building blocks: first, the encoder network extracts low-resolution spatiotemporal features from an input clip of several…

Computer Vision and Pattern Recognition · Computer Science 2019-08-19 Kyle Min , Jason J. Corso

It's no secret that video has become the primary way we share information online. That's why there's been a surge in demand for algorithms that can analyze and understand video content. It's a trend going to continue as video continues to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Amir Hosein Fadaei , Mohammad-Reza A. Dehaqani

Identifying the regions of a learning resource that a learner pays attention to is crucial for assessing the material's impact and improving its design and related support systems. Saliency detection in videos addresses the automatic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Evelyn Navarrete , Ralph Ewerth , Anett Hoppe

In this paper we discuss several forms of spatiotemporal convolutions for video analysis and study their effects on action recognition. Our motivation stems from the observation that 2D CNNs applied to individual frames of the video have…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Du Tran , Heng Wang , Lorenzo Torresani , Jamie Ray , Yann LeCun , Manohar Paluri

Since the wide employment of deep learning frameworks in video salient object detection, the accuracy of the recent approaches has made stunning progress. These approaches mainly adopt the sequential modules, based on optical flow or…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yi Tang , Yuanman Li , Wenbin Zou

In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framework is composed of three stages. In stage 1, appearance and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

For more than a decade, deep learning models have been dominating in various 2D imaging tasks. Their application is now extending to 3D imaging, with 3D Convolutional Neural Networks (3D CNNs) being able to process LIDAR, MRI, and CT scans,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Mariusz Wiśniewski , Loris Giulivi , Giacomo Boracchi

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen

The Transformer architecture has gained significant popularity in computer vision tasks due to its capacity to generalize and capture long-range dependencies. This characteristic makes it well-suited for generating spatiotemporal tokens…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Rachid Reda Dokkar , Faten Chaieb , Hassen Drira , Arezki Aberkane

We address the problem of action detection in videos. Driven by the latest progress in object detection from 2D images, we build action models using rich feature hierarchies derived from shape and kinematic cues. We incorporate appearance…

Computer Vision and Pattern Recognition · Computer Science 2014-11-25 Georgia Gkioxari , Jitendra Malik

Multi-level features are important for saliency detection. Better combination and use of multi-level features with time information can greatly improve the accuracy of the video saliency model. In order to fully combine multi-level features…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Qinyao Chang , Shiping Zhu