English
Related papers

Related papers: Describing Videos by Exploiting Temporal Structure

200 papers

In this paper we describe a video surveillance system able to detect traffic events in videos acquired by fixed videocameras on highways. The events of interest consist in a specific sequence of situations that occur in the video, as for…

Computer Vision and Pattern Recognition · Computer Science 2019-09-27 Matteo Tiezzi , Stefano Melacci , Marco Maggini , Angelo Frosini

In this paper, we propose a new architecture for real-time anomaly detection in video data, inspired by human behavior combining spatial and temporal analyses. This approach uses two distinct models: (i) for temporal analysis, a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Fabien Poirier

Video description is the automatic generation of natural language sentences that describe the contents of a given video. It has applications in human-robot interaction, helping the visually impaired and video subtitling. The past few years…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Nayyer Aafaq , Ajmal Mian , Wei Liu , Syed Zulqarnain Gilani , Mubarak Shah

Generating natural language descriptions for images is a challenging task. The traditional way is to use the convolutional neural network (CNN) to extract image features, followed by recurrent neural network (RNN) to generate sentences. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Shijian Tang , Song Han

We present a general approach to video understanding, inspired by semantic transfer techniques that have been successfully used for 2D image analysis. Our method considers a video to be a 1D sequence of clips, each one associated with its…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Dotan Kaufman , Gil Levi , Tal Hassner , Lior Wolf

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Deep learning approaches have been established as the main methodology for video classification and recognition. Recently, 3-dimensional convolutions have been used to achieve state-of-the-art performance in many challenging video datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Alexandros Stergiou , Georgios Kapidis , Grigorios Kalliatakis , Christos Chrysoulas , Remco Veltkamp , Ronald Poppe

Thispaperaimstoresearchandimplementa real-timevideotargettrackingalgorithmbasedon ConvolutionalNeuralNetworks(CNN),enhancingthe accuracyandrobustnessoftargettrackingincomplex scenarios.Addressingthelimitationsoftraditionaltracking…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Chaoyi Tan , Xiangtian Li , Xiaobo Wang , Zhen Qi , Ao Xiang

It is difficult for people to interpret the decision-making in the inference process of deep neural networks. Visual explanation is one method for interpreting the decision-making of deep learning. It analyzes the decision-making of 2D CNNs…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Masahiro Mitsuhara , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

In this paper, we newly introduce the concept of temporal attention filters, and describe how they can be used for human activity recognition from videos. Many high-level activities are often composed of multiple temporal parts (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2016-12-28 AJ Piergiovanni , Chenyou Fan , Michael S. Ryoo

Dynamic graphs are common in real-world systems such as social media, recommender systems, and traffic networks. Existing dynamic graph models for link prediction often fall short in capturing the complexity of temporal evolution. They tend…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Hua Liu , Yanbin Wei , Fei Xing , Tyler Derr , Haoyu Han , Yu Zhang

Video classification problem has been studied many years. The success of Convolutional Neural Networks (CNN) in image recognition tasks gives a powerful incentive for researchers to create more advanced video classification approaches. As…

Computer Vision and Pattern Recognition · Computer Science 2017-06-15 Manuk Akopyan , Eshsou Khashba

We consider two less-emphasized temporal properties of video: 1. Temporal cues are fine-grained; 2. Temporal modeling needs reasoning. To tackle both problems at once, we exploit approximated bilinear modules (ABMs) for temporal modeling.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Xinqi Zhu , Chang Xu , Langwen Hui , Cewu Lu , Dacheng Tao

This paper addresses temporal sentence grounding. Previous works typically solve this task by learning frame-level video features and align them with the textual information. A major limitation of these works is that they fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Daizong Liu , Xiaoye Qu , Pan Zhou , Yang Liu

Reading text in the wild is a challenging task in the field of computer vision. Existing approaches mainly adopted Connectionist Temporal Classification (CTC) or Attention models based on Recurrent Neural Network (RNN), which is…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yunze Gao , Yingying Chen , Jinqiao Wang , Hanqing Lu

Video summarization technologies aim to create a concise and complete synopsis by selecting the most informative parts of the video content. Several approaches have been developed over the last couple of decades and the current state of the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Evlampios Apostolidis , Eleni Adamantidou , Alexandros I. Metsai , Vasileios Mezaris , Ioannis Patras

In recent years, advances in Artificial Intelligence have significantly impacted computer science, particularly in the field of computer vision, enabling solutions to complex problems such as video frame prediction. Video frame prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jose M. Sánchez Velázquez , Mingbo Cai , Andrew Coney , Álvaro J. García- Tejedor , Alberto Nogales

We propose a self-supervised visual learning method by predicting the variable playback speeds of a video. Without semantic labels, we learn the spatio-temporal visual representation of the video by leveraging the variations in the visual…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Hyeon Cho , Taehoon Kim , Hyung Jin Chang , Wonjun Hwang

Various convolutional neural networks (CNNs) were developed recently that achieved accuracy comparable with that of human beings in computer vision tasks such as image recognition, object detection and tracking, etc. Most of these networks,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Tianchen Wang , Jinjun Xiong , Xiaowei Xu , Yiyu Shi

An important aspect of video understanding is the ability to predict the evolution of its content in the future. This paper presents a future frame semantic segmentation technique for predicting semantic masks of the current and future…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Talha Siddiqui , Samarth Bharadwaj