English
Related papers

Related papers: Two-Stream temporal transformer for video action c…

200 papers

Abnormal driving behaviour is one of the leading cause of terrible traffic accidents endangering human life. Therefore, study on driving behaviour surveillance has become essential to traffic security and public management. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yaocong Hu , MingQi Lu , Xiaobo Lu

Recognizing actions from a limited set of labeled videos remains a challenge as annotating visual data is not only tedious but also can be expensive due to classified nature. Moreover, handling spatio-temporal data using deep $3$D…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Owais Iqbal , Omprakash Chakraborty , Aftab Hussain , Rameswar Panda , Abir Das

The task of action recognition or action detection involves analyzing videos and determining what action or motion is being performed. The primary subject of these videos are predominantly humans performing some action. However, this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Amlaan Bhoi

Motion representation plays a vital role in human action recognition in videos. In this study, we introduce a novel compact motion representation for video action recognition, named Optical Flow guided Feature (OFF), which enables the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Shuyang Sun , Zhanghui Kuang , Wanli Ouyang , Lu Sheng , Wei Zhang

In action recognition, although the combination of spatio-temporal videos and skeleton features can improve the recognition performance, a separate model and balancing feature representation for cross-modal data are required. To solve these…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Dasom Ahn , Sangwon Kim , Hyunsu Hong , Byoung Chul Ko

To generate proper captions for videos, the inference needs to identify relevant concepts and pay attention to the spatial relationships between them as well as to the temporal development in the clip. Our end-to-end encoder-decoder video…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Zohreh Ghaderi , Leonard Salewski , Hendrik P. A. Lensch

We study the video super-resolution (SR) problem for facilitating video analytics tasks, e.g. action recognition, instead of for visual quality. The popular action recognition methods based on convolutional networks, exemplified by…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Haochen Zhang , Dong Liu , Zhiwei Xiong

Moments capture a huge part of our lives. Accurate recognition of these moments is challenging due to the diverse and complex interpretation of the moments. Action recognition refers to the act of classifying the desired action/activity…

Computer Vision and Pattern Recognition · Computer Science 2018-09-14 Ankit Shah , Harini Kesavamoorthy , Poorva Rane , Pramati Kalwad , Alexander Hauptmann , Florian Metze

The strong demand of autonomous driving in the industry has lead to strong interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Zhenxun Yuan , Xiao Song , Lei Bai , Wengang Zhou , Zhe Wang , Wanli Ouyang

In recent years, a number of approaches based on 2D or 3D convolutional neural networks (CNN) have emerged for video action recognition, achieving state-of-the-art results on several large-scale benchmark datasets. In this paper, we carry…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chun-Fu Chen , Rameswar Panda , Kandan Ramakrishnan , Rogerio Feris , John Cohn , Aude Oliva , Quanfu Fan

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava

Online temporal action localization from an untrimmed video stream is a challenging problem in computer vision. It is challenging because of i) in an untrimmed video stream, more than one action instance may appear, including background…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Da-Hye Yoon , Nam-Gyu Cho , Seong-Whan Lee

Recently, video transformers have shown great success in video understanding, exceeding CNN performance; yet existing video transformer models do not explicitly model objects, although objects can be essential for recognizing actions. In…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Roei Herzig , Elad Ben-Avraham , Karttikeya Mangalam , Amir Bar , Gal Chechik , Anna Rohrbach , Trevor Darrell , Amir Globerson

With the rapid advancements in deep learning, computer vision tasks have seen significant improvements, making two-stream neural networks a popular focus for video based action recognition. Traditional models using RGB and optical flow…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Song-Jiang Lai , Tsun-Hin Cheung , Ka-Chun Fung , Tian-Shan Liu , Kin-Man Lam

This paper focuses on task recognition and action segmentation in weakly-labeled instructional videos, where only the ordered sequence of video-level actions is available during training. We propose a two-stream framework, which exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Reza Ghoddoosian , Saif Sayed , Vassilis Athitsos

We propose TubeR: a simple solution for spatio-temporal video action detection. Different from existing methods that depend on either an off-line actor detector or hand-designed actor-positional hypotheses like proposals or anchors, we…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiaojiao Zhao , Yanyi Zhang , Xinyu Li , Hao Chen , Shuai Bing , Mingze Xu , Chunhui Liu , Kaustav Kundu , Yuanjun Xiong , Davide Modolo , Ivan Marsic , Cees G. M. Snoek , Joseph Tighe

Computational saliency models for still images have gained significant popularity in recent years. Saliency prediction from videos, on the other hand, has received relatively little interest from the community. Motivated by this, in this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Cagdas Bak , Aysun Kocak , Erkut Erdem , Aykut Erdem

Even with the recent advances in convolutional neural networks (CNN) in various visual recognition tasks, the state-of-the-art action recognition system still relies on hand crafted motion feature such as optical flow to achieve the best…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Joe Yue-Hei Ng , Jonghyun Choi , Jan Neumann , Larry S. Davis

We consider the problem of video-based person re-identification. The goal is to identify a person from videos captured under different cameras. In this paper, we propose an efficient spatial-temporal attention based model for person…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Shivansh Rao , Tanzila Rahman , Mrigank Rochan , Yang Wang

This paper presents a method for automatic video object segmentation based on the fusion of motion stream, appearance stream, and instance-aware segmentation. The proposed scheme consists of a two-stream fusion network and an instance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Sungkwon Choo , Wonkyo Seo , Nam Ik Cho