English
Related papers

Related papers: Single Shot Temporal Action Detection

200 papers

Weakly supervised temporal action detection is a Herculean task in understanding untrimmed videos, since no supervisory signal except the video-level category label is available on training data. Under the supervision of category labels,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Tao Zhang , Thomas H. Li , Ge Li

Temporal action detection in long videos is an important problem. State-of-the-art methods address this problem by applying action classifiers on sliding windows. Although sliding windows may contain an identifiable portion of the actions,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-04 Jiyang Gao , Zhenheng Yang , Ram Nevatia

This technical report analyzes a temporal action localization method we used in the HACS competition which is hosted in Activitynet Challenge 2020.The goal of our task is to locate the start time and end time of the action in the untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhiwu Qing , Xiang Wang , Yongpeng Sang , Changxin Gao , Shiwei Zhang , Nong Sang

Many activities of interest are rare events, with only a few labeled examples available. Therefore models for temporal activity detection which are able to learn from a few examples are desirable. In this paper, we present a conceptually…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Huijuan Xu , Bingyi Kang , Ximeng Sun , Jiashi Feng , Kate Saenko , Trevor Darrell

We introduce Activity Graph Transformer, an end-to-end learnable model for temporal action localization, that receives a video as input and directly predicts a set of action instances that appear in the video. Detecting and localizing…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Megha Nawhal , Greg Mori

Temporal action segmentation (TAS) is a critical step toward long-term video understanding. Recent studies follow a pattern that builds models based on features instead of raw video picture information. However, we claim those models are…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Wujun Wen , Yunheng Li , Zhuben Dong , Lin Feng , Wanxiao Yang , Shenlan Liu

In this paper, we study an intermediate form of supervision, i.e., single-frame supervision, for temporal action localization (TAL). To obtain the single-frame supervision, the annotators are asked to identify only a single frame within the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Fan Ma , Linchao Zhu , Yi Yang , Shengxin Zha , Gourab Kundu , Matt Feiszli , Zheng Shou

The task of action detection aims at deducing both the action category and localization of the start and end moment for each action instance in a long, untrimmed video. While vision Transformers have driven the recent advances in video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yuetian Weng , Zizheng Pan , Mingfei Han , Xiaojun Chang , Bohan Zhuang

Weakly supervised temporal action localization aims to localize temporal boundaries of actions and simultaneously identify their categories with only video-level category labels. Many existing methods seek to generate pseudo labels for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linjiang Huang , Liang Wang , Hongsheng Li

Temporal action recognition always depends on temporal action proposal generation to hypothesize actions and algorithms usually need to process very long video sequences and output the starting and ending times of each potential action in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tian Wang , Shiye Lei , Youyou Jiang , Choi Chang , Hichem Snoussi , Guangcun Shan

Temporal action localization in untrimmed videos is an important but difficult task. Difficulties are encountered in the application of existing methods when modeling temporal structures of videos. In the present study, we developed a novel…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Yuan Zhou , Hongru Li , Sun-Yuan Kung

Temporal action localization aims at localizing action instances from untrimmed videos. Existing works have designed various effective modules to precisely localize action instances based on appearance and motion features. However, by…

Computer Vision and Pattern Recognition · Computer Science 2022-05-30 Le Yang , Junwei Han , Tao Zhao , Nian Liu , Dingwen Zhang

Temporal action localization is an important yet challenging problem. Given a long, untrimmed video consisting of multiple action instances and complex background contents, we need not only to recognize their action categories, but also to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Zheng Shou , Jonathan Chan , Alireza Zareian , Kazuyuki Miyazawa , Shih-Fu Chang

Previous methods based on 3DCNN, convLSTM, or optical flow have achieved great success in video salient object detection (VSOD). However, they still suffer from high computational costs or poor quality of the generated saliency maps. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xing Zhao , Haoran Liang , Peipei Li , Guodao Sun , Dongdong Zhao , Ronghua Liang , Xiaofei He

Temporal Action Detection (TAD) aims to identify the action boundaries and the corresponding category within untrimmed videos. Inspired by the success of DETR in object detection, several methods have adapted the query-based framework to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yuhan Zhu , Guozhen Zhang , Jing Tan , Gangshan Wu , Limin Wang

We propose StartNet to address Online Detection of Action Start (ODAS) where action starts and their associated categories are detected in untrimmed, streaming videos. Previous methods aim to localize action starts by learning feature…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Mingfei Gao , Mingze Xu , Larry S. Davis , Richard Socher , Caiming Xiong

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

We propose a weakly supervised temporal action localization algorithm on untrimmed videos using convolutional neural networks. Our algorithm learns from video-level class labels and predicts temporal intervals of human actions with no…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Phuc Nguyen , Ting Liu , Gautam Prasad , Bohyung Han

With the development of video understanding, there is a proliferation of tasks for clip-level temporal video analysis, including temporal action detection (TAD), temporal action segmentation (TAS), and generic event boundary detection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Min Yang , Zichen Zhang , Limin Wang

This paper takes initial strides at designing and evaluating a vision-based system for privacy ensured activity monitoring. The proposed technology utilizing Artificial Intelligence (AI)-empowered proactive systems offering continuous…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Anbumalar Saravanan , Justin Sanchez , Hassan Ghasemzadeh , Aurelia Macabasco-O'Connell , Hamed Tabkhi