English
Related papers

Related papers: Temporal Action Localization using Long Short-Term…

200 papers

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

We address the problem of temporal action localization in videos. We pose action localization as a structured prediction over arbitrary-length temporal windows, where each window is scored as the sum of frame-wise classification scores.…

Computer Vision and Pattern Recognition · Computer Science 2017-04-18 Zehuan Yuan , Jonathan C. Stroud , Tong Lu , Jia Deng

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

This technical report analyzes a temporal action localization method we used in the HACS competition which is hosted in Activitynet Challenge 2020.The goal of our task is to locate the start time and end time of the action in the untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhiwu Qing , Xiang Wang , Yongpeng Sang , Changxin Gao , Shiwei Zhang , Nong Sang

This technical report presents an overview of our solution used in the submission to ActivityNet Challenge 2020 Task 1 (\textbf{temporal action localization/detection}). Temporal action localization requires to not only precisely locate the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Haisheng Su , Jinyuan Feng , Hao Shao , Zhenyu Jiang , Manyuan Zhang , Wei Wu , Yu Liu , Hongsheng Li , Junjie Yan

Temporal action localization is a challenging computer vision problem with numerous real-world applications. Most existing methods require laborious frame-level supervision to train action localization models. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Sanath Narayan , Hisham Cholakkal , Fahad Shahbaz Khan , Ling Shao

Temporal action proposals are a common module in action detection pipelines today. Most current methods for training action proposal modules rely on fully supervised approaches that require large amounts of annotated temporal action…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jingwei Ji , Kaidi Cao , Juan Carlos Niebles

Accurate temporal action proposals play an important role in detecting actions from untrimmed videos. The existing approaches have difficulties in capturing global contextual information and simultaneously localizing actions with different…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Jialin Gao , Zhixiang Shi , Jiani Li , Guanshuo Wang , Yufeng Yuan , Shiming Ge , Xi Zhou

In this paper, we address the challenging problem of spatial and temporal action detection in videos. We first develop an effective approach to localize frame-level action regions through integrating static and kinematic information by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yuancheng Ye , Xiaodong Yang , Yingli Tian

This paper proposes a novel multi-modal transformer network for detecting actions in untrimmed videos. To enrich the action features, our transformer network utilizes a new multi-modal attention mechanism that computes the correlations…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Matthew Korban , Scott T. Acton , Peter Youngs

In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framework is composed of three stages. In stage 1, appearance and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

We address the problem of fine-grained action localization from temporally untrimmed web videos. We assume that only weak video-level annotations are available for training. The goal is to use these weak labels to identify temporal segments…

Computer Vision and Pattern Recognition · Computer Science 2015-08-05 Chen Sun , Sanketh Shetty , Rahul Sukthankar , Ram Nevatia

Temporal action localization has long been researched in computer vision. Existing state-of-the-art action localization methods divide each video into multiple action units (i.e., proposals in two-stage methods and segments in one-stage…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Runhao Zeng , Wenbing Huang , Mingkui Tan , Yu Rong , Peilin Zhao , Junzhou Huang , Chuang Gan

Weakly supervised temporal action localization aims to detect and localize actions in untrimmed videos with only video-level labels during training. However, without frame-level annotations, it is challenging to achieve localization…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Wang Luo , Tianzhu Zhang , Wenfei Yang , Jingen Liu , Tao Mei , Feng Wu , Yongdong Zhang

We describe a latent approach that learns to detect actions in long sequences given training videos with only whole-video class labels. Our approach makes use of two innovations to attention-modeling in weakly-supervised learning. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Phuc Xuan Nguyen , Deva Ramanan , Charless C. Fowlkes

Understanding human behavior and activity facilitates advancement of numerous real-world applications, and is critical for video analysis. Despite the progress of action recognition algorithms in trimmed videos, the majority of real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Elahe Vahdani , Yingli Tian

Temporally localizing actions in a video is a fundamental challenge in video understanding. Most existing approaches have often drawn inspiration from image object detection and extended the advances, e.g., SSD and Faster R-CNN, to produce…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuchen Long , Ting Yao , Zhaofan Qiu , Xinmei Tian , Jiebo Luo , Tao Mei

Temporal action recognition always depends on temporal action proposal generation to hypothesize actions and algorithms usually need to process very long video sequences and output the starting and ending times of each potential action in…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tian Wang , Shiye Lei , Youyou Jiang , Choi Chang , Hichem Snoussi , Guangcun Shan

The ability to identify and temporally segment fine-grained human actions throughout a video is crucial for robotics, surveillance, education, and beyond. Typical approaches decouple this problem by first extracting local spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Colin Lea , Michael D. Flynn , Rene Vidal , Austin Reiter , Gregory D. Hager

Temporal action localization is an important yet challenging task in video understanding. Typically, such a task aims at inferring both the action category and localization of the start and end frame for each action instance in a long,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Chuming Lin , Chengming Xu , Donghao Luo , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Yanwei Fu