English
Related papers

Related papers: Temporal Action Detection with Structured Segment …

200 papers

Temporal sentence grounding (TSG) aims to localize the temporal segment which is semantically aligned with a natural language query in an untrimmed video.Most existing methods extract frame-grained features or object-grained features by 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Zeyu Xiong , Daizong Liu , Pan Zhou , Jiahao Zhu

Nowadays, the interaction between humans and robots is constantly expanding, requiring more and more human motion recognition applications to operate in real time. However, most works on temporal action detection and recognition perform…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Vasiliki I. Vasileiou , Nikolaos Kardaris , Petros Maragos

The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measurement systems,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Benjamin Filtjens , Bart Vanrumste , Peter Slaets

Visual tempo characterizes the dynamics and the temporal scale of an action. Modeling such visual tempos of different actions facilitates their recognition. Previous works often capture the visual tempo through sampling raw videos at…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Ceyuan Yang , Yinghao Xu , Jianping Shi , Bo Dai , Bolei Zhou

Temporal Action Localization (TAL) is a critical task in video analysis, identifying precise start and end times of actions. Existing methods like CNNs, RNNs, GCNs, and Transformers have limitations in capturing long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sangyoun Lee , Juho Jung , Changdae Oh , Sunghee Yun

Action detection is an essential and challenging task, especially for densely labelled datasets of untrimmed videos. There are many real-world challenges in those datasets, such as composite action, co-occurring action, and high temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Rui Dai , Srijan Das , Francois Bremond

Temporal action proposals are a common module in action detection pipelines today. Most current methods for training action proposal modules rely on fully supervised approaches that require large amounts of annotated temporal action…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jingwei Ji , Kaidi Cao , Juan Carlos Niebles

In this paper, we address the challenging problem of spatial and temporal action detection in videos. We first develop an effective approach to localize frame-level action regions through integrating static and kinematic information by the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Yuancheng Ye , Xiaodong Yang , Yingli Tian

This paper presents a novel spatiotemporal transformer network that introduces several original components to detect actions in untrimmed videos. First, the multi-feature selective semantic attention model calculates the correlations…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Matthew Korban , Peter Youngs , Scott T. Acton

In the field of action recognition, video clips are always treated as ordered frames for subsequent processing. To achieve spatio-temporal perception, existing approaches propose to embed adjacent temporal interaction in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Rongchang Li , Xiao-Jun Wu , Tianyang Xu

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zichen Yang , Jie Qin , Di Huang

The existing action recognition methods are mainly based on clip-level classifiers such as two-stream CNNs or 3D CNNs, which are trained from the randomly selected clips and applied to densely sampled clips during testing. However, this…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yin-Dong Zheng , Zhaoyang Liu , Tong Lu , Limin Wang

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

We address the problem of spatio-temporal action detection in videos. Existing methods commonly either ignore temporal context in action recognition and localization, or lack the modelling of flexible shapes of action tubes. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wei Li , Zehuan Yuan , Dashan Guo , Lei Huang , Xiangzhong Fang , Changhu Wang

We introduce Activity Graph Transformer, an end-to-end learnable model for temporal action localization, that receives a video as input and directly predicts a set of action instances that appear in the video. Detecting and localizing…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Megha Nawhal , Greg Mori

Dominant approaches to action detection can only provide sub-optimal solutions to the problem, as they rely on seeking frame-level detections, to later compose them into "action tubes" in a post-processing step. With this paper we radically…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Fabio Cuzzolin

Temporally localizing actions in a video is a fundamental challenge in video understanding. Most existing approaches have often drawn inspiration from image object detection and extended the advances, e.g., SSD and Faster R-CNN, to produce…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Fuchen Long , Ting Yao , Zhaofan Qiu , Xinmei Tian , Jiebo Luo , Tao Mei

With the success of deep learning in classifying short trimmed videos, more attention has been focused on temporally segmenting and classifying activities in long untrimmed videos. State-of-the-art approaches for action segmentation utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Shijie Li , Yazan Abu Farha , Yun Liu , Ming-Ming Cheng , Juergen Gall

This technical report analyzes a temporal action localization method we used in the HACS competition which is hosted in Activitynet Challenge 2020.The goal of our task is to locate the start time and end time of the action in the untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Zhiwu Qing , Xiang Wang , Yongpeng Sang , Changxin Gao , Shiwei Zhang , Nong Sang

Accurately locating the start and end time of an action in untrimmed videos is a challenging task. One of the important reasons is the boundary of action is not highly distinguishable, and the features around the boundary are difficult to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Yushuai Hu , Yaochu Jin , Runhua Li , Xiangxiang Zhang