English
Related papers

Related papers: Decoupling Spatio-Temporal Adapter for Fine-Graine…

200 papers

This paper studies introducing viewpoint invariant feature representations in existing action recognition architecture. Despite significant progress in action recognition, efficiently handling geometric variations in large-scale datasets…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jinhui Ye , Junwei Liang

Temporal Action Detection (TAD) is an essential and challenging topic in video understanding, aiming to localize the temporal segments containing human action instances and predict the action categories. The previous works greatly rely upon…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Jiannan Wu , Peize Sun , Shoufa Chen , Jiewen Yang , Zihao Qi , Lan Ma , Ping Luo

We introduce the task of spotting temporally precise, fine-grained events in video (detecting the precise moment in time events occur). Precise spotting requires models to reason globally about the full-time scale of actions and locally to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 James Hong , Haotian Zhang , Michaël Gharbi , Matthew Fisher , Kayvon Fatahalian

In this work, we address the problem of spatio-temporal action detection in temporally untrimmed videos. It is an important and challenging task as finding accurate human actions in both temporal and spatial space is important for analyzing…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Zhenheng Yang , Jiyang Gao , Ram Nevatia

Taking advantage of human pose data for understanding human activities has attracted much attention these days. However, state-of-the-art pose estimators struggle in obtaining high-quality 2D or 3D pose data due to occlusion, truncation and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Di Yang , Rui Dai , Yaohui Wang , Rupayan Mallick , Luca Minciullo , Gianpiero Francesca , Francois Bremond

We propose a Dynamic Graph-Based Spatial-Temporal Attention (DG-STA) method for hand gesture recognition. The key idea is to first construct a fully-connected graph from a hand skeleton, where the node features and edges are then…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Yuxiao Chen , Long Zhao , Xi Peng , Jianbo Yuan , Dimitris N. Metaxas

Real-life applications of action recognition often require a fine-grained understanding of subtle movements, e.g., in sports analytics, user interactions in AR/VR, and surgical videos. Although fine-grained actions are more costly to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Mubarak Shah

In this work, we propose an approach to the spatiotemporal localisation (detection) and classification of multiple concurrent actions within temporally untrimmed videos. Our framework is composed of three stages. In stage 1, appearance and…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

The application of visual tracking to the performance analysis of sports players in dynamic competitions is vital for effective coaching. In doubles matches, coordinated positioning is crucial for maintaining control of the court and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Ning Ding , Kazuya Takeda , Wenhui Jin , Yingjiu Bei , Keisuke Fujii

Recognizing human actions in videos requires spatial and temporal understanding. Most existing action recognition models lack a balanced spatio-temporal understanding of videos. In this work, we propose a novel two-stream architecture,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Dongho Lee , Jongseo Lee , Jinwoo Choi

Sports video analysis is a widespread research topic. Its applications are very diverse, like events detection during a match, video summary, or fine-grained movement analysis of athletes. As part of the MediaEval 2022 benchmarking…

Videos are unique in their integration of temporal elements, including camera, scene, action, and attribute, along with their dynamic relationships over time. However, existing benchmarks for video understanding often treat these properties…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Fanheng Kong , Jingyuan Zhang , Hongzhi Zhang , Shi Feng , Daling Wang , Linhao Yu , Xingguang Ji , Yu Tian , Victoria W. , Fuzheng Zhang

Temporal action localization (TAL) involves dual tasks to classify and localize actions within untrimmed videos. However, the two tasks often have conflicting requirements for features. Existing methods typically employ separate heads for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Qiang Li , Di Liu , Jun Kong , Sen Li , Hui Xu , Jianzhong Wang

We present a model for temporally precise action spotting in videos, which uses a dense set of detection anchors, predicting a detection confidence and corresponding fine-grained temporal displacement for each anchor. We experiment with two…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 João V. B. Soares , Avijit Shah , Topojoy Biswas

The 3D trajectory of a shuttlecock required for a badminton rally robot for human-robot competition demands real-time performance with high accuracy. However, the fast flight speed of the shuttlecock, along with various visual effects, and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Yuan Lai , Zhiwei Shi , Chengxi Zhu

Naturalistic driving action recognition is essential for vehicle cabin monitoring systems. However, the complexity of real-world backgrounds presents significant challenges for this task, and previous approaches have struggled with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Qing Chang , Wei Dai , Zhihao Shuai , Limin Yu , Yutao Yue

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed security…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Joshua Gleason , Rajeev Ranjan , Steven Schwarcz , Carlos D. Castillo , Jun-Chen Cheng , Rama Chellappa

Badminton is a fast-paced sport that requires a strategic combination of spatial, temporal, and technical tactics. To gain a competitive edge at high-level competitions, badminton professionals frequently analyze match videos to gain…

Human-Computer Interaction · Computer Science 2023-08-09 Tica Lin , Alexandre Aouididi , Zhutian Chen , Johanna Beyer , Hanspeter Pfister , Jui-Hsien Wang

Sports video analysis is a prevalent research topic due to the variety of application areas, ranging from multimedia intelligent devices with user-tailored digests up to analysis of athletes' performance. The Sports Video task is part of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Pierre-Etienne Martin , Jordan Calandre , Boris Mansencal , Jenny Benois-Pineau , Renaud Péteri , Laurent Mascarilla , Julien Morlier

Self-attention learns pairwise interactions to model long-range dependencies, yielding great improvements for video action recognition. In this paper, we seek a deeper understanding of self-attention for temporal modeling in videos. We…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Bo He , Xitong Yang , Zuxuan Wu , Hao Chen , Ser-Nam Lim , Abhinav Shrivastava