English
Related papers

Related papers: Weakly-Supervised Temporal Action Localization wit…

200 papers

Weakly supervised video anomaly detection (WS-VAD) is a challenging problem that aims to learn VAD models only with video-level annotations. In this work, we propose a Long-Short Temporal Co-teaching (LSTC) method to address the WS-VAD…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Shengyang Sun , Xiaojin Gong

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

Temporal Activity Detection aims to predict activity classes per frame, in contrast to video-level predictions in Activity Classification (i.e., Activity Recognition). Due to the expensive frame-level annotations required for detection, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Kumara Kahatapitiya , Zhou Ren , Haoxiang Li , Zhenyu Wu , Michael S. Ryoo , Gang Hua

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Recently, temporal action localization (TAL) has garnered significant interest in information retrieval community. However, existing supervised/weakly supervised methods are heavily dependent on extensive labeled temporal boundaries and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yupeng Hu , Han Jiang , Hao Liu , Kun Wang , Haoyu Tang , Liqiang Nie

This paper focuses on temporal localization of actions in untrimmed videos. Existing methods typically train classifiers for a pre-defined list of actions and apply them in a sliding window fashion. However, activities in the wild consist…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Jiyang Gao , Chen Sun , Zhenheng Yang , Ram Nevatia

Point-Level temporal action localization (PTAL) aims to localize actions in untrimmed videos with only one timestamp annotation for each action instance. Existing methods adopt the frame-level prediction paradigm to learn from the sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Chen Ju , Peisen Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

Recent breakthroughs in Multimodal Large Language Models (MLLMs) have gained significant recognition within the deep learning community, where the fusion of the Video Foundation Models (VFMs) and Large Language Models(LLMs) has proven…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Quan Zhang , Jinwei Fang , Rui Yuan , Xi Tang , Yuxin Qi , Ke Zhang , Chun Yuan

Weakly-supervised temporal action localization (WTAL) learns to detect and classify action instances with only category labels. Most methods widely adopt the off-the-shelf Classification-Based Pre-training (CBP) to generate video features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Chen Ju , Kunhao Zheng , Jinxiang Liu , Peisen Zhao , Ya Zhang , Jianlong Chang , Yanfeng Wang , Qi Tian

In this paper, we introduce a novel task, referred to as Weakly-Supervised Spatio-Temporal Anomaly Detection (WSSTAD) in surveillance video. Specifically, given an untrimmed video, WSSTAD aims to localize a spatio-temporal tube (i.e., a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Jie Wu , Wei Zhang , Guanbin Li , Wenhao Wu , Xiao Tan , Yingying Li , Errui Ding , Liang Lin

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zichen Yang , Jie Qin , Di Huang

Weakly-supervised Temporal Action Localization (WTAL) aims to detect the action segments with only video-level action labels in training. The key challenge is how to distinguish the action of interest segments from the background, which is…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Yuan Liu , Jingyuan Chen , Zhenfang Chen , Bing Deng , Jianqiang Huang , Hanwang Zhang

Existing temporal action localization (TAL) works rely on a large number of training videos with exhaustive segment-level annotation, preventing them from scaling to new classes. As a solution to this problem, few-shot TAL (FS-TAL) aims to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sauradip Nag , Xiatian Zhu , Tao Xiang

Weakly-supervised Temporal Action Localization (WTAL) has achieved notable success but still suffers from a lack of temporal annotations, leading to a performance and framework gap compared with fully-supervised methods. While recent…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ziyi Liu , Yangcen Liu

Weakly-supervised temporal action localization aims to localize actions in untrimmed videos with only video-level action category labels. Most of previous methods ignore the incompleteness issue of Class Activation Sequences (CAS),…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Chen Ju , Peisen Zhao , Siheng Chen , Ya Zhang , Xiaoyun Zhang , Qi Tian

Temporal action segmentation (TAS) demands dense temporal supervision, yet most of the annotation cost in untrimmed videos is spent identifying and refining action transitions, where segmentation errors concentrate and small temporal shifts…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Halil Ismail Helvaci , Sen-ching Samson Cheung

Zero-Shot Temporal Action Localization (ZS-TAL) seeks to identify and locate actions in untrimmed videos unseen during training. Existing ZS-TAL methods involve fine-tuning a model on a large amount of annotated training data. While…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Benedetta Liberatori , Alessandro Conti , Paolo Rota , Yiming Wang , Elisa Ricci

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

Effectively tackling the problem of temporal action localization (TAL) necessitates a visual representation that jointly pursues two confounding goals, i.e., fine-grained discrimination for temporal localization and sufficient visual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zixin Zhu , Wei Tang , Le Wang , Nanning Zheng , Gang Hua

Temporal action segmentation is a topic of increasing interest, however, annotating each frame in a video is cumbersome and costly. Weakly supervised approaches therefore aim at learning temporal action segmentation from videos that are…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mohsen Fayyaz , Juergen Gall