English
Related papers

Related papers: Test-Time Zero-Shot Temporal Action Localization

200 papers

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing, and many other…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Wei Lin , Leonid Karlinsky , Nina Shvetsova , Horst Possegger , Mateusz Kozinski , Rameswar Panda , Rogerio Feris , Hilde Kuehne , Horst Bischof

We propose a novel approach for aerial video action recognition. Our method is designed for videos captured using UAVs and can run on edge or mobile devices. We present a learning-based approach that uses customized auto zoom to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xijun Wang , Ruiqi Xian , Tianrui Guan , Celso M. de Melo , Stephen M. Nogar , Aniket Bera , Dinesh Manocha

Understanding human behavior and activity facilitates advancement of numerous real-world applications, and is critical for video analysis. Despite the progress of action recognition algorithms in trimmed videos, the majority of real-world…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Elahe Vahdani , Yingli Tian

Weakly supervised temporal action localization aims to localize temporal boundaries of actions and simultaneously identify their categories with only video-level category labels. Many existing methods seek to generate pseudo labels for…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Linjiang Huang , Liang Wang , Hongsheng Li

We introduce Train/Test-Time Adaptation with Retrieval (${\rm T^3AR}$), a method to adapt models both at train and test time by means of a retrieval module and a searchable pool of external samples. Before inference, ${\rm T^3AR}$ adapts a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Luca Zancato , Alessandro Achille , Tian Yu Liu , Matthew Trager , Pramuditha Perera , Stefano Soatto

Few-shot (FS) and zero-shot (ZS) learning are two different approaches for scaling temporal action detection (TAD) to new classes. The former adapts a pretrained vision model to a new task represented by as few as a single video per class,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Sauradip Nag , Mengmeng Xu , Xiatian Zhu , Juan-Manuel Perez-Rua , Bernard Ghanem , Yi-Zhe Song , Tao Xiang

The task of weakly supervised temporal action localization targets at generating temporal boundaries for actions of interest, meanwhile the action category should also be classified. Pseudo-label-based methods, which serve as an effective…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jingqiu Zhou , Linjiang Huang , Liang Wang , Si Liu , Hongsheng Li

Temporal action localization aims to identify the boundaries and categories of actions in videos, such as scoring a goal in a football match. Single-frame supervision has emerged as a labor-efficient way to train action localizers as it…

Human-Computer Interaction · Computer Science 2023-12-11 Changjian Chen , Jiashu Chen , Weikai Yang , Haoze Wang , Johannes Knittel , Xibin Zhao , Steffen Koch , Thomas Ertl , Shixia Liu

Current state-of-the-art human action recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. In this work we address the problem of action localisation and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Suman Saha , Gurkirt Singh , Michael Sapienza , Philip H. S. Torr , Fabio Cuzzolin

In this work, we focus on label efficient learning for video action detection. We develop a novel semi-supervised active learning approach which utilizes both labeled as well as unlabeled data along with informative sample selection for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ayush Singh , Aayush J Rana , Akash Kumar , Shruti Vyas , Yogesh Singh Rawat

Learning to recognize actions from only a handful of labeled videos is a challenging problem due to the scarcity of tediously collected activity labels. We approach this problem by learning a two-pathway temporal contrastive model using…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ankit Singh , Omprakash Chakraborty , Ashutosh Varshney , Rameswar Panda , Rogerio Feris , Kate Saenko , Abir Das

Trajectory-Guided image-to-video (I2V) generation aims to synthesize videos that adhere to user-specified motion instructions. Existing methods typically rely on computationally expensive fine-tuning on scarce annotated datasets. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Ruicheng Zhang , Jun Zhou , Zunnan Xu , Zihao Liu , Jiehui Huang , Mingyang Zhang , Yu Sun , Xiu Li

The object of Weakly-supervised Temporal Action Localization (WS-TAL) is to localize all action instances in an untrimmed video with only video-level supervision. Due to the lack of frame-level annotations during training, current WS-TAL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ziyi Liu , Le Wang , Qilin Zhang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Pilhyeon Lee , Jinglu Wang , Yan Lu , Hyeran Byun

Zero-shot learning is a new paradigm to classify objects from classes that are not available at training time. Zero-shot learning (ZSL) methods have attracted considerable attention in recent years because of their ability to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Temporal human action detection aims to identify and localize action segments within untrimmed videos, serving as a pivotal task in video understanding. Despite the progress achieved by prior architectures like CNN and Transformer models,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yicheng Qiu , Keiji Yanai

Zero-shot video recognition (ZSVR) is a task that aims to recognize video categories that have not been seen during the model training process. Recently, vision-language models (VLMs) pre-trained on large-scale image-text pairs have…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yan Zhu , Junbao Zhuo , Bin Ma , Jiajia Geng , Xiaoming Wei , Xiaolin Wei , Shuhui Wang

We present our solution to the BinEgo-360 Challenge at ICCV 2025, which focuses on temporal action localization (TAL) in multi-perspective and multi-modal video settings. The challenge provides a dataset containing panoramic, third-person,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Anh-Kiet Duong , Petra Gomez-Krämer

Active learning (AL) aims to select the most useful data samples from an unlabeled data pool and annotate them to expand the labeled dataset under a limited budget. Especially, uncertainty-based methods choose the most uncertain samples,…

Machine Learning · Computer Science 2023-10-02 Seong Min Kye , Kwanghee Choi , Hyeongmin Byun , Buru Chang

Action recognition in surveillance video makes our life safer by detecting the criminal events or predicting violent emergencies. However, efficient action recognition is not free of difficulty. First, there are so many action classes in…

Computer Vision and Pattern Recognition · Computer Science 2017-10-23 Kun Liu , Wu Liu , Huadong Ma , Wenbing Huang , Xiongxiong Dong