English
Related papers

Related papers: Forcing the Whole Video as Background: An Adversar…

200 papers

Temporal Action Localization (TAL) in untrimmed video is important for many applications. But it is very expensive to annotate the segment-level ground truth (action class and temporal boundary). This raises the interest of addressing TAL…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zheng Shou , Hang Gao , Lei Zhang , Kazuyuki Miyazawa , Shih-Fu Chang

Long-form video understanding requires designing approaches that are able to temporally localize activities or language. End-to-end training for such tasks is limited by the compute device memory constraints and lack of temporal annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Mengmeng Xu , Erhan Gundogdu , Maksim Lapin , Bernard Ghanem , Michael Donoser , Loris Bazzani

Weakly-supervised action localization aims to recognize and localize action instancese in untrimmed videos with only video-level labels. Most existing models rely on multiple instance learning(MIL), where the predictions of unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Guiqin Wang , Peng Zhao , Cong Zhao , Shusen Yang , Jie Cheng , Luziwei Leng , Jianxing Liao , Qinghai Guo

Enabling computational systems with the ability to localize actions in video-based content has manifold applications. Traditionally, such a problem is approached in a fully-supervised setting where video-clips with complete frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Kurt Degiorgio , Fabio Cuzzolin

Temporal action localization presents a trade-off between test performance and annotation-time cost. Fully supervised methods achieve good performance with time-consuming boundary annotations. Weakly supervised methods with cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Xinpeng Ding , Nannan Wang , Xinbo Gao , Jie Li , Xiaoyu Wang , Tongliang Liu

Point-supervised Temporal Action Localization (PTAL) adopts a lightly frame-annotated paradigm (\textit{i.e.}, labeling only a single frame per action instance) to train a model to effectively locate action instances within untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yunchuan Ma , Laiyun Qing , Guorong Li , Yuqing Liu , Yuankai Qi , Qingming Huang

We present a method for weakly-supervised action localization based on graph convolutions. In order to find and classify video time segments that correspond to relevant action classes, a system must be able to both identify discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Maheen Rashid , Hedvig Kjellström , Yong Jae Lee

Recent breakthroughs in Multimodal Large Language Models (MLLMs) have gained significant recognition within the deep learning community, where the fusion of the Video Foundation Models (VFMs) and Large Language Models(LLMs) has proven…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Quan Zhang , Jinwei Fang , Rui Yuan , Xi Tang , Yuxin Qi , Ke Zhang , Chun Yuan

Temporal action localization (TAL), which involves recognizing and locating action instances, is a challenging task in video understanding. Most existing approaches directly predict action classes and regress offsets to boundaries, while…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayi Shao , Xiaohan Wang , Ruijie Quan , Junjun Zheng , Jiang Yang , Yi Yang

Action recognition in videos has attracted a lot of attention in the past decade. In order to learn robust models, previous methods usually assume videos are trimmed as short sequences and require ground-truth annotations of each video…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Xiao-Yu Zhang , Haichao Shi , Changsheng Li , Kai Zheng , Xiaobin Zhu , Lixin Duan

This report presents our method for Temporal Action Localisation (TAL), which focuses on identifying and classifying actions within specific time intervals throughout a video sequence. We employ a data augmentation technique by expanding…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yinan Han , Qingyuan Jiang , Hongming Mei , Yang Yang , Jinhui Tang

Weakly supervised temporal action detection is a Herculean task in understanding untrimmed videos, since no supervisory signal except the video-level category label is available on training data. Under the supervision of category labels,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Tao Zhang , Thomas H. Li , Ge Li

Learning to localize actions in long, cluttered, and untrimmed videos is a hard task, that in the literature has typically been addressed assuming the availability of large amounts of annotated training samples for each class -- either in a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Ting-Ting Xie , Christos Tzelepis , Fan Fu , Ioannis Patras

The tracking-by-detection framework consists of two stages, i.e., drawing samples around the target object in the first stage and classifying each sample as the target object or as background in the second stage. The performance of existing…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Yibing Song , Chao Ma , Xiaohe Wu , Lijun Gong , Linchao Bao , Wangmeng Zuo , Chunhua Shen , Rynson Lau , Ming-Hsuan Yang

Recently, Weakly-supervised Temporal Action Localization (WTAL) has been densely studied but there is still a large gap between weakly-supervised models and fully-supervised models. It is practical and intuitive to annotate temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xudong Lin , Zheng Shou , Shih-Fu Chang

Pixel-level annotations are expensive and time-consuming to obtain. Hence, weak supervision using only image tags could have a significant impact in semantic segmentation. Recent years have seen great progress in weakly-supervised semantic…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Fatemeh Sadat Saleh , Mohammad Sadegh Aliakbarian , Mathieu Salzmann , Lars Petersson , Jose M. Alvarez

Temporal Action Localization (TAL) has garnered significant attention in information retrieval. Existing supervised or weakly supervised methods heavily rely on labeled temporal boundaries and action categories, which are labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Rui Xia , Dan Jiang , Quan Zhang , Ke Zhang , Chun Yuan

The goal of Temporal Action Localization (TAL) is to find the categories and temporal boundaries of actions in an untrimmed video. Most TAL methods rely heavily on action recognition models that are sensitive to action labels rather than…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hao Zhang , Chunyan Feng , Jiahui Yang , Zheng Li , Caili Guo

Weakly supervised object localization (WSOL) aims to localize the target object using only the image-level supervision. Recent methods encourage the model to activate feature maps over the entire object by dropping the most discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-09-28 Minsong Ki , Youngjung Uh , Wonyoung Lee , Hyeran Byun

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang