中文
相关论文

相关论文: Weakly-Supervised Temporal Action Localization wit…

200 篇论文

In this work, we propose a new transformer-based regularization to better localize objects for Weakly supervised semantic segmentation (WSSS). In image-level WSSS, Class Activation Map (CAM) is adopted to generate object localization as…

计算机视觉与模式识别 · 计算机科学 2023-09-26 Weixuan Sun , Yanhao Zhang , Zhen Qin , Zheyuan Liu , Lin Cheng , Fanyi Wang , Yiran Zhong , Nick Barnes

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

Weakly-Supervised Dense Video Captioning aims to localize and describe events in videos trained only on caption annotations, without temporal boundaries. Prior work introduced an implicit supervision paradigm based on Gaussian masking and…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Ye-Chan Kim , SeungJu Cha , Si-Woo Kim , Minju Jeon , Hyungee Kim , Dong-Jin Kim

Temporal action detection (TAD) is an important yet challenging task in video analysis. Most existing works draw inspiration from image object detection and tend to reformulate it as a proposal generation - classification problem. However,…

计算机视觉与模式识别 · 计算机科学 2022-03-04 Chen Zhao , Merey Ramazanova , Mengmeng Xu , Bernard Ghanem

The goal of this work is spatio-temporal action localization in videos, using only the supervision from video-level class labels. The state-of-the-art casts this weakly-supervised action localization regime as a Multiple Instance Learning…

计算机视觉与模式识别 · 计算机科学 2018-11-26 Pascal Mettes , Cees G. M. Snoek

We propose a weakly-supervised framework for action labeling in video, where only the order of occurring actions is required during training time. The key challenge is that the per-frame alignments between the input (video) and label…

计算机视觉与模式识别 · 计算机科学 2016-07-29 De-An Huang , Li Fei-Fei , Juan Carlos Niebles

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

计算机视觉与模式识别 · 计算机科学 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

Despite the recent advances in video classification, progress in spatio-temporal action recognition has lagged behind. A major contributing factor has been the prohibitive cost of annotating videos frame-by-frame. In this paper, we present…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Anurag Arnab , Chen Sun , Arsha Nagrani , Cordelia Schmid

Weakly supervised object localization (WSOL) is a challenging problem when given image category labels but requires to learn object localization models. Optimizing a convolutional neural network (CNN) for classification tends to activate…

计算机视觉与模式识别 · 计算机科学 2021-08-05 Wei Gao , Fang Wan , Xingjia Pan , Zhiliang Peng , Qi Tian , Zhenjun Han , Bolei Zhou , Qixiang Ye

Weakly supervised video anomaly detection (WS-VAD) is tasked with pinpointing temporal intervals containing anomalous events within untrimmed videos, utilizing only video-level annotations. However, a significant challenge arises due to the…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Yu Wang , Shiwei Chen

Temporal action localization (TAL) is a fundamental yet challenging task in video understanding. Existing TAL methods rely on pre-training a video encoder through action classification supervision. This results in a task discrepancy problem…

计算机视觉与模式识别 · 计算机科学 2021-11-01 Mengmeng Xu , Juan-Manuel Perez-Rua , Xiatian Zhu , Bernard Ghanem , Brais Martinez

Temporal action segmentation is a task to classify each frame in the video with an action label. However, it is quite expensive to annotate every frame in a large corpus of videos to construct a comprehensive supervised training dataset.…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Zhe Wang , Hao Chen , Xinyu Li , Chunhui Liu , Yuanjun Xiong , Joseph Tighe , Charless Fowlkes

Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration. In temporal action…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Zhanzhong Pang , Fadime Sener , Shrinivas Ramasubramanian , Angela Yao

Training temporal action detection in videos requires large amounts of labeled data, yet such annotation is expensive to collect. Incorporating unlabeled or weakly-labeled data to train action detection model could help reduce annotation…

计算机视觉与模式识别 · 计算机科学 2021-02-19 Baifeng Shi , Qi Dai , Judy Hoffman , Kate Saenko , Trevor Darrell , Huijuan Xu

Weakly supervised object localization (WSOL) is a challenging task aiming to localize objects with only image-level supervision. Recent works apply visual transformer to WSOL and achieve significant success by exploiting the long-range…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Pingyu Wu , Wei Zhai , Yang Cao , Jiebo Luo , Zheng-Jun Zha

Weakly supervised semantic segmentation (WSSS) aims at learning a semantic segmentation model with only image-level tags. Despite intensive research on deep learning approaches over a decade, there is still a significant performance gap…

计算机视觉与模式识别 · 计算机科学 2024-05-09 Qi Lai , Chi-Man Vong

The image-level label has prevailed in weakly supervised semantic segmentation tasks due to its easy availability. Since image-level labels can only indicate the existence or absence of specific categories of objects, visualization-based…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Tao Chen , Yazhou Yao , Xingguo Huang , Zechao Li , Liqiang Nie , Jinhui Tang

Weakly-Supervised Video Anomaly Detection aims to identify anomalous events using only video-level labels, balancing annotation efficiency with practical applicability. However, existing methods often oversimplify the anomaly space by…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Junhee Lee , ChaeBeen Bang , MyoungChul Kim , MyeongAh Cho

Open-Vocabulary Temporal Action Localization (OVTAL) enables a model to recognize any desired action category in videos without the need to explicitly curate training data for all categories. However, this flexibility poses significant…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Akshita Gupta , Aditya Arora , Sanath Narayan , Salman Khan , Fahad Shahbaz Khan , Graham W. Taylor

Weakly supervised object localization (WSOL) aims at predicting object locations in an image using only image-level category labels. Common challenges that image classification models encounter when localizing objects are, (a) they tend to…

计算机视觉与模式识别 · 计算机科学 2022-04-15 Saurav Gupta , Sourav Lakhotia , Abhay Rawat , Rahul Tallamraju