English
Related papers

Related papers: Two-Stream Consensus Network for Weakly-Supervised…

200 papers

Action segmentation is the task of predicting the actions for each frame of a video. As obtaining the full annotation of videos for action segmentation is expensive, weakly supervised approaches that can learn only from transcripts are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yaser Souri , Mohsen Fayyaz , Luca Minciullo , Gianpiero Francesca , Juergen Gall

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zichen Yang , Jie Qin , Di Huang

Detecting actions in videos have been widely applied in on-device applications. Practical on-device videos are always untrimmed with both action and background. It is desirable for a model to both recognize the class of action and localize…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yue Tang , Yawen Wu , Peipei Zhou , Jingtong Hu

With video-level labels, weakly supervised temporal action localization (WTAL) applies a localization-by-classification paradigm to detect and classify the action in untrimmed videos. Due to the characteristic of classification,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ziqiang Li , Yongxin Ge , Jiaruo Yu , Zhongming Chen

Temporal action detection (TAD) aims to detect the semantic labels and boundaries of action instances in untrimmed videos. Current mainstream approaches are multi-step solutions, which fall short in efficiency and flexibility. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shimin Chen , Chen Chen , Wei Li , Xunqiang Tao , Yandong Guo

Temporal action detection aims to locate the boundaries of action in the video. The current method based on boundary matching enumerates and calculates all possible boundary matchings to generate proposals. However, these methods neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Guo Chen , Yin-Dong Zheng , Limin Wang , Tong Lu

Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Pilhyeon Lee , Jinglu Wang , Yan Lu , Hyeran Byun

Point-Level temporal action localization (PTAL) aims to localize actions in untrimmed videos with only one timestamp annotation for each action instance. Existing methods adopt the frame-level prediction paradigm to learn from the sparse…

Computer Vision and Pattern Recognition · Computer Science 2020-12-16 Chen Ju , Peisen Zhao , Ya Zhang , Yanfeng Wang , Qi Tian

We present a Temporal Context Network (TCN) for precise temporal localization of human activities. Similar to the Faster-RCNN architecture, proposals are placed at equal intervals in a video which span multiple temporal scales. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xiyang Dai , Bharat Singh , Guyue Zhang , Larry S. Davis , Yan Qiu Chen

Weakly-supervised temporal action localization (WTAL) aims to recognize and localize action instances with only video-level labels. Despite the significant progress, existing methods suffer from severe performance degradation when…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Yangcen Liu , Ziyi Liu , Yuanhao Zhai , Wen Li , David Doerman , Junsong Yuan

Temporal Action Localization (TAL) is a critical task in video analysis, identifying precise start and end times of actions. Existing methods like CNNs, RNNs, GCNs, and Transformers have limitations in capturing long-range dependencies and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sangyoun Lee , Juho Jung , Changdae Oh , Sunghee Yun

\begin{abstract} Learning-based methods suffer from a deficiency of clean annotations, especially in biomedical segmentation. Although many semi-supervised methods have been proposed to provide extra training data, automatically generated…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Shaobo Min , Xuejin Chen , Zheng-Jun Zha , Feng Wu , Yongdong Zhang

Weakly-supervised temporal action localization aims to locate action regions and identify action categories in untrimmed videos simultaneously by taking only video-level labels as the supervision. Pseudo label generation is a promising…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Wulian Yun , Mengshi Qi , Chuanming Wang , Huadong Ma

Weakly-supervised temporal action localization (WTAL) intends to detect action instances with only weak supervision, e.g., video-level labels. The current~\textit{de facto} pipeline locates action instances by thresholding and grouping…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Qinying Liu , Zilei Wang , Ruoxi Chen , Zhilin Li

Weakly-supervised temporal action localization is a very challenging problem because frame-wise labels are not given in the training stage while the only hint is video-level labels: whether each video contains action frames of interest.…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Pilhyeon Lee , Youngjung Uh , Hyeran Byun

Weakly supervised semantic segmentation (WSSS) aims at learning a semantic segmentation model with only image-level tags. Despite intensive research on deep learning approaches over a decade, there is still a significant performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qi Lai , Chi-Man Vong

Point-level weakly-supervised temporal action localization (PWTAL) aims to localize actions with only a single timestamp annotation for each action instance. Existing methods tend to mine dense pseudo labels to alleviate the label sparsity,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Yueyang Li , Yonghong Hou , Wanqing Li

Video moment retrieval is to identify the target moment according to the given sentence in an untrimmed video. Due to temporal boundary annotations of the video are extremely time-consuming to acquire, modeling in the weakly-supervised…

Multimedia · Computer Science 2023-11-27 Haoyuan Li , Zhou Zhao , Zhu Zhang , Zhijie Lin

Detecting temporal extents of human actions in videos is a challenging computer vision problem that requires detailed manual supervision including frame-level labels. This expensive annotation process limits deploying action detectors to a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Basura Fernando , Cheston Tan Yin Chet , Hakan Bilen

Weakly supervised temporal action localization is a challenging task as only the video-level annotation is available during the training process. To address this problem, we propose a two-stage approach to fully exploit multi-resolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Rui Su , Dong Xu , Luping Zhou , Wanli Ouyang