English
Related papers

Related papers: Weakly-Supervised Temporal Action Localization by …

200 papers

Weakly supervised temporal action localization is a challenging vision task due to the absence of ground-truth temporal locations of actions in the training videos. With only video-level supervision during training, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Ashraful Islam , Chengjiang Long , Richard Radke

Temporal action segmentation in videos has drawn much attention recently. Timestamp supervision is a cost-effective way for this task. To obtain more information to optimize the model, the existing method generated pseudo frame-wise labels…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Yang Zhao , Yan Song

Video anomaly detection under video-level labels is currently a challenging task. Previous works have made progresses on discriminating whether a video sequencecontains anomalies. However, most of them fail to accurately localize the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Hui Lv , Chuanwei Zhou , Chunyan Xu , Zhen Cui , Jian Yang

In this work, we focus on label efficient learning for video action detection. We develop a novel semi-supervised active learning approach which utilizes both labeled as well as unlabeled data along with informative sample selection for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Ayush Singh , Aayush J Rana , Akash Kumar , Shruti Vyas , Yogesh Singh Rawat

Recent advances in supervised salient object detection has resulted in significant performance on benchmark datasets. Training such models, however, requires expensive pixel-wise annotations of salient objects. Moreover, many existing…

Computer Vision and Pattern Recognition · Computer Science 2015-09-09 Huaizu Jiang

Semantic segmentation aims to classify every pixel of an input image. Considering the difficulty of acquiring dense labels, researchers have recently been resorting to weak labels to alleviate the annotation burden of segmentation. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Yazhou Yao , Tao Chen , Guosen Xie , Chuanyi Zhang , Fumin Shen , Qi Wu , Zhenmin Tang , Jian Zhang

We address the problem of fine-grained action localization from temporally untrimmed web videos. We assume that only weak video-level annotations are available for training. The goal is to use these weak labels to identify temporal segments…

Computer Vision and Pattern Recognition · Computer Science 2015-08-05 Chen Sun , Sanketh Shetty , Rahul Sukthankar , Ram Nevatia

With video-level labels, weakly supervised temporal action localization (WTAL) applies a localization-by-classification paradigm to detect and classify the action in untrimmed videos. Due to the characteristic of classification,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Ziqiang Li , Yongxin Ge , Jiaruo Yu , Zhongming Chen

We describe a latent approach that learns to detect actions in long sequences given training videos with only whole-video class labels. Our approach makes use of two innovations to attention-modeling in weakly-supervised learning. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Phuc Xuan Nguyen , Deva Ramanan , Charless C. Fowlkes

Deep learning based salient object detection has recently achieved great success with its performance greatly outperforms any other unsupervised methods. However, annotating per-pixel saliency masks is a tedious and inefficient procedure.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Guanbin Li , Yuan Xie , Liang Lin

Image-level weakly supervised semantic segmentation (WSSS) relies on class activation maps (CAMs) for pseudo labels generation. As CAMs only highlight the most discriminative regions of objects, the generated pseudo labels are usually…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Weixuan Sun , Jing Zhang , Nick Barnes

The object of Weakly-supervised Temporal Action Localization (WS-TAL) is to localize all action instances in an untrimmed video with only video-level supervision. Due to the lack of frame-level annotations during training, current WS-TAL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ziyi Liu , Le Wang , Qilin Zhang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

Temporal Action Localization (TAL) in untrimmed video is important for many applications. But it is very expensive to annotate the segment-level ground truth (action class and temporal boundary). This raises the interest of addressing TAL…

Computer Vision and Pattern Recognition · Computer Science 2018-12-18 Zheng Shou , Hang Gao , Lei Zhang , Kazuyuki Miyazawa , Shih-Fu Chang

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zichen Yang , Jie Qin , Di Huang

Weakly-supervised action localization requires training a model to localize the action segments in the video given only video level action label. It can be solved under the Multiple Instance Learning (MIL) framework, where a bag (video)…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Zhekun Luo , Devin Guillory , Baifeng Shi , Wei Ke , Fang Wan , Trevor Darrell , Huijuan Xu

Semi-supervised video action recognition tends to enable deep neural networks to achieve remarkable performance even with very limited labeled data. However, existing methods are mainly transferred from current image-based methods (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Junfei Xiao , Longlong Jing , Lin Zhang , Ju He , Qi She , Zongwei Zhou , Alan Yuille , Yingwei Li

Weakly supervised temporal action localization (WTAL) aims to localize actions in untrimmed videos with only weak supervision information (e.g. video-level labels). Most existing models handle all input videos with a fixed temporal scale.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Weiqi Sun , Rui Su , Qian Yu , Dong Xu

Audio-Visual Event Localization (AVEL) is the task of temporally localizing and classifying \emph{audio-visual events}, i.e., events simultaneously visible and audible in a video. In this paper, we solve AVEL in a weakly-supervised setting,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Kalyan Ramakrishnan

Detecting actions in videos have been widely applied in on-device applications. Practical on-device videos are always untrimmed with both action and background. It is desirable for a model to both recognize the class of action and localize…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yue Tang , Yawen Wu , Peipei Zhou , Jingtong Hu

Learning visual knowledge from massive weakly-labeled web videos has attracted growing research interests thanks to the large corpus of easily accessible video data on the Internet. However, for video action recognition, the action of…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kunpeng Li , Zizhao Zhang , Guanhang Wu , Xuehan Xiong , Chen-Yu Lee , Zhichao Lu , Yun Fu , Tomas Pfister