English
Related papers

Related papers: Weakly-supervised Temporal Action Localization by …

200 papers

This paper studies the joint learning of action recognition and temporal localization in long, untrimmed videos. We employ a multi-task learning framework that performs the three highly related steps of action proposal, action recognition,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Yi Zhu , Shawn Newsam

Weakly supervised temporal action localization (WS-TAL) is a task of targeting at localizing complete action instances and categorizing them with video-level labels. Action-background ambiguity, primarily caused by background noise…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yuanpeng He , Lijian Li , Tianxiang Zhan , Wenpin Jiao , Chi-Man Pun

Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal detection of activities…

Computer Vision and Pattern Recognition · Computer Science 2016-07-14 Gurkirt Singh , Fabio Cuzzolin

Learning disentangled representations that correspond to factors of variation in real-world data is critical to interpretable and human-controllable machine learning. Recently, concerns about the viability of learning disentangled…

Machine Learning · Computer Science 2020-04-14 Rui Shu , Yining Chen , Abhishek Kumar , Stefano Ermon , Ben Poole

Temporal action localization is an important and challenging task that aims to locate temporal regions in real-world untrimmed videos where actions occur and recognize their classes. It is widely acknowledged that video context is a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xin Qin , Hanbin Zhao , Guangchen Lin , Hao Zeng , Songcen Xu , Xi Li

We introduce the problem of weakly supervised Multi-Object Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation. To address it, we…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Idoia Ruiz , Lorenzo Porzi , Samuel Rota Bulò , Peter Kontschieder , Joan Serrat

Current action recognition methods heavily rely on trimmed videos for model training. However, it is expensive and time-consuming to acquire a large-scale trimmed video dataset. This paper presents a new weakly supervised architecture,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Limin Wang , Yuanjun Xiong , Dahua Lin , Luc Van Gool

Formulating learning systems for the detection of real-world anomalous events using only video-level labels is a challenging task mainly due to the presence of noisy labels as well as the rare occurrence of anomalous events in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Muhammad Zaigham Zaheer , Arif Mahmood , Marcella Astrid , Seung-Ik Lee

We consider the problem of parameter estimation using weakly supervised datasets, where a training sample consists of the input and a partially specified annotation, which we refer to as the output. The missing information in the annotation…

Machine Learning · Computer Science 2012-06-22 M. Pawan Kumar , Ben Packer , Daphne Koller

Weakly Supervised Object Localization (WSOL) methodsusually rely on fully convolutional networks in order to ob-tain class activation maps(CAMs) of targeted labels. How-ever, these networks always highlight the most discriminativeparts to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Ziyi Kou , Wentian Zhao , Guofeng Cui , Shaojie Wang

In fine-grained road scene understanding, semantic segmentation plays a crucial role in enabling vehicles to perceive and comprehend their surroundings. By assigning a specific class label to each pixel in an image, it allows for precise…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Yuting Hong , Yongkang Wu , Hui Xiao , Huazheng Hao , Xiaojie Qiu , Baochen Yao , Chengbin Peng

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in a video or the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Shuang Li , Yilun Du , Antonio Torralba , Josef Sivic , Bryan Russell

Neural network models that are not conditioned on class identities were shown to facilitate knowledge transfer between classes and to be well-suited for one-shot learning tasks. Following this motivation, we further explore and establish…

Machine Learning · Statistics 2018-06-28 Gil Keren , Maximilian Schmitt , Thomas Kehrenberg , Björn Schuller

With a focus on abnormal events contained within untrimmed videos, there is increasing interest among researchers in video anomaly detection. Among different video anomaly detection scenarios, weakly-supervised video anomaly detection poses…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Yidan Fan , Yongxin Yu , Wenhuan Lu , Yahong Han

Self-supervised vision transformers can generate accurate localization maps of the objects in an image. However, since they decompose the scene into multiple maps containing various objects, and they do not rely on any explicit supervisory…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Shakeeb Murtaza , Soufiane Belharbi , Marco Pedersoli , Aydin Sarraf , Eric Granger

Weakly-supervised temporal action localization (WTAL) in untrimmed videos has emerged as a practical but challenging task since only video-level labels are available. Existing approaches typically leverage off-the-shelf segment-level…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Zichen Yang , Jie Qin , Di Huang

Learning to detect real-world anomalous events through video-level labels is a challenging task due to the rare occurrence of anomalies as well as noise in the labels. In this work, we propose a weakly supervised anomaly detection method…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Muhammad Zaigham Zaheer , Arif Mahmood , Marcella Astrid , Seung-Ik Lee

This paper addresses the challenging task of weakly-supervised video temporal grounding. Existing approaches are generally based on the moment proposal selection framework that utilizes contrastive learning and reconstruction paradigm for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Zeyu Xiong , Wanlong Fang , Xiaoye Qu , Chen Chen , Jianfeng Dong , Keke Tang , Pan Zhou , Yu Cheng , Daizong Liu

Semi-Supervised Learning can be more beneficial for the video domain compared to images because of its higher annotation cost and dimensionality. Besides, any video understanding task requires reasoning over both spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Ishan Rajendrakumar Dave , Mamshad Nayeem Rizve , Chen Chen , Mubarak Shah

Weakly supervised object detection is a challenging task when provided with image category supervision but required to learn, at the same time, object locations and object detectors. The inconsistency between the weak supervision and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-19 Fang Wan , Pengxu Wei , Zhenjun Han , Jianbin Jiao , Qixiang Ye