English
Related papers

Related papers: Step-by-step Erasion, One-by-one Collection: A Wea…

200 papers

Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video-level supervision…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Davide Moltisanti , Sanja Fidler , Dima Damen

Detecting temporal extents of human actions in videos is a challenging computer vision problem that requires detailed manual supervision including frame-level labels. This expensive annotation process limits deploying action detectors to a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Basura Fernando , Cheston Tan Yin Chet , Hakan Bilen

We are given a set of video clips, each one annotated with an {\em ordered} list of actions, such as "walk" then "sit" then "answer phone" extracted from, for example, the associated text script. We seek to temporally localize the…

Computer Vision and Pattern Recognition · Computer Science 2014-07-07 Piotr Bojanowski , Rémi Lajugie , Francis Bach , Ivan Laptev , Jean Ponce , Cordelia Schmid , Josef Sivic

We introduce the task of weakly supervised learning for detecting human and object interactions in videos. Our task poses unique challenges as a system does not know what types of human-object interactions are present in a video or the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Shuang Li , Yilun Du , Antonio Torralba , Josef Sivic , Bryan Russell

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

Weakly-supervised Temporal Action Localization (WS-TAL) methods learn to localize temporal starts and ends of action instances in a video under only video-level supervision. Existing WS-TAL methods rely on deep features learned for action…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Ziyi Liu , Le Wang , Wei Tang , Junsong Yuan , Nanning Zheng , Gang Hua

Anomaly activities such as robbery, explosion, accidents, etc. need immediate actions for preventing loss of human life and property in real world surveillance systems. Although the recent automation in surveillance systems are capable of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Snehashis Majhi , Srijan Das , Francois Bremond , Ratnakar Dash , Pankaj Kumar Sa

Fight detection in videos is an emerging deep learning application with today's prevalence of surveillance systems and streaming media. Previous work has largely relied on action recognition techniques to tackle this problem. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Zhenting Qi , Ruike Zhu , Zheyu Fu , Wenhao Chai , Volodymyr Kindratenko

Temporal action localization is an important yet challenging research topic due to its various applications. Since the frame-level or segment-level annotations of untrimmed videos require amounts of labor expenditure, studies on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-08 Chengwei Zhang , Yunlu Xu , Zhanzhan Cheng , Yi Niu , Shiliang Pu , Fei Wu , Futai Zou

The Audio-Visual Video Parsing task aims to identify and temporally localize the events that occur in either or both the audio and visual streams of audible videos. It often performs in a weakly-supervised manner, where only video event…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jinxing Zhou , Dan Guo , Yiran Zhong , Meng Wang

Detecting actions in videos have been widely applied in on-device applications. Practical on-device videos are always untrimmed with both action and background. It is desirable for a model to both recognize the class of action and localize…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yue Tang , Yawen Wu , Peipei Zhou , Jingtong Hu

Localizing actions in video is a core task in computer vision. The weakly supervised temporal localization problem investigates whether this task can be adequately solved with only video-level labels, significantly reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Junwei Ma , Satya Krishna Gorti , Maksims Volkovs , Guangwei Yu

Current state-of-the-art human activity recognition is focused on the classification of temporally trimmed videos in which only one action occurs per frame. We propose a simple, yet effective, method for the temporal detection of activities…

Computer Vision and Pattern Recognition · Computer Science 2016-07-14 Gurkirt Singh , Fabio Cuzzolin

This paper proposes a segregated temporal assembly recurrent (STAR) network for weakly-supervised multiple action detection. The model learns from untrimmed videos with only supervision of video-level labels and makes prediction of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Yunlu Xu , Chengwei Zhang , Zhanzhan Cheng , Jianwen Xie , Yi Niu , Shiliang Pu , Fei Wu

Temporal action localization presents a trade-off between test performance and annotation-time cost. Fully supervised methods achieve good performance with time-consuming boundary annotations. Weakly supervised methods with cheaper…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Xinpeng Ding , Nannan Wang , Xinbo Gao , Jie Li , Xiaoyu Wang , Tongliang Liu

Weakly-supervised temporal action localization aims to learn detecting temporal intervals of action classes with only video-level labels. To this end, it is crucial to separate frames of action classes from the background frames (i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Pilhyeon Lee , Jinglu Wang , Yan Lu , Hyeran Byun

Action segmentation is the task of temporally segmenting every frame of an untrimmed video. Weakly supervised approaches to action segmentation, especially from transcripts have been of considerable interest to the computer vision…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yaser Souri , Alexander Richard , Luca Minciullo , Juergen Gall

We present an approach for weakly supervised learning of human actions from video transcriptions. Our system is based on the idea that, given a sequence of input data and a transcript, i.e. a list of the order the actions occur in the…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Hilde Kuehne , Alexander Richard , Juergen Gall

The video action segmentation task is regularly explored under weaker forms of supervision, such as transcript supervision, where a list of actions is easier to obtain than dense frame-wise labels. In this formulation, the task presents…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 John Ridley , Huseyin Coskun , David Joseph Tan , Nassir Navab , Federico Tombari

Weakly Supervised Temporal Action Localization (WSTAL) aims to localize and classify action instances in long untrimmed videos with only video-level category labels. Due to the lack of snippet-level supervision for indicating action…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Jia-Run Du , Jia-Chang Feng , Kun-Yu Lin , Fa-Ting Hong , Xiao-Ming Wu , Zhongang Qi , Ying Shan , Wei-Shi Zheng