English
Related papers

Related papers: Cross-modal Consensus Network for Weakly Supervise…

200 papers

Unsupervised video representation learning has made remarkable achievements in recent years. However, most existing methods are designed and optimized for video classification. These pre-trained models can be sub-optimal for temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Can Zhang , Tianyu Yang , Junwu Weng , Meng Cao , Jue Wang , Yuexian Zou

With the rapid development of digital multimedia, video understanding has become an important field. For action recognition, temporal dimension plays an important role, and this is quite different from image recognition. In order to learn…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Qian Liu , Tao Wang , Jie Liu , Yang Guan , Qi Bu , Longfei Yang

Video-based computer vision tasks can benefit from estimation of the salient regions and interactions between those regions. Traditionally, this has been done by identifying the object regions in the images by utilizing pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Arulkumar Subramaniam , Jayesh Vaidya , Muhammed Abdul Majeed Ameen , Athira Nambiar , Anurag Mittal

Cross-modal retrieval aims to learn discriminative and modal-invariant features for data from different modalities. Unlike the existing methods which usually learn from the features extracted by offline networks, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Longlong Jing , Elahe Vahdani , Jiaxing Tan , Yingli Tian

Activity detection is a fundamental problem in computer vision. Detecting activities of different temporal scales is particularly challenging. In this paper, we propose the contextual multi-scale region convolutional 3D network (CMS-RC3D)…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Yancheng Bai , Huijuan Xu , Kate Saenko , Bernard Ghanem

Weakly-supervised temporal action localization is a very challenging problem because frame-wise labels are not given in the training stage while the only hint is video-level labels: whether each video contains action frames of interest.…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Pilhyeon Lee , Youngjung Uh , Hyeran Byun

This paper focuses on temporal localization of actions in untrimmed videos. Existing methods typically train classifiers for a pre-defined list of actions and apply them in a sliding window fashion. However, activities in the wild consist…

Computer Vision and Pattern Recognition · Computer Science 2017-08-07 Jiyang Gao , Chen Sun , Zhenheng Yang , Ram Nevatia

This report presents our method for Temporal Action Localisation (TAL), which focuses on identifying and classifying actions within specific time intervals throughout a video sequence. We employ a data augmentation technique by expanding…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Yinan Han , Qingyuan Jiang , Hongming Mei , Yang Yang , Jinhui Tang

Online action detection in untrimmed videos aims to identify an action as it happens, which makes it very important for real-time applications. Previous methods rely on tedious annotations of temporal action boundaries for training, which…

Computer Vision and Pattern Recognition · Computer Science 2021-05-20 Mingfei Gao , Yingbo Zhou , Ran Xu , Richard Socher , Caiming Xiong

Weakly-supervised temporal action localization is a problem of learning an action localization model with only video-level action labeling available. The general framework largely relies on the classification activation, which employs an…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Baifeng Shi , Qi Dai , Yadong Mu , Jingdong Wang

Weakly supervised temporal action localization (WTAL) aims to detect action instances in untrimmed videos using only video-level annotations. Since many existing works optimize WTAL models based on action classification labels, they…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Geuntaek Lim , Hyunwoo Kim , Joonsoo Kim , Yukyung Choi

Enabling computational systems with the ability to localize actions in video-based content has manifold applications. Traditionally, such a problem is approached in a fully-supervised setting where video-clips with complete frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Kurt Degiorgio , Fabio Cuzzolin

The task of weakly supervised temporal action localization targets at generating temporal boundaries for actions of interest, meanwhile the action category should also be classified. Pseudo-label-based methods, which serve as an effective…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jingqiu Zhou , Linjiang Huang , Liang Wang , Si Liu , Hongsheng Li

Audio-visual generalised zero-shot learning for video classification requires understanding the relations between the audio and visual information in order to be able to recognise samples from novel, previously unseen classes at test time.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Otniel-Bogdan Mercea , Thomas Hummel , A. Sophia Koepke , Zeynep Akata

Video data is with complex temporal dynamics due to various factors such as camera motion, speed variation, and different activities. To effectively capture this diverse motion pattern, this paper presents a new temporal adaptive module…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Zhaoyang Liu , Limin Wang , Wayne Wu , Chen Qian , Tong Lu

The present few-shot temporal action localization model can't handle the situation where videos contain multiple action instances. So the purpose of this paper is to achieve manifold action instances localization in a lengthy untrimmed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Fengshun Wang , Qiurui Wang , Yuting Wang

Temporal Action Detection (TAD), the task of localizing and classifying actions in untrimmed video, remains challenging due to action overlaps and variable action durations. Recent findings suggest that TAD performance is dependent on the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Aglind Reka , Diana Laura Borza , Dominick Reilly , Michal Balazia , Francois Bremond

We address temporal action localization in untrimmed long videos. This is important because videos in real applications are usually unconstrained and contain multiple action instances plus video content of background scenes or other…

Computer Vision and Pattern Recognition · Computer Science 2016-04-25 Zheng Shou , Dongang Wang , Shih-Fu Chang

Current action recognition methods heavily rely on trimmed videos for model training. However, it is expensive and time-consuming to acquire a large-scale trimmed video dataset. This paper presents a new weakly supervised architecture,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-23 Limin Wang , Yuanjun Xiong , Dahua Lin , Luc Van Gool

Different from general object detection, moving infrared small target detection faces huge challenges due to tiny target size and weak background contrast.Currently, most existing methods are fully-supervised, heavily relying on a large…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Weiwei Duan , Luping Ji , Shengjia Chen , Sicheng Zhu , Jianghong Huang , Mao Ye