English
Related papers

Related papers: Learning Transferable Spatiotemporal Representatio…

200 papers

Videos are a rich source for self-supervised learning (SSL) of visual representations due to the presence of natural temporal transformations of objects. However, current methods typically randomly sample video clips for learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Brian Chen , Ramprasaath R. Selvaraju , Shih-Fu Chang , Juan Carlos Niebles , Nikhil Naik

Abnormal event detection in videos is a challenging problem, partly due to the multiplicity of abnormal patterns and the lack of their corresponding annotations. In this paper, we propose new constrained pretext tasks to learn object level…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yassine Naji , Aleksandr Setkov , Angélique Loesch , Michèle Gouiffès , Romaric Audigier

Video-Text pre-training aims at learning transferable representations from large-scale video-text pairs via aligning the semantics between visual and textual information. State-of-the-art approaches extract visual features from raw pixels…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Rui Yan , Mike Zheng Shou , Yixiao Ge , Alex Jinpeng Wang , Xudong Lin , Guanyu Cai , Jinhui Tang

State-of-the-art computer vision systems are trained to predict a fixed set of predetermined object categories. This restricted form of supervision limits their generality and usability since additional labeled data is needed to specify any…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Alec Radford , Jong Wook Kim , Chris Hallacy , Aditya Ramesh , Gabriel Goh , Sandhini Agarwal , Girish Sastry , Amanda Askell , Pamela Mishkin , Jack Clark , Gretchen Krueger , Ilya Sutskever

We present an unsupervised representation learning approach using videos without semantic labels. We leverage the temporal coherence as a supervisory signal by formulating representation learning as a sequence sorting task. We take…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Hsin-Ying Lee , Jia-Bin Huang , Maneesh Singh , Ming-Hsuan Yang

Video-Text Pre-training (VTP) aims to learn transferable representations for various downstream tasks from large-scale web videos. To date, almost all existing VTP methods are limited to retrieval-based downstream tasks, e.g., video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Meng Cao , Tianyu Yang , Junwu Weng , Can Zhang , Jue Wang , Yuexian Zou

Spatio-temporal representational learning has been widely adopted in various fields such as action recognition, video object segmentation, and action anticipation. Previous spatio-temporal representational learning approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Xuefan Zha , Wentao Zhu , Tingxun Lv , Sen Yang , Ji Liu

In this paper, we explore the visual representations produced from a pre-trained text-to-video (T2V) diffusion model for video understanding tasks. We hypothesize that the latent representation learned from a pretrained generative T2V model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zixin Zhu , Xuelu Feng , Dongdong Chen , Junsong Yuan , Chunming Qiao , Gang Hua

We present a framework for learning cross-modal video representations by directly pre-training on raw data to facilitate various downstream video-text tasks. Our main contributions lie in the pre-training framework and proxy tasks. First,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xingning Dong , Qingpei Guo , Tian Gan , Qing Wang , Jianlong Wu , Xiangyuan Ren , Yuan Cheng , Wei Chu

Learning from spatio-temporal data has numerous applications such as human-behavior analysis, object tracking, video compression, and physics simulation.However, existing methods still perform poorly on challenging video tasks such as…

Machine Learning · Computer Science 2020-10-06 Jiahao Su , Wonmin Byeon , Jean Kossaifi , Furong Huang , Jan Kautz , Animashree Anandkumar

Video recognition models have progressed significantly over the past few years, evolving from shallow classifiers trained on hand-crafted features to deep spatiotemporal networks. However, labeled video data required to train such models…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Rohit Girdhar , Du Tran , Lorenzo Torresani , Deva Ramanan

The abundance of instructional videos and their narrations over the Internet offers an exciting avenue for understanding procedural activities. In this work, we propose to learn video representation that encodes both action steps and their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Yiwu Zhong , Licheng Yu , Yang Bai , Shangwen Li , Xueting Yan , Yin Li

Self-supervised approaches for video have shown impressive results in video understanding tasks. However, unlike early works that leverage temporal self-supervision, current state-of-the-art methods primarily rely on tasks from the image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Ishan Rajendrakumar Dave , Simon Jenni , Mubarak Shah

This paper demonstrates a self-supervised approach for learning semantic video representations. Recent vision studies show that a masking strategy for vision and natural language supervision has contributed to developing transferable visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Mona Ahmadian , Frank Guerin , Andrew Gilbert

Procedural video representation learning is an active research area where the objective is to learn an agent which can anticipate and forecast the future given the present video input, typically in conjunction with textual annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Han Lin , Tushar Nagarajan , Nicolas Ballas , Mido Assran , Mojtaba Komeili , Mohit Bansal , Koustuv Sinha

In low-level video analyses, effective representations are important to derive the correspondences between video frames. These representations have been learned in a self-supervised fashion from unlabeled images or videos, using carefully…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Rui Li , Dong Liu

Self-supervised feature learning enables perception systems to benefit from the vast raw data recorded by vehicle fleets worldwide. While video-level self-supervised learning approaches have shown strong generalizability on classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Christopher Lang , Alexander Braun , Lars Schillingmann , Karsten Haug , Abhinav Valada

Most of the existing video self-supervised methods mainly leverage temporal signals of videos, ignoring that the semantics of moving objects and environmental information are all critical for video-related tasks. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Wei Li , Dezhao Luo , Bo Fang , Yu Zhou , Weiping Wang

Video semantic segmentation (VSS) plays a vital role in understanding the temporal evolution of scenes. Traditional methods often segment videos frame-by-frame or in a short temporal window, leading to limited temporal context, redundant…

Image and Video Processing · Electrical Eng. & Systems 2025-03-28 Syed Ariff Syed Hesham , Yun Liu , Guolei Sun , Henghui Ding , Jing Yang , Ender Konukoglu , Xue Geng , Xudong Jiang

In self-supervised spatio-temporal representation learning, the temporal resolution and long-short term characteristics are not yet fully explored, which limits representation capabilities of learned models. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Yuan Yao , Chang Liu , Dezhao Luo , Yu Zhou , Qixiang Ye