中文
相关论文

相关论文: Self-supervised Video Representation Learning Usin…

200 篇论文

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Contrastive learning has revolutionized self-supervised image representation learning field, and recently been adapted to video domain. One of the greatest advantages of contrastive learning is that it allows us to flexibly define powerful…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Haofei Kuang , Yi Zhu , Zhi Zhang , Xinyu Li , Joseph Tighe , Sören Schwertfeger , Cyrill Stachniss , Mu Li

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

计算机视觉与模式识别 · 计算机科学 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki

This paper presents a framework for learning visual representations from unlabeled video demonstrations captured from multiple viewpoints. We show that these representations are applicable for imitating several robotic tasks, including pick…

计算机视觉与模式识别 · 计算机科学 2023-01-30 André Correia , Luís A. Alexandre

We focus on contrastive methods for self-supervised video representation learning. A common paradigm in contrastive learning is to construct positive pairs by sampling different data views for the same instance, with different data…

计算机视觉与模式识别 · 计算机科学 2021-08-23 Chen Sun , Arsha Nagrani , Yonglong Tian , Cordelia Schmid

We address the problem of video representation learning without human-annotated labels. While previous efforts address the problem by designing novel self-supervised tasks using video data, the learned features are merely on a…

计算机视觉与模式识别 · 计算机科学 2019-04-09 Jiangliu Wang , Jianbo Jiao , Linchao Bao , Shengfeng He , Yunhui Liu , Wei Liu

Traditional supervised learning methods are hitting a bottleneck because of their dependency on expensive manually labeled data and their weaknesses such as limited generalization ability and vulnerability to adversarial attacks. A…

机器学习 · 计算机科学 2021-06-08 Ran Liu

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The augmentation enables contrast with another view of a single…

机器学习 · 计算机科学 2022-11-28 Sangmin Bae , Sungnyun Kim , Jongwoo Ko , Gihun Lee , Seungjong Noh , Se-Young Yun

Self-supervised learning has recently shown great potential in vision tasks through contrastive learning, which aims to discriminate each image, or instance, in the dataset. However, such instance-level learning ignores the semantic…

计算机视觉与模式识别 · 计算机科学 2022-03-17 Tsai-Shien Chen , Wei-Chih Hung , Hung-Yu Tseng , Shao-Yi Chien , Ming-Hsuan Yang

This paper addresses the problem of self-supervised video representation learning from a new perspective -- by video pace prediction. It stems from the observation that human visual system is sensitive to video pace, e.g., slow motion, a…

计算机视觉与模式识别 · 计算机科学 2020-09-07 Jiangliu Wang , Jianbo Jiao , Yun-Hui Liu

Content creators often use music to enhance their videos, from soundtracks in movies to background music in video blogs and social media content. However, identifying the best music for a video can be a difficult and time-consuming task. To…

多媒体 · 计算机科学 2024-12-24 Shanti Stewart , Gouthaman KV , Lie Lu , Andrea Fanelli

Contrastive learning has delivered impressive results for various tasks in the self-supervised regime. However, existing approaches optimize for learning representations specific to downstream scenarios, i.e., \textit{global}…

机器学习 · 计算机科学 2021-10-29 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

We propose a self-supervised approach for learning representations of objects from monocular videos and demonstrate it is particularly useful in situated settings such as robotics. The main contributions of this paper are: 1) a…

计算机视觉与模式识别 · 计算机科学 2019-06-12 Sören Pirk , Mohi Khansari , Yunfei Bai , Corey Lynch , Pierre Sermanet

To extract robust deep representations from long sequential modeling of speech data, we propose a self-supervised learning approach, namely Contrastive Separative Coding (CSC). Our key finding is to learn such representations by separating…

音频与语音处理 · 电气工程与系统科学 2021-03-02 Jun Wang , Max W. Y. Lam , Dan Su , Dong Yu

Learning robust representations to discriminate cell phenotypes based on microscopy images is important for drug discovery. Drug development efforts typically analyse thousands of cell images to screen for potential treatments. Early works…

计算机视觉与模式识别 · 计算机科学 2021-12-28 Alexis Perakis , Ali Gorji , Samriddhi Jain , Krishna Chaitanya , Simone Rizza , Ender Konukoglu

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Videos are a rich source for self-supervised learning (SSL) of visual representations due to the presence of natural temporal transformations of objects. However, current methods typically randomly sample video clips for learning, which…

计算机视觉与模式识别 · 计算机科学 2022-09-30 Brian Chen , Ramprasaath R. Selvaraju , Shih-Fu Chang , Juan Carlos Niebles , Nikhil Naik

Upscaled video detection is a helpful tool in multimedia forensics, but it is a challenging task that involves various upscaling and compression algorithms. There are many resolution-enhancement methods, including interpolation and…

计算机视觉与模式识别 · 计算机科学 2022-05-24 Viacheslav Meshchaninov , Ivan Molodetskikh , Dmitriy Vatolin