English
Related papers

Related papers: CoCon: Cooperative-Contrastive Learning

200 papers

Learning to recognize actions from only a handful of labeled videos is a challenging problem due to the scarcity of tediously collected activity labels. We approach this problem by learning a two-pathway temporal contrastive model using…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Ankit Singh , Omprakash Chakraborty , Ashutosh Varshney , Rameswar Panda , Rogerio Feris , Kate Saenko , Abir Das

Contrastive learning has shown promising potential in self-supervised spatio-temporal representation learning. Most works naively sample different clips to construct positive and negative pairs. However, we observe that this formulation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Shuangrui Ding , Rui Qian , Hongkai Xiong

Cross-age facial images are typically challenging and expensive to collect, making noise-free age-oriented datasets relatively small compared to widely-used large-scale facial datasets. Additionally, in real scenarios, images of the same…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Haoyi Wang , Victor Sanchez , Chang-Tsun Li

Contrastive Learning has recently received interest due to its success in self-supervised representation learning in the computer vision domain. However, the origins of Contrastive Learning date as far back as the 1990s and its development…

Machine Learning · Computer Science 2020-10-29 Phuc H. Le-Khac , Graham Healy , Alan F. Smeaton

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

Machine Learning · Computer Science 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL approach to the supervised setting is not fully explored,…

Computation and Language · Computer Science 2022-05-23 Zhenyu Zhang , Yuming Zhao , Meng Chen , Xiaodong He

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain has attracted much attention in recent years. While many domain adaptation techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Aadarsh Sahoo , Rutav Shah , Rameswar Panda , Kate Saenko , Abir Das

In this work, we leverage estimated depth to boost self-supervised contrastive learning for segmentation of urban scenes, where unlabeled videos are readily available for training self-supervised depth estimation. We argue that the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Liang Zeng , Attila Lengyel , Nergis Tömen , Jan van Gemert

Generated video scenes for action-centric sequence descriptions, such as recipe instructions and do-it-yourself projects, often include non-linear patterns, where the next video may need to be visually consistent not with the immediately…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Vasco Ramos , Yonatan Bitton , Michal Yarom , Idan Szpektor , Joao Magalhaes

Facial action unit (AU) detection, aiming to classify AU present in the facial image, has long suffered from insufficient AU annotations. In this paper, we aim to mitigate this data scarcity issue by learning AU representations from a large…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Yong Li , Shiguang Shan

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

Machine Learning · Computer Science 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

This paper strives for self-supervised learning of a feature space suitable for skeleton-based action recognition. Our proposal is built upon learning invariances to input skeleton representations and various skeleton augmentations via a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Fida Mohammad Thoker , Hazel Doughty , Cees G. M. Snoek

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Recently, representation learning with contrastive learning algorithms has been successfully applied to challenging unlabeled datasets. However, these methods are unable to distinguish important features from unimportant ones under simply…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Toshiyuki Oshima , Kentaro Takagi , Kouta Nakata

Many real-world applications involve data from multiple modalities and thus exhibit the view heterogeneity. For example, user modeling on social media might leverage both the topology of the underlying social network and the content of the…

Machine Learning · Computer Science 2021-02-16 Lecheng Zheng , Yu Cheng , Hongxia Yang , Nan Cao , Jingrui He

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin
‹ Prev 1 8 9 10 Next ›