English
Related papers

Related papers: A Practical Contrastive Learning Framework for Sin…

200 papers

This work considers supervised contrastive learning for semantic segmentation. We apply contrastive learning to enhance the discriminative power of the multi-scale features extracted by semantic segmentation networks. Our key methodological…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Theodoros Pissas , Claudio S. Ravasio , Lyndon Da Cruz , Christos Bergeles

Contrastive learning methods train visual encoders by comparing views from one instance to others. Typically, the views created from one instance are set as positive, while views from other instances are negative. This binary instance…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Chongjian Ge , Jiangliu Wang , Zhan Tong , Shoufa Chen , Yibing Song , Ping Luo

Contrastive learning, a dominant self-supervised technique, emphasizes similarity in representations between augmentations of the same input and dissimilarity for different ones. Although low contrastive loss often correlates with high…

Machine Learning · Computer Science 2023-11-22 Yunzhe Zhang , Yao Lu , Qi Xuan

Contrastive learning has shown promising potential in self-supervised spatio-temporal representation learning. Most works naively sample different clips to construct positive and negative pairs. However, we observe that this formulation…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Shuangrui Ding , Rui Qian , Hongkai Xiong

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research. While recent contrastive learning strategies have focused on how to…

Machine Learning · Computer Science 2024-08-27 Xiyuan Jin , Jing Wang , Lei Liu , Youfang Lin

Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations. However, most of methods mainly focus on the instance level information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mingkai Zheng , Shan You , Fei Wang , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

We describe a method for unpaired realistic depth synthesis that learns diverse variations from the real-world depth scans and ensures geometric consistency between the synthetic and synthesized depth. The synthesized realistic depth can…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yuefan Shen , Yanchao Yang , Youyi Zheng , C. Karen Liu , Leonidas Guibas

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Super-resolution (SR) has traditionally been based on pairs of high-resolution images (HR) and their low-resolution (LR) counterparts obtained artificially with bicubic downsampling. However, in real-world SR, there is a large variety of…

Image and Video Processing · Electrical Eng. & Systems 2020-11-06 Mohammad Saeed Rad , Thomas Yu , Claudiu Musat , Hazim Kemal Ekenel , Behzad Bozorgtabar , Jean-Philippe Thiran

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pairs, for example,…

Machine Learning · Computer Science 2022-03-16 Yao-Hung Hubert Tsai , Tianqin Li , Martin Q. Ma , Han Zhao , Kun Zhang , Louis-Philippe Morency , Ruslan Salakhutdinov

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-supervised learning, especially contrastive learning, has made an outstanding contribution to the development of many deep learning research fields. Recently, researchers in the acoustic signal processing field noticed its success and…

Sound · Computer Science 2022-04-05 Dong Yao , Zhou Zhao , Shengyu Zhang , Jieming Zhu , Yudong Zhu , Rui Zhang , Xiuqiang He

We propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The mapping is represented as a deep convolutional neural network (CNN) that…

Computer Vision and Pattern Recognition · Computer Science 2015-08-03 Chao Dong , Chen Change Loy , Kaiming He , Xiaoou Tang

In recent years, tons of research has been conducted on Single Image Super-Resolution (SISR). However, to the best of our knowledge, few of these studies are mainly focused on compressed images. A problem such as complicated compression…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Agus Gunawan , Sultan Rizky Hikmawan Madjid

Many Click-Through Rate (CTR) prediction works focused on designing advanced architectures to model complex feature interactions but neglected the importance of feature representation learning, e.g., adopting a plain embedding layer for…

Information Retrieval · Computer Science 2022-12-02 Fangye Wang , Yingxu Wang , Dongsheng Li , Hansu Gu , Tun Lu , Peng Zhang , Ning Gu

Recent advancements in self-supervised learning have demonstrated that effective visual representations can be learned from unlabeled images. This has led to increased interest in applying self-supervised learning to the medical domain,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Xiangyi Yan , Junayed Naushad , Chenyu You , Hao Tang , Shanlin Sun , Kun Han , Haoyu Ma , James Duncan , Xiaohui Xie

Contrastive learning has achieved great success in self-supervised visual representation learning, but existing approaches mostly ignored spatial information which is often crucial for visual representation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xinyue Huo , Lingxi Xie , Longhui Wei , Xiaopeng Zhang , Hao Li , Zijie Yang , Wengang Zhou , Houqiang Li , Qi Tian

Contrastive Learning (CL), a leading paradigm in Self-Supervised Learning (SSL), typically relies on pairs of data views generated through augmentation. While multiple augmentations per instance (more than two) improve generalization in…

Contrastive learning is a powerful framework for learning self-supervised representations that generalize well to downstream supervised tasks. We show that multiple existing contrastive learning methods can be reinterpreted as learning…

Machine Learning · Computer Science 2023-02-16 Daniel D. Johnson , Ayoub El Hanchi , Chris J. Maddison