English
Related papers

Related papers: Divide and Contrast: Self-supervised Learning from…

200 papers

Face deepfake detection has seen impressive results recently. Nearly all existing deep learning techniques for face deepfake detection are fully supervised and require labels during training. In this paper, we design a novel deepfake…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Sheldon Fung , Xuequan Lu , Chao Zhang , Chang-Tsun Li

Unsupervised learning technology has caught up with or even surpassed supervised learning technology in general object classification (GOC) and person re-identification (re-ID). However, it is found that the unsupervised learning of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Jiabao Wang , Yang Li , Xiu-Shen Wei , Hang Li , Zhuang Miao , Rui Zhang

Most previous approaches for analyzing food images have relied on extensively annotated datasets, resulting in significant human labeling expenses due to the varied and intricate nature of such images. Inspired by the effectiveness of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Xinda Liu , Yaohui Zhu , Linhu Liu , Jiang Tian , Lili Wang

Recent progress in contrastive learning has revolutionized unsupervised representation learning. Concretely, multiple views (augmentations) from the same image are encouraged to map to the similar embeddings, while views from different…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Nanxuan Zhao , Zhirong Wu , Rynson W. H. Lau , Stephen Lin

Building accurate and robust artificial intelligence systems for medical image assessment requires not only the research and design of advanced deep learning models but also the creation of large and curated sets of annotated training…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Florin C. Ghesu , Bogdan Georgescu , Awais Mansoor , Youngjin Yoo , Dominik Neumann , Pragneshkumar Patel , R. S. Vishwanath , James M. Balter , Yue Cao , Sasa Grbic , Dorin Comaniciu

Self-supervised learning (SSL) has rapidly emerged as a transformative approach in computer vision, enabling the extraction of rich feature representations from vast amounts of unlabeled data and reducing reliance on costly manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Nikolaos Giakoumoglou , Tania Stathaki , Athanasios Gkelias

A key requirement for the success of supervised deep learning is a large labeled dataset - a condition that is difficult to meet in medical image analysis. Self-supervised learning (SSL) can help in this regard by providing a strategy to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Krishna Chaitanya , Ertunc Erdil , Neerav Karani , Ender Konukoglu

A promising direction in deep learning research consists in learning representations and simultaneously discovering cluster structure in unlabeled data by optimizing a discriminative loss function. As opposed to supervised deep learning,…

Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and rely on a large…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Mathilde Caron , Ishan Misra , Julien Mairal , Priya Goyal , Piotr Bojanowski , Armand Joulin

Recently, contrastive learning has risen to be a promising approach for large-scale self-supervised learning. However, theoretical understanding of how it works is still unclear. In this paper, we propose a new guarantee on the downstream…

Machine Learning · Computer Science 2022-05-30 Yifei Wang , Qi Zhang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Contrastive Learning (CL) has achieved impressive performance in self-supervised learning tasks, showing superior generalization ability. Inspired by the success, adopting CL into collaborative filtering (CF) is prevailing in…

Information Retrieval · Computer Science 2023-10-31 An Zhang , Leheng Sheng , Zhibo Cai , Xiang Wang , Tat-Seng Chua

Existing text recognition methods usually need large-scale training data. Most of them rely on synthetic training data due to the lack of annotated real images. However, there is a domain gap between the synthetic data and real data, which…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Mingkun Yang , Minghui Liao , Pu Lu , Jing Wang , Shenggao Zhu , Hualin Luo , Qi Tian , Xiang Bai

Previous studies dominantly target at self-supervised learning on real-valued networks and have achieved many promising results. However, on the more challenging binary neural networks (BNNs), this task has not yet been fully explored in…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Zhiqiang Shen , Zechun Liu , Jie Qin , Lei Huang , Kwang-Ting Cheng , Marios Savvides

Self-supervised learning algorithms based on instance discrimination train encoders to be invariant to pre-defined transformations of the same instance. While most methods treat different views of the same image as positives for a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Debidatta Dwibedi , Yusuf Aytar , Jonathan Tompson , Pierre Sermanet , Andrew Zisserman

Contrastive Learning (CL) has been successfully applied to classification and other downstream tasks related to concrete concepts, such as objects contained in the ImageNet dataset. No attempts seem to have been made so far in applying this…

Machine Learning · Computer Science 2025-05-30 Daniel N. Nissani

Contrastive learning has become an important tool in learning representations from unlabeled data mainly relying on the idea of minimizing distance between positive data pairs, e.g., views from the same images, and maximizing distance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Nina Shvetsova , Felix Petersen , Anna Kukleva , Bernt Schiele , Hilde Kuehne

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

Computation and Language · Computer Science 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The augmentation enables contrast with another view of a single…

Machine Learning · Computer Science 2022-11-28 Sangmin Bae , Sungnyun Kim , Jongwoo Ko , Gihun Lee , Seungjong Noh , Se-Young Yun