English
Related papers

Related papers: An Empirical Study on Improving SimCLR's Nonlinear…

200 papers

Currently intelligent diagnosis systems lack the ability of continually learning to diagnose new diseases once deployed, under the condition of preserving old disease knowledge. In particular, updating an intelligent diagnosis system with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Wentao Zhang , Yujun Huang , Tong Zhang , Qingsong Zou , Wei-Shi Zheng , Ruixuan Wang

This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sample two apartment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Raynor Kirkson E. Chavez , Kyle Gabriel M. Reynoso

The benefit of pretrained autoencoders for reinforcement learning in comparison to training on raw observations is already known [1]. In this paper, we address the generation of a compact and information-rich state representation. In…

Robotics · Computer Science 2021-03-09 Christopher Gebauer , Maren Bennewitz

This paper presents Contrastive Reconstruction, ConRec - a self-supervised learning algorithm that obtains image representations by jointly optimizing a contrastive and a self-reconstruction loss. We showcase that state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Jonas Dippel , Steffen Vogler , Johannes Höhne

In Computer Vision, self-supervised contrastive learning enforces similar representations between different views of the same image. The pre-training is most often performed on image classification datasets, like ImageNet, where images…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Benjamin Missaoui , Chongbin Yuan

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng

Recently, contrastive learning has risen to be a promising paradigm for extracting meaningful data representations. Among various special designs, adding a projection head on top of the encoder during training and removing it for downstream…

Machine Learning · Computer Science 2025-03-05 Zhuo Ouyang , Kaiwen Hu , Qi Zhang , Yifei Wang , Yisen Wang

Contrastive learning has emerged as a pivotal framework for representation learning, underpinning advances in both unimodal and bimodal applications like SimCLR and CLIP. To address fundamental limitations like large batch size dependency…

Machine Learning · Computer Science 2024-12-12 Ajay Jagannath , Aayush Upadhyay , Anant Mehta

Self-supervised learning (SSL) aims to produce useful feature representations without access to any human-labeled data annotations. Due to the success of recent SSL methods based on contrastive learning, such as SimCLR, this problem has…

Machine Learning · Computer Science 2022-12-23 Kartik Gupta , Thalaiyasingam Ajanthan , Anton van den Hengel , Stephen Gould

Unsupervised learning has been a long-standing goal of machine learning and is especially important for medical image analysis, where the learning can compensate for the scarcity of labeled datasets. A promising subclass of unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2021-09-09 Ozan Ciga , Tony Xu , Anne L. Martel

In recent years, pretrained models revolutionized the paradigm of natural language understanding (NLU), where we append a randomly initialized classification head after the pretrained backbone, e.g. BERT, and finetune the whole model. As…

Computation and Language · Computer Science 2023-03-29 Zhuoyi Yang , Ming Ding , Yanhui Guo , Qingsong Lv , Jie Tang

Vision models pretrained on large-scale RGB natural image datasets are widely reused for electron microscopy image segmentation. In electron microscopy, volumetric data are acquired as serial sections and processed as stacks of adjacent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zsófia Molnár , Gergely Szabó , András Horváth

This thesis investigates the effectiveness of SimCLR, a contrastive learning technique, in Greek letter recognition, focusing on the impact of various augmentation techniques. We pretrain the SimCLR backbone using the Alpub dataset…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Vedasri Nakka , Andreas Fischer , Rolf Ingold , Lars Vogtlin

In contrastive learning, two views of an original image, generated by different augmentations, are considered a positive pair, and their similarity is required to be high. Similarly, two views of distinct images form a negative pair, with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Lei Wang , Piotr Koniusz , Tom Gedeon , Liang Zheng

Enforcing complex (e.g., nonconvex) operational constraints is a critical challenge in real-world learning and control systems. However, existing methods struggle to efficiently enforce general classes of constraints. To address this, we…

Machine Learning · Computer Science 2026-04-07 Maria Chzhen , Priya L. Donti

When existing retrieval-augmented generation (RAG) solutions are intended to be used for new knowledge domains, it is necessary to update their encoders, which are taken to be pretrained large language models (LLMs). However, fully…

Machine Learning · Computer Science 2025-09-23 Marijan Fofonjka , Shahryar Zehtabi , Alireza Behtash , Tyler Mauer , David Stout

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

In recent years, self-supervised learning (SSL) has emerged as a promising approach for extracting valuable representations from unlabeled data. One successful SSL method is contrastive learning, which aims to bring positive examples closer…

Machine Learning · Computer Science 2023-07-20 Zeen Song , Xingzhe Su , Jingyao Wang , Wenwen Qiang , Changwen Zheng , Fuchun Sun

In this paper, we propose a method to improve prediction accuracy of semantic segmentation methods as follows: (1) construct a neural network that has pre-processing layers based on a convolutional autoencoder ahead of a semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Hisashi Shimodaira

Recent advancements in contrastive learning have revolutionized self-supervised representation learning and achieved state-of-the-art performance on benchmark tasks. While most existing methods focus on applying contrastive learning to…

Machine Learning · Computer Science 2024-04-16 Lihui Liu , Jinha Kim , Vidit Bansal