中文
相关论文

相关论文: Crafting Better Contrastive Views for Siamese Repr…

200 篇论文

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Xia Xu , Jochen Triesch

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Masked image modelling (e.g., Masked AutoEncoder) and contrastive learning (e.g., Momentum Contrast) have shown impressive performance on unsupervised visual representation learning. This work presents Masked Contrastive Representation…

计算机视觉与模式识别 · 计算机科学 2022-11-14 Yuchong Yao , Nandakishor Desai , Marimuthu Palaniswami

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

Contrastive learning have been widely used as pretext tasks for self-supervised pre-trained molecular representation learning models in AI-aided drug design and discovery. However, exiting methods that generate molecular views by…

生物大分子 · 定量生物学 2023-03-14 Ziqiao Zhang , Ailin Xie , Jihong Guan , Shuigeng Zhou

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

机器学习 · 计算机科学 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

Self-supervised learning (SSL) has delivered superior performance on a variety of downstream vision tasks. Two main-stream SSL frameworks have been proposed, i.e., Instance Discrimination (ID) and Masked Image Modeling (MIM). ID pulls…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Chenxin Tao , Xizhou Zhu , Weijie Su , Gao Huang , Bin Li , Jie Zhou , Yu Qiao , Xiaogang Wang , Jifeng Dai

Recent approaches in self-supervised learning of image representations can be categorized into different families of methods and, in particular, can be divided into contrastive and non-contrastive approaches. While differences between the…

机器学习 · 计算机科学 2023-06-27 Quentin Garrido , Yubei Chen , Adrien Bardes , Laurent Najman , Yann Lecun

Contrastive learning has emerged as a prominent branch of self-supervised learning for several years. Especially, CLIP, which applies contrastive learning to large sets of captioned images, has garnered significant attention. Recently,…

机器学习 · 计算机科学 2024-02-21 Chungpa Lee , Joonhwan Chang , Jy-yong Sohn

In recent years, self-supervised learning has had significant success in applications involving computer vision and natural language processing. The type of pretext task is important to this boost in performance. One common pretext task is…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Ademola Okerinde , Sam Hoggatt , Divya Vani Lakkireddy , Nolan Brubaker , William Hsu , Lior Shamir , Brian Spiesman

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Weakly supervised person search aims to perform joint pedestrian detection and re-identification (re-id) with only person bounding-box annotations. Recently, the idea of contrastive learning is initially applied to weakly supervised person…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Jiabei Wang , Yanwei Pang , Jiale Cao , Hanqing Sun , Zhuang Shao , Xuelong Li

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Gang Wu , Junjun Jiang , Xianming Liu

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

计算机视觉与模式识别 · 计算机科学 2021-05-14 Haiping Wu , Xiaolong Wang

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Contrastive learning typically matches pairs of related views among a number of unrelated negative views. Views can be generated (e.g. by augmentations) or be observed. We investigate matching when there are more than two related views…

机器学习 · 计算机科学 2024-03-11 Amitis Shidani , Devon Hjelm , Jason Ramapuram , Russ Webb , Eeshan Gunesh Dhekane , Dan Busbridge

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research. While recent contrastive learning strategies have focused on how to…

机器学习 · 计算机科学 2024-08-27 Xiyuan Jin , Jing Wang , Lei Liu , Youfang Lin

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

计算机视觉与模式识别 · 计算机科学 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin