中文
相关论文

相关论文: Contrastive Learning for Regression on Hyperspectr…

200 篇论文

As a seminal tool in self-supervised representation learning, contrastive learning has gained unprecedented attention in recent years. In essence, contrastive learning aims to leverage pairs of positive and negative samples for…

机器学习 · 计算机科学 2022-02-01 Ching-Yun Ko , Jeet Mohapatra , Sijia Liu , Pin-Yu Chen , Luca Daniel , Lily Weng

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

计算机视觉与模式识别 · 计算机科学 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

机器学习 · 统计学 2025-10-15 Licong Lin , Song Mei

Contrastive learning has made considerable progress in computer vision, outperforming supervised pretraining on a range of downstream datasets. However, is contrastive learning the better choice in all situations? We demonstrate two cases…

计算机视觉与模式识别 · 计算机科学 2021-12-13 Ananya Karthik , Mike Wu , Noah Goodman , Alex Tamkin

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

机器学习 · 计算机科学 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Contrastive representation learning, which aims to learnthe shared information between different views of unlabeled data by maximizing the mutual information between them, has shown its powerful competence in self-supervised learning for…

机器学习 · 计算机科学 2024-08-21 Xuechu Yu

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

机器学习 · 计算机科学 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

机器学习 · 计算机科学 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Contrastive Learning (CL) has emerged as a powerful method for training feature extraction models using unlabeled data. Recent studies suggest that incorporating a linear projection head post-backbone significantly enhances model…

机器学习 · 计算机科学 2024-10-08 Huanran Li , Daniel Pimentel-Alarcón

What matters for contrastive learning? We argue that contrastive learning heavily relies on informative features, or "hard" (positive or negative) features. Early works include more informative features by applying complex data…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Hui Xiong

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

计算机视觉与模式识别 · 计算机科学 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

机器学习 · 计算机科学 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learned representations:…

机器学习 · 统计学 2023-01-18 Kyungmin Lee , Jinwoo Shin

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

This paper presents a self-supervised feature learning method for hyperspectral image classification. Our method tries to construct two different views of the raw hyperspectral image through a cross-representation learning method. And then…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Anyu Zhang , Haotian Wu , Zeyu Cao

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Contrastive learning is an efficient approach to self-supervised representation learning. Although recent studies have made progress in the theoretical understanding of contrastive learning, the investigation of how to characterize the…

机器学习 · 计算机科学 2023-08-21 Hiroki Waida , Yuichiro Wada , Léo Andéol , Takumi Nakagawa , Yuhui Zhang , Takafumi Kanamori

Contrastive learning is among the most popular and powerful approaches for self-supervised representation learning, where the goal is to map semantically similar samples close together while separating dissimilar ones in the latent space.…

机器学习 · 统计学 2025-12-03 Ali Alvandi , Mina Rezaei