中文
相关论文

相关论文: Contrastive Learning Is Spectral Clustering On Sim…

200 篇论文

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

机器学习 · 计算机科学 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Contrastive learning has revolutionized the field of computer vision, learning rich representations from unlabeled data, which generalize well to diverse vision tasks. Consequently, it has become increasingly important to explain these…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Fawaz Sammani , Boris Joukovsky , Nikos Deligiannis

A common problem in contextual preference ranking is that a single preferred action is compared against several choices, thereby blowing up the complexity and skewing the preference distribution. In this work, we show how one can solve this…

人工智能 · 计算机科学 2024-07-09 Timo Bertram , Johannes Fürnkranz , Martin Müller

Subspace clustering aims to group data points that lie in a union of low-dimensional subspaces and finds wide application in computer vision, hyperspectral imaging, and recommendation systems. However, most existing methods assume fully…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Huanran Li , Daniel Pimentel-Alarcón

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

计算机视觉与模式识别 · 计算机科学 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Contrastive learning is a well-established paradigm in representation learning. The standard framework of contrastive learning minimizes the distance between "similar" instances and maximizes the distance between dissimilar ones in the…

机器学习 · 计算机科学 2025-02-06 Naghmeh Ghanooni , Barbod Pajoum , Harshit Rawal , Sophie Fellenz , Vo Nguyen Le Duy , Marius Kloft

Graph Neural Networks (GNNs) have received extensive research attention due to their powerful information aggregation capabilities. Despite the success of GNNs, most of them suffer from the popularity bias issue in a graph caused by a small…

机器学习 · 计算机科学 2024-08-02 Yuntao Shou , Haozhi Lan , Xiangyong Cao

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

计算机视觉与模式识别 · 计算机科学 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

Contrastive learning has emerged as a prominent branch of self-supervised learning for several years. Especially, CLIP, which applies contrastive learning to large sets of captioned images, has garnered significant attention. Recently,…

机器学习 · 计算机科学 2024-02-21 Chungpa Lee , Joonhwan Chang , Jy-yong Sohn

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong

Self-supervised contrastive learning offers a means of learning informative features from a pool of unlabeled data. In this paper, we delve into another useful approach -- providing a way of selecting a core-set that is entirely unlabeled.…

机器学习 · 计算机科学 2021-04-08 Jeongwoo Ju , Heechul Jung , Yoonju Oh , Junmo Kim

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

计算与语言 · 计算机科学 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

机器学习 · 计算机科学 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

We present a collaborative learning method called Mutual Contrastive Learning (MCL) for general visual representation learning. The core idea of MCL is to perform mutual interaction and transfer of contrastive distributions among a cohort…

计算机视觉与模式识别 · 计算机科学 2022-01-19 Chuanguang Yang , Zhulin An , Linhang Cai , Yongjun Xu

Various graph contrastive learning models have been proposed to improve the performance of learning tasks on graph datasets in recent years. While effective and prevalent, these models are usually carefully customized. In particular,…

机器学习 · 计算机科学 2021-11-01 Dongkuan Xu , Wei Cheng , Dongsheng Luo , Haifeng Chen , Xiang Zhang

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize CSL with a loss…

计算机视觉与模式识别 · 计算机科学 2022-10-20 Shentong Mo , Zhun Sun , Chao Li