中文
相关论文

相关论文: Whitening for Self-Supervised Representation Learn…

200 篇论文

Self-supervised learning (SSL) provides a promising alternative for representation learning on hypergraphs without costly labels. However, existing hypergraph SSL models are mostly based on contrastive methods with the instance-level…

机器学习 · 计算机科学 2024-04-19 Fan Li , Xiaoyang Wang , Dawei Cheng , Wenjie Zhang , Ying Zhang , Xuemin Lin

Sentence Representation Learning (SRL) is a crucial task in Natural Language Processing (NLP), where contrastive Self-Supervised Learning (SSL) is currently a mainstream approach. However, the reasons behind its remarkable effectiveness…

计算与语言 · 计算机科学 2024-06-06 Mingxin Li , Richong Zhang , Zhijie Nie

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

计算机视觉与模式识别 · 计算机科学 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

Self-Supervised Learning (SSL) is an increasingly popular ML paradigm that trains models to transform complex inputs into representations without relying on explicit labels. These representations encode similarity structures that enable…

机器学习 · 计算机科学 2022-06-30 Adam Dziedzic , Nikita Dhawan , Muhammad Ahmad Kaleem , Jonas Guan , Nicolas Papernot

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

计算机视觉与模式识别 · 计算机科学 2022-08-19 Shentong Mo , Zhun Sun , Chao Li

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Self-supervised learning (SSL) methods have achieved remarkable success in learning image representations allowing invariances in them - but therefore discarding transformation information that some computer vision tasks actually require.…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Qin Wang , Alessio Quercia , Benjamin Bruns , Abigail Morrison , Hanno Scharr , Kai Krajsek

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Yun-Hao Cao , Jianxin Wu

Writer independent offline signature verification is one of the most challenging tasks in pattern recognition as there is often a scarcity of training data. To handle such data scarcity problem, in this paper, we propose a novel…

计算机视觉与模式识别 · 计算机科学 2022-07-13 Siladittya Manna , Soumitri Chattopadhyay , Saumik Bhattacharya , Umapada Pal

Self-supervised learning (SSL) has recently shown remarkable results in closing the gap between supervised and unsupervised learning. The idea is to learn robust features that are invariant to distortions of the input data. Despite its…

声音 · 计算机科学 2023-03-08 Bac Nguyen , Stefan Uhlich , Fabien Cardinaux

Self-supervised learning (SSL) has recently achieved tremendous empirical advancements in learning image representation. However, our understanding of the principle behind learning such a representation is still limited. This work shows…

计算机视觉与模式识别 · 计算机科学 2023-06-14 Yubei Chen , Adrien Bardes , Zengyi Li , Yann LeCun

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

机器学习 · 计算机科学 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

Self-supervised representation learning has made significant leaps fueled by progress in contrastive learning, which seeks to learn transformations that embed positive input pairs nearby, while pushing negative pairs far apart. While…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Tri Huynh , Simon Kornblith , Matthew R. Walter , Michael Maire , Maryam Khademi

Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images,…

计算机视觉与模式识别 · 计算机科学 2023-01-25 Yinheng Li , Han Ding , Shaofei Wang

Self-supervised learning enables networks to learn discriminative features from massive data itself. Most state-of-the-art methods maximize the similarity between two augmentations of one image based on contrastive learning. By utilizing…

计算机视觉与模式识别 · 计算机科学 2023-07-05 Jidong Ge , Yuxiang Liu , Jie Gui , Lanting Fang , Ming Lin , James Tin-Yau Kwok , LiGuo Huang , Bin Luo

Recent successes in self-supervised learning (SSL) model spatial co-occurrences of visual features either by masking portions of an image or by aggressively cropping it. Here, we propose a new way to model spatial co-occurrences by aligning…

机器学习 · 计算机科学 2025-01-07 Arthur Aubret , Céline Teulière , Jochen Triesch

Self-supervised learning (SSL) methods via joint embedding architectures have proven remarkably effective at capturing semantically rich representations with strong clustering properties, magically in the absence of label supervision.…

机器学习 · 计算机科学 2025-05-13 Xi Weng , Jianing An , Xudong Ma , Binhang Qi , Jie Luo , Xi Yang , Jin Song Dong , Lei Huang

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

计算机视觉与模式识别 · 计算机科学 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Shubham Gupta , Rahul Kunigal Ravishankar , Madhoolika Gangaraju , Poojasree Dwarkanath , Natarajan Subramanyam