中文
相关论文

相关论文: Refining Self-Supervised Learning in Imaging: Beyo…

200 篇论文

We propose a semantic similarity metric for image registration. Existing metrics like Euclidean Distance or Normalized Cross-Correlation focus on aligning intensity values, giving difficulties with low intensity contrast or noise. Our…

机器学习 · 计算机科学 2021-04-21 Steffen Czolbe , Oswin Krause , Aasa Feragen

Single-shot diffraction imaging of isolated nanosized particles has seen remarkable success in recent years, yielding in-situ measurements with ultra-high spatial and temporal resolution. The progress of high-repetition-rate sources for…

原子与分子团簇 · 物理学 2022-08-26 Julian Zimmermann , Fabien Beguet , Daniel Guthruf , Bruno Langbehn , Daniela Rupp

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Jiale Chen

Given a similarity metric, contrastive methods learn a representation in which examples that are similar are pushed together and examples that are dissimilar are pulled apart. Contrastive learning techniques have been utilized extensively…

机器学习 · 计算机科学 2023-07-07 Emily Mu , John Guttag , Maggie Makar

Semi-supervised learning is an important and active topic of research in pattern recognition. For classification using linear discriminant analysis specifically, several semi-supervised variants have been proposed. Using any one of these…

机器学习 · 统计学 2014-11-18 Jesse H. Krijthe , Marco Loog

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

机器学习 · 计算机科学 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

Contrastive learning methods have significantly narrowed the gap between supervised and unsupervised learning on computer vision tasks. In this paper, we explore their application to geo-located datasets, e.g. remote sensing, where…

计算机视觉与模式识别 · 计算机科学 2022-03-09 Kumar Ayush , Burak Uzkent , Chenlin Meng , Kumar Tanmay , Marshall Burke , David Lobell , Stefano Ermon

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

机器学习 · 计算机科学 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

计算机视觉与模式识别 · 计算机科学 2026-02-09 Salma Haidar , José Oramas

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

机器学习 · 计算机科学 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Contrastive pre-training on distant supervision has shown remarkable effectiveness in improving supervised relation extraction tasks. However, the existing methods ignore the intrinsic noise of distant supervision during the pre-training…

计算与语言 · 计算机科学 2023-02-13 Zhen Wan , Fei Cheng , Qianying Liu , Zhuoyuan Mao , Haiyue Song , Sadao Kurohashi

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Contrastive learning is among the most successful methods for visual representation learning, and its performance can be further improved by jointly performing clustering on the learned representations. However, existing methods for joint…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Shunjie-Fabian Zheng , JaeEun Nam , Emilio Dorigatti , Bernd Bischl , Shekoofeh Azizi , Mina Rezaei

Contrastive learning, along with its variations, has been a highly effective self-supervised learning method across diverse domains. Contrastive learning measures the distance between representations using cosine similarity and uses…

机器学习 · 计算机科学 2023-10-11 Daniel Rho , TaeSoo Kim , Sooill Park , Jaehyun Park , JaeHan Park

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

机器学习 · 计算机科学 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

As a seminal tool in self-supervised representation learning, contrastive learning has gained unprecedented attention in recent years. In essence, contrastive learning aims to leverage pairs of positive and negative samples for…

机器学习 · 计算机科学 2022-02-01 Ching-Yun Ko , Jeet Mohapatra , Sijia Liu , Pin-Yu Chen , Luca Daniel , Lily Weng

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella