中文
相关论文

相关论文: Learning Representations with Contrastive Self-Sup…

200 篇论文

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Contrastive learning has become a key component of self-supervised learning approaches for computer vision. By learning to embed two augmented versions of the same image close to each other and to push the embeddings of different images…

计算机视觉与模式识别 · 计算机科学 2020-12-07 Yannis Kalantidis , Mert Bulent Sariyildiz , Noe Pion , Philippe Weinzaepfel , Diane Larlus

Recent advances in self-supervised learning have attracted significant attention from both machine learning and neuroscience. This is primarily because self-supervised methods do not require annotated supervisory information, making them…

神经元与认知 · 定量生物学 2025-12-05 Asaki Kataoka , Yoshihiro Nagano , Masafumi Oizumi

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

计算机视觉与模式识别 · 计算机科学 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

计算机视觉与模式识别 · 计算机科学 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Self-supervised contrastive learning is a powerful tool to learn visual representation without labels. Prior work has primarily focused on evaluating the recognition accuracy of various pre-training algorithms, but has overlooked other…

计算机视觉与模式识别 · 计算机科学 2022-06-13 Yuanyi Zhong , Haoran Tang , Junkun Chen , Jian Peng , Yu-Xiong Wang

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer…

计算机视觉与模式识别 · 计算机科学 2021-11-03 Chetan L. Srinidhi , Seung Wook Kim , Fu-Der Chen , Anne L. Martel

Data labeling is often the most challenging task when developing computational pathology models. Pathologist participation is necessary to generate accurate labels, and the limitations on pathologist time and demand for large, labeled…

定量方法 · 定量生物学 2021-11-12 Lantian Zhang , Mohamed Amgad , Lee A. D. Cooper

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

计算机视觉与模式识别 · 计算机科学 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

This work presents a novel domain adaption paradigm for studying contrastive self-supervised representation learning and knowledge transfer using remote sensing satellite data. Major state-of-the-art remote sensing visual domain efforts…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Muskaan Chopra , Prakash Chandra Chhipa , Gopal Mengi , Varun Gupta , Marcus Liwicki

Deep neural networks have reached remarkable achievements in medical image processing tasks, specifically in classifying and detecting various diseases. However, when confronted with limited data, these networks face a critical…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Matina Mahdizadeh Sani , Ali Royat , Mahdieh Soleymani Baghshah

The popularity of self-supervised learning has made it possible to train models without relying on labeled data, which saves expensive annotation costs. However, most existing self-supervised contrastive learning methods often overlook the…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Weiquan Li , Xianzhong Long , Yun Li

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

In recent years, self-supervised contrastive learning has emerged as a distinguished paradigm in the artificial intelligence landscape. It facilitates unsupervised feature learning through contrastive delineations at the instance level.…

计算机视觉与模式识别 · 计算机科学 2024-03-27 Jiansong Zhang , Linlin Shen , Peizhong Liu

Annotating histopathological images is a time-consuming andlabor-intensive process, which requires broad-certificated pathologistscarefully examining large-scale whole-slide images from cells to tissues.Recent frontiers of transfer learning…

计算机视觉与模式识别 · 计算机科学 2020-08-24 Dou Xu , Chang Cai , Chaowei Fang , Bin Kong , Jihua Zhu , Zhongyu Li