中文
相关论文

相关论文: Contrastive Learning for Character Detection in An…

200 篇论文

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

计算与语言 · 计算机科学 2021-09-20 Haoxiang Shi , Cen Wang

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

机器学习 · 计算机科学 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Self-supervised learning (SSL) has emerged as a powerful paradigm for Chest X-ray (CXR) analysis under limited annotations. Yet, existing SSL strategies remain suboptimal for medical imaging. Masked image modeling allocates substantial…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Wangyu Feng , Shawn Young , Lijian Xu

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, the understanding of…

机器学习 · 计算机科学 2023-02-07 Amur Ghose , Yingxue Zhang , Jianye Hao , Mark Coates

Contrastive learning with the nearest neighbor has proved to be one of the most efficient self-supervised learning (SSL) techniques by utilizing the similarity of multiple instances within the same class. However, its efficacy is…

计算机视觉与模式识别 · 计算机科学 2025-04-25 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Yiyu Shi

Learning a deep model from small data is yet an opening and challenging problem. We focus on one-shot classification by deep learning approach based on a small quantity of training samples. We proposed a novel deep learning approach named…

机器学习 · 计算机科学 2018-02-13 Chuanyun Xu , Yang Zhang , Xin Feng , YongXing Ge , Yihao Zhang , Jianwu Long

Deep neural networks perform remarkably well in close-world scenarios. However, novel classes emerged continually in real applications, making it necessary to learn incrementally. Class-incremental learning (CIL) aims to gradually recognize…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Wenzhuo Liu , Fei Zhu , Cheng-Lin Liu

Single-cell RNA sequencing (scRNA-seq) data is a potent tool for comprehending the "language of life" and can provide insights into various downstream biomedical tasks. Large-scale language models (LLMs) are starting to be used for cell…

计算工程、金融与科学 · 计算机科学 2023-06-08 Suyuan Zhao , Jiahuan Zhang , Zaiqing Nie

Recently, Supervised Contrastive Learning (SCL) has been shown to achieve excellent performance in most classification tasks. In SCL, a neural network is trained to optimize two objectives: pull an anchor and positive samples together in…

计算与语言 · 计算机科学 2022-09-29 Youness Moukafih , Mounir Ghogho , Kamel Smaili

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Contrastive Language-Image Pretraining (CLIP) models maximize the mutual information between text and visual modalities to learn representations. This makes the nature of the training data a significant factor in the efficacy of CLIP for…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Maitreya Patel , Abhiram Kusumba , Sheng Cheng , Changhoon Kim , Tejas Gokhale , Chitta Baral , Yezhou Yang

Contrastive self-supervised learning (CSL) is an approach to learn useful representations by solving a pretext task that selects and compares anchor, negative and positive (APN) features from an unlabeled dataset. We present a conceptual…

计算机视觉与模式识别 · 计算机科学 2020-09-02 William Falcon , Kyunghyun Cho

What role do augmentations play in contrastive learning? Recent work suggests that good augmentations are label-preserving with respect to a specific downstream task. We complicate this picture by showing that label-destroying augmentations…

机器学习 · 计算机科学 2022-12-19 Alex Tamkin , Margalit Glasgow , Xiluo He , Noah Goodman

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Hiroshi Sasaki

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

信息检索 · 计算机科学 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Radiology reports are unstructured and contain the imaging findings and corresponding diagnoses transcribed by radiologists which include clinical facts and negated and/or uncertain statements. Extracting pathologic findings and diagnoses…

机器学习 · 计算机科学 2021-11-22 Ajay Jaiswal , Liyan Tang , Meheli Ghosh , Justin Rousseau , Yifan Peng , Ying Ding

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Contrastive losses yield state-of-the-art performance for person re-identification, face verification and few shot learning. They have recently outperformed the cross-entropy loss on classification at the ImageNet scale and outperformed all…

计算机视觉与模式识别 · 计算机科学 2020-09-08 Bharti Munjal , Sikandar Amin , Fabio Galasso