中文
相关论文

相关论文: MaskCon: Masked Contrastive Learning for Coarse-La…

200 篇论文

The success of deep learning heavily depends on the availability of large labeled training sets. However, it is hard to get large labeled datasets in medical image domain because of the strict privacy concern and costly labeling efforts.…

计算机视觉与模式识别 · 计算机科学 2021-09-30 Dewen Zeng , Yawen Wu , Xinrong Hu , Xiaowei Xu , Haiyun Yuan , Meiping Huang , Jian Zhuang , Jingtong Hu , Yiyu Shi

In neutrino physics, analyses often depend on large simulated datasets, making it essential for models to generalise effectively to real-world detector data. Contrastive learning, a well-established technique in deep learning, offers a…

高能物理 - 实验 · 物理学 2025-05-23 Alex Wilkinson , Radi Radev , Saul Alonso-Monsalve

Contrastive learning methods enforce label distance relationships in feature space to improve representation capability for regression models. However, these methods highly depend on label information to correctly recover ordinal…

机器学习 · 计算机科学 2025-12-11 Ce Wang , Weihang Dai , Hanru Bai , Xiaomeng Li

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Learning scientific document representations can be substantially improved through contrastive learning objectives, where the challenge lies in creating positive and negative training samples that encode the desired similarity semantics.…

计算与语言 · 计算机科学 2022-10-20 Malte Ostendorff , Nils Rethmeier , Isabelle Augenstein , Bela Gipp , Georg Rehm

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

机器学习 · 计算机科学 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Recently, contrastive self-supervised learning has become a key component for learning visual representations across many computer vision tasks and benchmarks. However, contrastive learning in the context of domain adaptation remains…

计算机视觉与模式识别 · 计算机科学 2021-06-25 Mamatha Thota , Georgios Leontidis

The deep learning technique has been shown to be effectively addressed several image analysis tasks in the computer-aided diagnosis scheme for mammography. The training of an efficacious deep learning model requires large data with diverse…

计算机视觉与模式识别 · 计算机科学 2023-09-08 Zheren Li , Zhiming Cui , Lichi Zhang , Sheng Wang , Chenjin Lei , Xi Ouyang , Dongdong Chen , Xiangyu Zhao , Yajia Gu , Zaiyi Liu , Chunling Liu , Dinggang Shen , Jie-Zhi Cheng

In this paper, we introduce a contrastive learning framework for keypoint detection (CoKe). Keypoint detection differs from other visual tasks where contrastive learning has been applied because the input is a set of images in which…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Yutong Bai , Angtian Wang , Adam Kortylewski , Alan Yuille

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data sparsity and…

信息检索 · 计算机科学 2023-10-12 Mengyuan Jing , Yanmin Zhu , Tianzi Zang , Ke Wang

Recently, representation learning with contrastive learning algorithms has been successfully applied to challenging unlabeled datasets. However, these methods are unable to distinguish important features from unimportant ones under simply…

计算机视觉与模式识别 · 计算机科学 2024-08-12 Toshiyuki Oshima , Kentaro Takagi , Kouta Nakata

Cross-modality distillation arises as an important topic for data modalities containing limited knowledge such as depth maps and high-quality sketches. Such techniques are of great importance, especially for memory and privacy-restricted…

机器学习 · 计算机科学 2024-05-29 Hangyu Lin , Chen Liu , Chengming Xu , Zhengqi Gao , Yanwei Fu , Yuan Yao

We study Online Continual Learning with missing labels and propose SemiCon, a new contrastive loss designed for partly labeled data. We demonstrate its efficiency by devising a memory-based method trained on an unlabeled data stream, where…

机器学习 · 计算机科学 2022-11-23 Nicolas Michel , Romain Negrel , Giovanni Chierchia , Jean-François Bercher

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

Chromosome recognition is an essential task in karyotyping, which plays a vital role in birth defect diagnosis and biomedical research. However, existing classification methods face significant challenges due to the inter-class similarity…

计算机视觉与模式识别 · 计算机科学 2023-12-14 Ruijia Chang , Suncheng Xiang , Chengyu Zhou , Kui Su , Dahong Qian , Jun Wang

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Representation learning has significantly been developed with the advance of contrastive learning methods. Most of those methods have benefited from various data augmentations that are carefully designated to maintain their identities so…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Xiao Wang , Guo-Jun Qi

Tremendous progress has been made in visual representation learning, notably with the recent success of self-supervised contrastive learning methods. Supervised contrastive learning has also been shown to outperform its cross-entropy…

计算机视觉与模式识别 · 计算机科学 2021-08-17 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Richard Radke , Rogerio Feris

The effectiveness of contrastive learning technology in natural language processing tasks is yet to be explored and analyzed. How to construct positive and negative samples correctly and reasonably is the core challenge of contrastive…

计算与语言 · 计算机科学 2023-07-17 Nankai Lin , Guanqiu Qin , Jigang Wang , Aimin Yang , Dong Zhou