中文
相关论文

相关论文: Contrastive learning-based pretraining improves re…

200 篇论文

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

计算与语言 · 计算机科学 2021-09-20 Haoxiang Shi , Cen Wang

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Aritra Ghosh , Andrew Lan

Contrastive learning is a representation learning method performed by contrasting a sample to other similar samples so that they are brought closely together, forming clusters in the feature space. The learning process is typically…

机器学习 · 计算机科学 2022-09-28 Valentino Vito , Lim Yohanes Stefanus

The prevalence of ocular illnesses is growing globally, presenting a substantial public health challenge. Early detection and timely intervention are crucial for averting visual impairment and enhancing patient prognosis. This research…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Shramana Dey , Pallabi Dutta , Riddhasree Bhattacharyya , Surochita Pal , Sushmita Mitra , Rajiv Raman

Objective: Optical coherence tomography (OCT) and its angiography (OCTA) have several advantages for the early detection and diagnosis of diabetic retinopathy (DR). However, automated, complete DR classification frameworks based on both OCT…

图像与视频处理 · 电气工程与系统科学 2020-09-28 Pengxiao Zang , Liqin Gao , Tristan T. Hormel , Jie Wang , Qisheng You , Thomas S. Hwang , Yali Jia

Noisy labels hurt deep learning-based supervised image classification performance as the models may overfit the noise and learn corrupted feature extractors. For natural image classification training with noisy labeled data, model…

图像与视频处理 · 电气工程与系统科学 2023-08-10 Bidur Khanal , Binod Bhattarai , Bishesh Khanal , Cristian A. Linte

Semi-supervised learning utilizes insights from unlabeled data to improve model generalization, thereby reducing reliance on large labeled datasets. Most existing studies focus on limited samples and fail to capture the overall data…

计算机视觉与模式识别 · 计算机科学 2025-03-13 Xiuzhen Guo , Lianyuan Yu , Ji Shi , Na Lei , Hongxiao Wang

Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets. However, natural data could be highly correlated and…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Xudong Wang , Ziwei Liu , Stella X. Yu

Purpose: Identifying intravenous (IV) contrast use within CT scans is a key component of data curation for model development and testing. Currently, IV contrast is poorly documented in imaging metadata and necessitates manual correction and…

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

计算机视觉与模式识别 · 计算机科学 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

We investigate the utility of pretraining by contrastive self supervised learning on both natural-scene and medical imaging datasets when the unlabeled dataset size is small, or when the diversity within the unlabeled set does not lead to…

图像与视频处理 · 电气工程与系统科学 2021-09-07 Ozan Ciga , Tony Xu , Anne L. Martel

Well-annotated medical datasets enable deep neural networks (DNNs) to gain strong power in extracting lesion-related features. Building such large and well-designed medical datasets is costly due to the need for high-level expertise. Model…

计算机视觉与模式识别 · 计算机科学 2022-12-09 Yixiong Chen , Chunhui Zhang , Chris H. Q. Ding , Li Liu

For anomaly detection (AD), early approaches often train separate models for individual classes, yielding high performance but posing challenges in scalability and resource management. Recent efforts have shifted toward training a single…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Lei Fan , Junjie Huang , Donglin Di , Anyang Su , Tianyou Song , Maurice Pagnucco , Yang Song

Recently, diabetic retinopathy (DR) screening utilizing ultra-wide optical coherence tomography angiography (UW-OCTA) has been used in clinical practices to detect signs of early DR. However, developing a deep learning-based DR analysis…

图像与视频处理 · 电气工程与系统科学 2022-10-19 Gitaek Kwon , Eunjin Kim , Sunho Kim , Seongwon Bak , Minsung Kim , Jaeyoung Kim

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomography images is key for diagnosis and personalized treatment of eye diseases. While deep learning has been successful at this task, trained supervised models often fail…

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

计算机视觉与模式识别 · 计算机科学 2022-11-22 Jiabo Huang , Shaogang Gong

Self-supervised contrastive learning (CL) has achieved remarkable empirical success, often producing representations that rival supervised pre-training on downstream tasks. Recent theory explains this by showing that the CL loss closely…

机器学习 · 计算机科学 2025-10-13 Achleshwar Luthra , Priyadarsi Mishra , Tomer Galanti

Diabetic retinopathy (DR) is one of the major blindness-causing diseases currently known. Automatic grading of DR using deep learning methods not only speeds up the diagnosis of the disease but also reduces the rate of misdiagnosis.…

图像与视频处理 · 电气工程与系统科学 2023-05-25 Lei Shi , Bin Wang , Junxing Zhang

Recent advancements in deep learning have proven highly effective in medical image classification, notably within histopathology. However, noisy labels represent a critical challenge in histopathology image classification, where accurate…

计算机视觉与模式识别 · 计算机科学 2024-04-12 Lucas Dedieu , Nicolas Nerrienet , Adrien Nivaggioli , Clara Simmat , Marceau Clavel , Arnaud Gauthier , Stéphane Sockeel , Rémy Peyret

Contrastive learning is a form of self-supervision that can leverage unlabeled data to produce pretrained models. While contrastive learning has demonstrated promising results on natural image classification tasks, its application to…

计算机视觉与模式识别 · 计算机科学 2021-05-19 Hari Sowrirajan , Jingbo Yang , Andrew Y. Ng , Pranav Rajpurkar