中文
相关论文

相关论文: Contrastive learning-based pretraining improves re…

200 篇论文

Diabetic retinopathy (DR) is a retinal microvascular condition that emerges in diabetic patients. DR will continue to be a leading cause of blindness worldwide, with a predicted 191.0 million globally diagnosed patients in 2030.…

计算机视觉与模式识别 · 计算机科学 2020-10-23 Mihir Rao , Michelle Zhu , Tianyang Wang

Contrastive self-supervised learning (CSL) has attracted increasing attention for model pre-training via unlabeled data. The resulted CSL models provide instance-discriminative visual features that are uniformly scattered in the feature…

计算机视觉与模式识别 · 计算机科学 2021-10-15 Yifan Zhang , Bryan Hooi , Dapeng Hu , Jian Liang , Jiashi Feng

Recent advancements in deep learning for Medical Artificial Intelligence have demonstrated that models can match the diagnostic performance of clinical experts in adult chest X-ray (CXR) interpretation. However, their application in the…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Sheng Cheng , Zbigniew A. Starosolski , Devika Subramanian

Contrastive learning (CL) can learn generalizable feature representations and achieve the state-of-the-art performance of downstream tasks by finetuning a linear classifier on top of it. However, as adversarial robustness becomes vital in…

计算机视觉与模式识别 · 计算机科学 2021-11-02 Lijie Fan , Sijia Liu , Pin-Yu Chen , Gaoyuan Zhang , Chuang Gan

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

机器学习 · 计算机科学 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

Although deep learning-based segmentation models have achieved impressive performance on public benchmarks, generalizing well to unseen environments remains a major challenge. To improve the model's generalization ability to the new domain…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Yunlong Zhang , Yuxuan Sun , Sunyi Zheng , Zhongyi Shui , Chenglu Zhu , Lin Yang

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

图像与视频处理 · 电气工程与系统科学 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

计算机视觉与模式识别 · 计算机科学 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Transformations in the input space of Deep Neural Networks (DNN) lead to unintended changes in the feature space. Almost perceptually identical inputs, such as adversarial examples, can have significantly distant feature representations. On…

机器学习 · 计算机科学 2022-11-29 Iordanis Fostiropoulos , Laurent Itti

In recent years, deep learning (DL) techniques have provided state-of-the-art performance on different medical imaging tasks. However, the availability of good quality annotated medical data is very challenging due to involved time…

机器学习 · 计算机科学 2020-12-29 Muhammad Ahtazaz Ahsan , Adnan Qayyum , Junaid Qadir , Adeel Razi

In the last decade, computer vision has witnessed the establishment of various training and learning approaches. Techniques like adversarial learning, contrastive learning, diffusion denoising learning, and ordinary reconstruction learning…

Cross-language pre-trained models such as multilingual BERT (mBERT) have achieved significant performance in various cross-lingual downstream NLP tasks. This paper proposes a multi-level contrastive learning (ML-CTL) framework to further…

计算与语言 · 计算机科学 2022-03-01 Beiduo Chen , Wu Guo , Bin Gu , Quan Liu , Yongchao Wang

Modern computer vision models have proven to be highly useful for medical imaging classification and segmentation tasks, but the scarcity of medical imaging data often limits the efficacy of models trained from scratch. Transfer learning…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Daniel Frees , Moritz Bolling , Aditri Bhagirath

Contrastive learning and self-supervised techniques have gained prevalence in computer vision for the past few years. It is essential for medical image analysis, which is often notorious for its lack of annotations. Most existing…

图像与视频处理 · 电气工程与系统科学 2022-03-07 Jun Li , Quan Quan , S. Kevin Zhou

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haojin Deng , Yimin Yang

Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning (SSCL) has recently…

图像与视频处理 · 电气工程与系统科学 2022-05-26 Makiya Nakashima , Inyeop Jang , Ramesh Basnet , Mitchel Benovoy , W. H. Wilson Tang , Christopher Nguyen , Deborah Kwon , Tae Hyun Hwang , David Chen

In the field of medical imaging, the advent of deep learning, especially the application of convolutional neural networks (CNNs) has revolutionized the analysis and interpretation of medical images. Nevertheless, deep learning methods…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Xin Li , Wenhui Zhu , Peijie Qiu , Oana M. Dumitrascu , Amal Youssef , Yalin Wang

This paper considers contrastive training for cross-modal 0-shot transfer wherein a pre-trained model in one modality is used for representation learning in another domain using pairwise data. The learnt models in the latter domain can then…

Semi-supervised segmentation methods have demonstrated promising results in natural scenarios, providing a solution to reduce dependency on manual annotation. However, these methods face significant challenges when directly applied to…

计算机视觉与模式识别 · 计算机科学 2024-02-08 Ye Zhang , Ziyue Wang , Yifeng Wang , Hao Bian , Linghan Cai , Hengrui Li , Lingbo Zhang , Yongbing Zhang

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu