English
Related papers

Related papers: Self-Supervised Learning for Building Robust Pedia…

200 papers

We propose SparseContrast, a new framework that merges dynamic sparse attention with contrastive learning for medical imaging, with a focus on chest X-ray disease detection in low-data settings. Traditional contrastive learning methods rely…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Paarth Prasad , Ruchika Malhotra

Purpose: The aim of this work is to develop a neural network training framework for continual training of small amounts of medical imaging data and create heuristics to assess training in the absence of a hold-out validation or test set.…

Image and Video Processing · Electrical Eng. & Systems 2023-09-27 Sohaib Naim , Brian Caffo , Haris I Sair , Craig K Jones

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Unsupervised image representations have significantly reduced the gap with supervised pretraining, notably with the recent achievements of contrastive learning methods. These contrastive methods typically work online and rely on a large…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Mathilde Caron , Ishan Misra , Julien Mairal , Priya Goyal , Piotr Bojanowski , Armand Joulin

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

Machine Learning · Computer Science 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

Leveraging machine learning techniques for Sepsis early detection and diagnosis has attracted increasing interest in recent years. However, most existing methods require a large amount of labeled training data, which may not be available…

Machine Learning · Computer Science 2023-03-07 Ruiqing Ding , Yu Zhou , Jie Xu , Yan Xie , Qiqiang Liang , He Ren , Yixuan Wang , Yanlin Chen , Leye Wang , Man Huang

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

The success of deep learning methods in medical image segmentation tasks heavily depends on a large amount of labeled data to supervise the training. On the other hand, the annotation of biomedical images requires domain knowledge and can…

Computer Vision and Pattern Recognition · Computer Science 2021-09-30 Xinrong Hu , Dewen Zeng , Xiaowei Xu , Yiyu Shi

Self supervised contrastive learning based pretraining allows development of robust and generalized deep learning models with small, labeled datasets, reducing the burden of label generation. This paper aims to evaluate the effect of CL…

Image and Video Processing · Electrical Eng. & Systems 2022-08-25 Minhaj Nur Alam , Rikiya Yamashita , Vignav Ramesh , Tejas Prabhune , Jennifer I. Lim , R. V. P. Chan , Joelle Hallak , Theodore Leng , Daniel Rubin

Image classification is hindered by subtle inter-class differences and substantial intra-class variations, which limit the effectiveness of existing contrastive learning methods. Supervised contrastive approaches based on the InfoNCE loss…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Bin Wang , Fadi Dornaika

Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning (SSCL) has recently…

Image and Video Processing · Electrical Eng. & Systems 2022-05-26 Makiya Nakashima , Inyeop Jang , Ramesh Basnet , Mitchel Benovoy , W. H. Wilson Tang , Christopher Nguyen , Deborah Kwon , Tae Hyun Hwang , David Chen

In this paper, we explore contrastive learning for few-shot classification, in which we propose to use it as an additional auxiliary training objective acting as a data-dependent regularizer to promote more general and transferable…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yassine Ouali , Céline Hudelot , Myriam Tami

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Zeyu Fu , Jianbo Jiao , Robail Yasrab , Lior Drukker , Aris T. Papageorghiou , J. Alison Noble

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

A common shortfall of supervised learning for medical imaging is the greedy need for human annotations, which is often expensive and time-consuming to obtain. This paper proposes a semi-supervised classification method for three kinds of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-15 Yanni Ren , Hangyu Deng , Hao Jiang , Jinglu Hu

Real-world data often exhibits long tail distributions with heavy class imbalance, where the majority classes can dominate the training process and alter the decision boundaries of the minority classes. Recently, researchers have…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Tianhong Li , Peng Cao , Yuan Yuan , Lijie Fan , Yuzhe Yang , Rogerio Feris , Piotr Indyk , Dina Katabi

Semi-supervised learning utilizes insights from unlabeled data to improve model generalization, thereby reducing reliance on large labeled datasets. Most existing studies focus on limited samples and fail to capture the overall data…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Xiuzhen Guo , Lianyuan Yu , Ji Shi , Na Lei , Hongxiao Wang
‹ Prev 1 4 5 6 7 8 10 Next ›