English
Related papers

Related papers: Chronological Contrastive Learning: Few-Shot Progr…

200 papers

Medical image classification has been widely adopted in medical image analysis. However, due to the difficulty of collecting and labeling data in the medical area, medical image datasets are usually highly-imbalanced. To address this…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhixiong Yang , Junwen Pan , Yanzhan Yang , Xiaozhou Shi , Hong-Yu Zhou , Zhicheng Zhang , Cheng Bian

Image segmentation relies on large annotated datasets, which are expensive and slow to produce. Silver-standard (AI-generated) labels are easier to obtain, but they risk introducing bias. Self-supervised learning, needing only images, has…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Marceau Lafargue-Hauret , Raghav Mehta , Fabio De Sousa Ribeiro , Mélanie Roschewitz , Ben Glocker

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Aishik Konwer , Xuan Xu , Joseph Bae , Chao Chen , Prateek Prasanna

Survival analysis plays a crucial role in many healthcare decisions, where the risk prediction for the events of interest can support an informative outlook for a patient's medical journey. Given the existence of data censoring, an…

Machine Learning · Computer Science 2023-09-29 Mohsen Nayebi Kerdabadi , Arya Hadizadeh Moghaddam , Bin Liu , Mei Liu , Zijun Yao

Contrastive loss has significantly improved performance in supervised classification tasks by using a multi-viewed framework that leverages augmentation and label information. The augmentation enables contrast with another view of a single…

Machine Learning · Computer Science 2022-11-28 Sangmin Bae , Sungnyun Kim , Jongwoo Ko , Gihun Lee , Seungjong Noh , Se-Young Yun

Electrocardiogram (ECG) analysis is foundational for cardiovascular disease diagnosis, yet the performance of deep learning models is often constrained by limited access to annotated data. Self-supervised contrastive learning has emerged as…

Machine Learning · Computer Science 2025-08-22 Yi Yuan , Joseph Van Duyn , Runze Yan , Zhuoyi Huang , Sulaiman Vesal , Sergey Plis , Xiao Hu , Gloria Hyunjung Kwak , Ran Xiao , Alex Fedorov

Despite the success of contrastive learning in Music Information Retrieval, the inherent ambiguity of contrastive self-supervision presents a challenge. Relying solely on augmentation chains and self-supervised positive sampling strategies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Julien Guinot , Elio Quinton , György Fazekas

Standard few-shot relation classification (RC) is designed to learn a robust classifier with only few labeled data for each class. However, previous works rarely investigate the effects of a different number of classes (i.e., $N$-way) and…

Machine Learning · Computer Science 2021-10-19 Hongru Wang , Zhijing Jin , Jiarun Cao , Gabriel Pui Cheong Fung , Kam-Fai Wong

With the onset of the COVID-19 pandemic, ultrasound has emerged as an effective tool for bedside monitoring of patients. Due to this, a large amount of lung ultrasound scans have been made available which can be used for AI based diagnosis…

Image and Video Processing · Electrical Eng. & Systems 2022-01-20 Gautam Rajendrakumar Gare , Hai V. Tran , Bennett P deBoisblanc , Ricardo Luis Rodriguez , John Michael Galeotti

Supervised contrastive learning (SupCon) has proven to be a powerful alternative to the standard cross-entropy loss for classification of multi-class balanced datasets. However, it struggles to learn well-conditioned representations of…

Machine Learning · Computer Science 2025-03-24 David Mildenberger , Paul Hager , Daniel Rueckert , Martin J Menten

The self-supervised ultrasound (US) video model pretraining can use a small amount of labeled data to achieve one of the most promising results on US diagnosis. However, it does not take full advantage of multi-level knowledge for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Chunhui Zhang , Yixiong Chen , Li Liu , Qiong Liu , Xi Zhou

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

Computer Vision and Pattern Recognition · Computer Science 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Automated radiology report generation offers an effective solution to alleviate radiologists' workload. However, most existing methods focus primarily on single or fixed-view images to model current disease conditions, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Kang Liu , Zhuoqi Ma , Xiaolu Kang , Yunan Li , Kun Xie , Zhicheng Jiao , Qiguang Miao

Deep neural networks are increasingly used in medical imaging for tasks such as pathological classification, but they face challenges due to the scarcity of high-quality, expert-labeled training data. Recent efforts have utilized…

Machine Learning · Computer Science 2024-10-14 Jongseong Jang , Daeun Kyung , Seung Hwan Kim , Honglak Lee , Kyunghoon Bae , Edward Choi

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

Long-term vertebral fractures severely affect the life quality of patients, causing kyphotic, lumbar deformity and even paralysis. Computed tomography (CT) is a common clinical examination to screen for this disease at early stages.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Xin Wei , Huaiwei Cong , Zheng Zhang , Junran Peng , Guoping Chen , Jinpeng Li

Contrastive self-supervised learning has recently benefited fMRI classification with inductive biases. Its weak label reliance prevents overfitting on small medical datasets and tackles the high intraclass variances. Nonetheless, existing…

Machine Learning · Computer Science 2022-07-19 Xuesong Wang , Lina Yao , Islem Rekik , Yu Zhang

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

Machine Learning · Computer Science 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another.…

Machine Learning · Computer Science 2021-05-18 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Spurious correlations pose a major challenge for robust machine learning. Models trained with empirical risk minimization (ERM) may learn to rely on correlations between class labels and spurious attributes, leading to poor performance on…

Machine Learning · Computer Science 2024-12-12 Michael Zhang , Nimit S. Sohoni , Hongyang R. Zhang , Chelsea Finn , Christopher Ré