English
Related papers

Related papers: Adaptive Contrastive Learning with Dynamic Correla…

200 papers

Contrastive learning has been shown to produce generalizable representations of audio and visual data by maximizing the lower bound on the mutual information (MI) between different views of an instance. However, obtaining a tight lower…

Machine Learning · Computer Science 2021-04-20 Shuang Ma , Zhaoyang Zeng , Daniel McDuff , Yale Song

Training vision-language models for image-text alignment typically requires large datasets to achieve robust performance. In low-data scenarios, standard contrastive learning can struggle to align modalities effectively due to overfitting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Sneh Pillai

Obtaining manual annotations for large datasets for supervised training of deep learning (DL) models is challenging. The availability of large unlabeled datasets compared to labeled ones motivate the use of self-supervised pretraining to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Lavanya Umapathy , Zhiyang Fu , Rohit Philip , Diego Martin , Maria Altbach , Ali Bilgin

Fully-convolutional neural networks have achieved superior performance in a variety of image segmentation tasks. However, their training requires laborious manual annotation of large datasets, as well as acceleration by parallel processors…

Neural and Evolutionary Computing · Computer Science 2018-11-29 Blaine Rister , Darvin Yi , Kaushik Shivakumar , Tomomi Nobashi , Daniel L. Rubin

Long-term vertebral fractures severely affect the life quality of patients, causing kyphotic, lumbar deformity and even paralysis. Computed tomography (CT) is a common clinical examination to screen for this disease at early stages.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Xin Wei , Huaiwei Cong , Zheng Zhang , Junran Peng , Guoping Chen , Jinpeng Li

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Segmentation of bone regions allows for enhanced diagnostics, disease characterisation and treatment monitoring in CT imaging. In contrast enhanced whole-body scans accurate automatic segmentation is particularly difficult as low dose whole…

Medical Physics · Physics 2020-08-14 Patrick Leydon , Martin O'Connell , Derek Greene , Kathleen M Curran

The segmentation of organs at risk (OAR) is a required precondition for the cancer treatment with image guided radiation therapy. The automation of the segmentation task is therefore of high clinical relevance. Deep Learning (DL) based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Elias Tappeiner , Martin Welk , Rainer Schubert

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Venkata Narendra Kotyada , Revanth Eranki , Nagesh Bhattu Sristy

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

Supervised machine learning-based medical image computing applications necessitate expert label curation, while unlabelled image data might be relatively abundant. Active learning methods aim to prioritise a subset of available image data…

As the demand for more descriptive machine learning models grows within medical imaging, bottlenecks due to data paucity will exacerbate. Thus, collecting enough large-scale data will require automated tools to harvest data/label pairs from…

Image and Video Processing · Electrical Eng. & Systems 2019-10-01 Bo Zhou , Adam P. Harrison , Jiawen Yao , Chi-Tung Cheng , Jing Xiao , Chien-Hung Liao , Le Lu

Many existing unsupervised domain adaptation (UDA) methods primarily focus on covariate shift, limiting their effectiveness in imbalanced domain adaptation (IDA) where both covariate shift and label shift coexist. Recent IDA methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Xiaona Sun , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

In this work, we propose a novel supervised contrastive loss that enables the integration of taxonomic hierarchy information during the representation learning process. A supervised contrastive loss operates by enforcing that images with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Kiran Kokilepersaud , Yavuz Yarici , Mohit Prabhushankar , Ghassan AlRegib

We present Domain Contrast (DC), a simple yet effective approach inspired by contrastive learning for training domain adaptive detectors. DC is deduced from the error bound minimization perspective of a transferred model, and is implemented…

Computer Vision and Pattern Recognition · Computer Science 2020-06-29 Feng Liu , Xiaoxong Zhang , Fang Wan , Xiangyang Ji , Qixiang Ye

Large-scale datasets are important for the development of deep learning models. Such datasets usually require a heavy workload of annotations, which are extremely time-consuming and expensive. To accelerate the annotation procedure,…

Machine Learning · Computer Science 2024-03-13 Xiaoqian Ruan , Gaoang Wang

The goal of contrastive learning based pre-training is to leverage large quantities of unlabeled data to produce a model that can be readily adapted downstream. Current approaches revolve around solving an image discrimination task: given…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Deep clustering successfully provides more effective features than conventional ones and thus becomes an important technique in current unsupervised learning. However, most deep clustering methods ignore the vital positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Zhiyuan Dang , Cheng Deng , Xu Yang , Heng Huang

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang