English
Related papers

Related papers: Contrastive Learning Meets Transfer Learning: A Ca…

200 papers

Medical imaging data is often siloed within hospitals, limiting the amount of data available for specialized model development. With limited in-domain data, one might hope to leverage larger datasets from related domains. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Yuwen Chen , Helen Zhou , Zachary C. Lipton

Recent advancements in deep learning for Medical Artificial Intelligence have demonstrated that models can match the diagnostic performance of clinical experts in adult chest X-ray (CXR) interpretation. However, their application in the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Sheng Cheng , Zbigniew A. Starosolski , Devika Subramanian

Recent works have advanced the performance of self-supervised representation learning by a large margin. The core among these methods is intra-image invariance learning. Two different transformations of one image instance are considered as…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Haiping Wu , Xiaolong Wang

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Paul Hager , Martin J. Menten , Daniel Rueckert

In recent years, self-supervised contrastive learning has emerged as a distinguished paradigm in the artificial intelligence landscape. It facilitates unsupervised feature learning through contrastive delineations at the instance level.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Jiansong Zhang , Linlin Shen , Peizhong Liu

Linking sheet music images to audio recordings remains a key problem for the development of efficient cross-modal music retrieval systems. One of the fundamental approaches toward this task is to learn a cross-modal embedding space via deep…

Sound · Computer Science 2023-09-22 Luis Carvalho , Tobias Washüttl , Gerhard Widmer

Researchers have long tried to minimize training costs in deep learning while maintaining strong generalization across diverse datasets. Emerging research on dataset distillation aims to reduce training costs by creating a small synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ahmad Sajedi , Samir Khaki , Ehsan Amjadian , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Recently, contrastive learning has achieved great results in self-supervised learning, where the main idea is to push two augmentations of an image (positive pairs) closer compared to other random images (negative pairs). We argue that not…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ajinkya Tejankar , Soroush Abbasi Koohpayegani , Vipin Pillai , Paolo Favaro , Hamed Pirsiavash

This paper introduces contrastive siamese (c-siam) network, an architecture for leveraging unlabeled acoustic data in speech recognition. c-siam is the first network that extracts high-level linguistic information from speech by matching…

Machine Learning · Computer Science 2022-05-30 Soheil Khorram , Jaeyoung Kim , Anshuman Tripathi , Han Lu , Qian Zhang , Hasim Sak

Recent advances in contrastive representation learning over paired image-text data have led to models such as CLIP that achieve state-of-the-art performance for zero-shot classification and distributional robustness. Such models typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Shashank Goel , Hritik Bansal , Sumit Bhatia , Ryan A. Rossi , Vishwa Vinay , Aditya Grover

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

In this paper, we propose a novel selection strategy for contrastive learning for medical images. On natural images, contrastive learning uses augmentations to select positive and negative pairs for the contrastive loss. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib , Stephanie Trejo Corona , Charles Wykoff

Deep learning with noisy labels is an interesting challenge in weakly supervised learning. Despite their significant learning capacity, CNNs have a tendency to overfit in the presence of samples with noisy labels. Alleviating this issue,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yan Han , Soumava Kumar Roy , Mehrtash Harandi , Lars Petersson

Deep neural networks have reached remarkable achievements in medical image processing tasks, specifically in classifying and detecting various diseases. However, when confronted with limited data, these networks face a critical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Matina Mahdizadeh Sani , Ali Royat , Mahdieh Soleymani Baghshah

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Contrastive learning with Transformer-based sequence encoder has gained predominance for sequential recommendation. It maximizes the agreements between paired sequence augmentations that share similar semantics. However, existing…

Information Retrieval · Computer Science 2022-08-18 Hanwen Du , Hui Shi , Pengpeng Zhao , Deqing Wang , Victor S. Sheng , Yanchi Liu , Guanfeng Liu , Lei Zhao

Contrastive learning, a prominent approach within self-supervised learning, has demonstrated significant effectiveness in developing generalizable models for various applications involving natural images. However, recent research indicates…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Zijie Cheng , Boxuan Li , André Altmann , Pearse A Keane , Yukun Zhou

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Peirong Liu , Oula Puonti , Xiaoling Hu , Daniel C. Alexander , Juan E. Iglesias

Recent advancements in deep learning have proven highly effective in medical image classification, notably within histopathology. However, noisy labels represent a critical challenge in histopathology image classification, where accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Lucas Dedieu , Nicolas Nerrienet , Adrien Nivaggioli , Clara Simmat , Marceau Clavel , Arnaud Gauthier , Stéphane Sockeel , Rémy Peyret

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat