English
Related papers

Related papers: Augment with Care: Contrastive Learning for Combin…

200 papers

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Few-shot learning is an established topic in natural images for years, but few work is attended to histology images, which is of high clinical value since well-labeled datasets and rare abnormal samples are expensive to collect. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-02-21 Jiawei Yang , Hanbo Chen , Jiangpeng Yan , Xiaoyu Chen , Jianhua Yao

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

Multi-task learning promises better model generalization on a target task by jointly optimizing it with an auxiliary task. However, the current practice requires additional labeling efforts for the auxiliary task, while not guaranteeing…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Menelaos Kanakis , Thomas E. Huang , David Bruggemann , Fisher Yu , Luc Van Gool

Training image-based object detectors presents formidable challenges, as it entails not only the complexities of object detection but also the added intricacies of precisely localizing objects within potentially diverse and noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chandan Kumar , Jansel Herrera-Gerena , John Just , Matthew Darr , Ali Jannesari

A major impediment to the application of deep learning to real-world problems is the scarcity of labeled data. Small training sets are in fact of no use to deep networks as, due to the large number of trainable parameters, they will very…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Ismail Elezi , Alessandro Torcinovich , Sebastiano Vascon , Marcello Pelillo

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most existing CL methods only perform either hand-crafted data or…

Information Retrieval · Computer Science 2023-11-22 Xiuyuan Qin , Huanhuan Yuan , Pengpeng Zhao , Junhua Fang , Fuzhen Zhuang , Guanfeng Liu , Victor Sheng

Self-training and contrastive learning have emerged as leading techniques for incorporating unlabeled data, both under distribution shift (unsupervised domain adaptation) and when it is absent (semi-supervised learning). However, despite…

Graph Contrastive Learning (GCL) aims to learn node representations by aligning positive pairs and separating negative ones. However, few of researchers have focused on the inner law behind specific augmentations used in graph-based…

Machine Learning · Computer Science 2024-12-25 Jingyu Liu , Huayi Tang , Yong Liu

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, the understanding of…

Machine Learning · Computer Science 2023-02-07 Amur Ghose , Yingxue Zhang , Jianye Hao , Mark Coates

Complementary Labels Learning (CLL) arises in many real-world tasks such as private questions classification and online learning, which aims to alleviate the annotation cost compared with standard supervised learning. Unfortunately, most…

Machine Learning · Computer Science 2022-11-22 Zhongnian Li , Jian Zhang , Mengting Xu , Xinzheng Xu , Daoqiang Zhang

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

Self-supervised pre-training with contrastive learning is a powerful method for learning from sparsely labeled data. However, performance can drop considerably when there is a shift in the distribution of data from training to test time. We…

Machine Learning · Computer Science 2026-01-13 Robert Lewis , Katie Matton , Rosalind W. Picard , John Guttag

In this paper, we propose a novel selection strategy for contrastive learning for medical images. On natural images, contrastive learning uses augmentations to select positive and negative pairs for the contrastive loss. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Kiran Kokilepersaud , Mohit Prabhushankar , Ghassan AlRegib , Stephanie Trejo Corona , Charles Wykoff

Contrastive learning has recently shown immense potential in unsupervised visual representation learning. Existing studies in this track mainly focus on intra-image invariance learning. The learning typically uses rich intra-image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Jiahao Xie , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

Machine Learning · Computer Science 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

Label distribution learning (LDL) is a new machine learning paradigm for solving label ambiguity. Since it is difficult to directly obtain label distributions, many studies are focusing on how to recover label distributions from logical…

Machine Learning · Computer Science 2023-05-17 Yifei Wang , Yiyang Zhou , Jihua Zhu , Xinyuan Liu , Wenbiao Yan , Zhiqiang Tian

Contrastive graph node clustering via learnable data augmentation is a hot research spot in the field of unsupervised graph learning. The existing methods learn the sampling distribution of a pre-defined augmentation to generate data-driven…

Machine Learning · Computer Science 2023-10-23 Xihong Yang , Cheng Tan , Yue Liu , Ke Liang , Siwei Wang , Sihang Zhou , Jun Xia , Stan Z. Li , Xinwang Liu , En Zhu

In the context of supervised statistical learning, it is typically assumed that the training set comes from the same distribution that draws the test samples. When this is not the case, the behavior of the learned model is unpredictable and…

Machine Learning · Computer Science 2022-05-12 Antonio-Javier Gallego , Jorge Calvo-Zaragoza , Robert B. Fisher

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin
‹ Prev 1 4 5 6 7 8 10 Next ›