English
Related papers

Related papers: CO2: Consistent Contrast for Unsupervised Visual R…

200 papers

This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias, wherein negative samples may encompass similar semantics (\eg labels). However, existing theories fall short in providing explanations for this…

Machine Learning · Computer Science 2023-10-18 Junkang Wu , Jiawei Chen , Jiancan Wu , Wentao Shi , Xiang Wang , Xiangnan He

Distribution shifts are problems where the distribution of data changes between training and testing, which can significantly degrade the performance of a model deployed in the real world. Recent studies suggest that one reason for the…

Machine Learning · Computer Science 2023-04-10 Takuro Kutsuna

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for object detection, where…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhenyu Wang , Yali Li , Ye Guo , Shengjin Wang

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran

In this paper, we propose a genuine group-level contrastive visual representation learning method whose linear evaluation performance on ImageNet surpasses the vanilla supervised learning. Two mainstream unsupervised learning schemes are…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Bo Pang , Yifan Zhang , Yaoyi Li , Jia Cai , Cewu Lu

Learning invariant representations via contrastive learning has seen state-of-the-art performance in domain generalization (DG). Despite such success, in this paper, we find that its core learning strategy -- feature alignment -- could…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yibing Liu , Chris Xing Tian , Haoliang Li , Shiqi Wang

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

Machine Learning · Computer Science 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

Contrastive learning has become an important tool in learning representations from unlabeled data mainly relying on the idea of minimizing distance between positive data pairs, e.g., views from the same images, and maximizing distance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Nina Shvetsova , Felix Petersen , Anna Kukleva , Bernt Schiele , Hilde Kuehne

We study Online Continual Learning with missing labels and propose SemiCon, a new contrastive loss designed for partly labeled data. We demonstrate its efficiency by devising a memory-based method trained on an unlabeled data stream, where…

Machine Learning · Computer Science 2022-11-23 Nicolas Michel , Romain Negrel , Giovanni Chierchia , Jean-François Bercher

Self-supervised representation learning can mitigate the limitations in recognition tasks with few manually labeled data but abundant unlabeled data---a common scenario in sound event research. In this work, we explore unsupervised…

Sound · Computer Science 2020-11-17 Eduardo Fonseca , Diego Ortego , Kevin McGuinness , Noel E. O'Connor , Xavier Serra

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Despite the widespread use of unsupervised models, very few methods are designed to explain them. Most explanation methods explain a scalar model output. However, unsupervised models output representation vectors, the elements of which are…

Machine Learning · Computer Science 2023-06-14 Chris Lin , Hugh Chen , Chanwoo Kim , Su-In Lee

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

In this paper, we present CLCC, a novel contrastive learning framework for color constancy. Contrastive learning has been applied for learning high-quality visual representations for image classification. One key aspect to yield useful…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yi-Chen Lo , Chia-Che Chang , Hsuan-Chao Chiu , Yu-Hao Huang , Chia-Ping Chen , Yu-Lin Chang , Kevin Jou

Pretext Invariant Representation Learning (PIRL) followed by Supervised Fine-Tuning (SFT) has become a standard paradigm for learning with limited labels. We extend this approach to the Positive Unlabeled (PU) setting, where only a small…

Machine Learning · Computer Science 2025-04-11 Anish Acharya , Li Jing , Bhargav Bhushanam , Dhruv Choudhary , Michael Rabbat , Sujay Sanghavi , Inderjit S Dhillon

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Venkata Narendra Kotyada , Revanth Eranki , Nagesh Bhattu Sristy

Recently, as an effective way of learning latent representations, contrastive learning has been increasingly popular and successful in various domains. The success of constrastive learning in single-label classifications motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Son D. Dao , Ethan Zhao , Dinh Phung , Jianfei Cai

Cross-modality distillation arises as an important topic for data modalities containing limited knowledge such as depth maps and high-quality sketches. Such techniques are of great importance, especially for memory and privacy-restricted…

Machine Learning · Computer Science 2024-05-29 Hangyu Lin , Chen Liu , Chengming Xu , Zhengqi Gao , Yanwei Fu , Yuan Yao

Recently, the introduction of Chain-of-Thought (CoT) has largely improved the generation ability of unified models. However, it is observed that the current thinking process during generation mainly focuses on the text consistency with the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Zixuan Ye , Quande Liu , Cong Wei , Yuanxing Zhang , Xintao Wang , Pengfei Wan , Kun Gai , Wenhan Luo