English
Related papers

Related papers: Weakly-Supervised Contrastive Learning for Impreci…

200 papers

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

Machine Learning · Computer Science 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Learning a discriminative semantic space using unlabelled and noisy data remains unaddressed in a multi-label setting. We present a contrastive self-supervised learning method which is robust to data noise, grounded in the domain of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Mehmet Can Yavuz , Berrin Yanikoglu

Neuron labeling assigns textual descriptions to internal units of deep networks. Existing approaches typically rely on highly activating examples, often yielding broad or misleading labels by focusing on dominant but incidental visual…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Oussama Bouanani , Jim Berend , Wojciech Samek , Sebastian Lapuschkin , Maximilian Dreyer

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Weakly supervised learning has drawn considerable attention recently to reduce the expensive time and labor consumption of labeling massive data. In this paper, we investigate a novel weakly supervised learning problem of learning from…

Machine Learning · Statistics 2021-02-16 Yuzhou Cao , Lei Feng , Yitian Xu , Bo An , Gang Niu , Masashi Sugiyama

Despite its empirical success, the theoretical foundations of self-supervised contrastive learning (CL) are not yet fully established. In this work, we address this gap by showing that standard CL objectives implicitly approximate a…

Machine Learning · Computer Science 2025-11-12 Achleshwar Luthra , Tianbao Yang , Tomer Galanti

Contrastive self-supervised learning (SSL) learns an embedding space that maps similar data pairs closer and dissimilar data pairs farther apart. Despite its success, one issue has been overlooked: the fairness aspect of representations…

Graphs are present in many real-world applications, such as financial fraud detection, commercial recommendation, and social network analysis. But given the high cost of graph annotation or labeling, we face a severe graph label-scarcity…

Machine Learning · Computer Science 2022-08-08 Zhen Tan , Kaize Ding , Ruocheng Guo , Huan Liu

Graph contrastive learning defines a contrastive task to pull similar instances close and push dissimilar instances away. It learns discriminative node embeddings without supervised labels, which has aroused increasing attention in the past…

Machine Learning · Computer Science 2023-04-25 Lin Shu , Chuan Chen , Zibin Zheng

Contrastive learning is a popular form of self-supervised learning that encourages augmentations (views) of the same input to have more similar representations compared to augmentations of different inputs. Recent attempts to theoretically…

Machine Learning · Computer Science 2022-03-01 Nikunj Saunshi , Jordan Ash , Surbhi Goel , Dipendra Misra , Cyril Zhang , Sanjeev Arora , Sham Kakade , Akshay Krishnamurthy

Scarcity of pixel-level labels is a significant challenge in practical scenarios. In specific domains like industrial smoke, acquiring such detailed annotations is particularly difficult and often requires expert knowledge. To alleviate…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Zheyuan Zhang , Yen-chia Hsu

Deep learning has achieved great success in recent years with the aid of advanced neural network structures and large-scale human-annotated datasets. However, it is often costly and difficult to accurately and efficiently annotate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Chen Feng , Ioannis Patras

Contrastive learning predicts whether two images belong to the same category by training a model to make their feature representations as close or as far away as possible. In this paper, we rethink how to mine samples in contrastive…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Hengkui Dong , Xianzhong Long , Yun Li

Contrastive learning relies on an assumption that positive pairs contain related views, e.g., patches of an image or co-occurring multimodal signals of a video, that share certain underlying information about an instance. But what if this…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Ching-Yao Chuang , R Devon Hjelm , Xin Wang , Vibhav Vineet , Neel Joshi , Antonio Torralba , Stefanie Jegelka , Yale Song

We pilot a family of stable contrastive losses for learning pixel-level representations that jointly capture semantic and geometric information. Our approach maps each pixel of an image to an overcomplete descriptor that is both…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Leonid Pogorelyuk , Niels Bracher , Aaron Verkleeren , Lars Kühmichel , Stefan T. Radev

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Programmatic weak supervision creates models without hand-labeled training data by combining the outputs of heuristic labelers. Existing frameworks make the restrictive assumption that labelers output a single class label. Enabling users to…

Machine Learning · Computer Science 2022-03-28 Peilin Yu , Tiffany Ding , Stephen H. Bach