English
Related papers

Related papers: Sample-Specific Debiasing for Better Image-Text Mo…

200 papers

Due to the advantages of leveraging unlabeled data and learning meaningful representations, semi-supervised learning and contrastive learning have been progressively combined to achieve better performances in popular applications with few…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Bowen Tao , Lan Li , Xin-Chun Li , De-Chuan Zhan

Contrastive learning has become a popular approach in natural language processing, particularly for the learning of sentence embeddings. However, the discrete nature of natural language makes it difficult to ensure the quality of positive…

Computation and Language · Computer Science 2023-05-23 Qinyuan Cheng , Xiaogui Yang , Tianxiang Sun , Linyang Li , Xipeng Qiu

This paper proposes a novel pseudo-labeling method for medical image segmentation that can perform learning on ``individual images'' to select effective pseudo-labels. We introduce Positive and Unlabeled Learning (PU learning), which uses…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Takehiro Yamane , Itaru Tsuge , Susumu Saito , Ryoma Bise

Contrastive pretraining can substantially increase model generalisation and downstream performance. However, the quality of the learned representations is highly dependent on the data augmentation strategy applied to generate positive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mélanie Roschewitz , Fabio De Sousa Ribeiro , Tian Xia , Galvin Khara , Ben Glocker

Contrastive Learning has emerged as a powerful representation learning method and facilitates various downstream tasks especially when supervised data is limited. How to construct efficient contrastive samples through data augmentation is…

Computation and Language · Computer Science 2021-11-30 Yangkai Du , Tengfei Ma , Lingfei Wu , Fangli Xu , Xuhong Zhang , Bo Long , Shouling Ji

The objective of this work is to localize the sound sources in visual scenes. Existing audio-visual works employ contrastive learning by assigning corresponding audio-visual pairs from the same source as positives while randomly mismatched…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Arda Senocak , Hyeonggon Ryu , Junsik Kim , In So Kweon

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

Deep learning models can perform well in complex medical imaging classification tasks, even when basing their conclusions on spurious correlations (i.e. confounders), should they be prevalent in the training dataset, rather than on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Amar Kumar , Nima Fathi , Raghav Mehta , Brennan Nichyporuk , Jean-Pierre R. Falet , Sotirios Tsaftaris , Tal Arbel

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

Information Retrieval · Computer Science 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

Model explanations such as saliency maps can improve user trust in AI by highlighting important features for a prediction. However, these become distorted and misleading when explaining predictions of images that are subject to systematic…

Human-Computer Interaction · Computer Science 2022-03-02 Wencan Zhang , Mariella Dimiccoli , Brian Y. Lim

Language models are strong few-shot learners and achieve good overall accuracy in text classification tasks, masking the fact that their results suffer from great class accuracy imbalance. We believe that the pursuit of overall accuracy…

Computation and Language · Computer Science 2025-07-28 Ruixi Lin , Ziqiao Wang , Yang You

Foundation models in healthcare have largely adopted self supervised pretraining objectives inherited from natural language processing and computer vision, emphasizing reconstruction and large scale representation learning prior to…

Machine Learning · Computer Science 2026-03-24 Yang Zhang , Li Fan , Samuel Lawrence , Shi Li

In this paper, we propose Self-Contrastive Decorrelation (SCD), a self-supervised approach. Given an input sentence, it optimizes a joint self-contrastive and decorrelation objective. Learning a representation is facilitated by leveraging…

Computation and Language · Computer Science 2022-03-16 Tassilo Klein , Moin Nabi

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Universal anomaly detection still remains a challenging problem in machine learning and medical image analysis. It is possible to learn an expected distribution from a single class of normative samples, e.g., through epistemic uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Johanna P. Müller , Matthew Baugh , Jeremy Tan , Mischa Dombrowski , Bernhard Kainz

One of the most promising approaches for unsupervised learning is combining deep representation learning and deep clustering. Some recent works propose to simultaneously learn representation using deep neural networks and perform clustering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Mina Rezaei , Emilio Dorigatti , David Ruegamer , Bernd Bischl

Point clouds have attracted increasing attention. Significant progress has been made in methods for point cloud analysis, which often requires costly human annotation as supervision. To address this issue, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Bi'an Du , Xiang Gao , Wei Hu , Xin Li

This paper addresses text-supervised semantic segmentation, aiming to learn a model capable of segmenting arbitrary visual concepts within images by using only image-text pairs without dense annotations. Existing methods have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Ji-Jia Wu , Andy Chia-Hao Chang , Chieh-Yu Chuang , Chun-Pei Chen , Yu-Lun Liu , Min-Hung Chen , Hou-Ning Hu , Yung-Yu Chuang , Yen-Yu Lin

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

The unique characteristics of text data make classification tasks a complex problem. Advances in unsupervised and semi-supervised learning and autoencoder architectures addressed several challenges. However, they still struggle with…

Computation and Language · Computer Science 2024-10-30 Grigorii Khvatskii , Nuno Moniz , Khoa Doan , Nitesh V Chawla