中文
相关论文

相关论文: A Tale of Two Classes: Adapting Supervised Contras…

200 篇论文

Mental disorder populations exhibit pronounced heterogeneity -- that is, the significant differences between samples -- poses a significant challenge to the definition of positive pairs in contrastive learning. To address this, we propose a…

机器学习 · 计算机科学 2026-03-23 Xiaolong Li , Guiliang Guo , Guangqi Wen , Peng Cao , Jinzhu Yang , Honglin Wu , Xiaoli Liu , Fei Wang , Osmar R. Zaiane

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

机器学习 · 计算机科学 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

机器学习 · 计算机科学 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Self-supervised contrastive representation learning has proved incredibly successful in the vision and natural language domains, enabling state-of-the-art performance with orders of magnitude less labeled data. However, such methods are…

机器学习 · 计算机科学 2022-03-17 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

The field of imbalanced self-supervised learning, especially in the context of tabular data, has not been extensively studied. Existing research has predominantly focused on image datasets. This paper aims to fill this gap by examining the…

机器学习 · 计算机科学 2024-03-26 Samuel Stocksieker , Denys Pommeret , Arthur Charpentier

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Jiale Chen

Class imbalance has a detrimental effect on the predictive performance of most supervised learning algorithms as the imbalanced distribution can lead to a bias preferring the majority class. To solve this problem, we propose a Supervised…

机器学习 · 计算机科学 2022-10-27 Shuting Tao , Peng Peng , Qi Li , Hongwei Wang

Pseudo-labeling has proven to be a promising semi-supervised learning (SSL) paradigm. Existing pseudo-labeling methods commonly assume that the class distributions of training data are balanced. However, such an assumption is far from…

机器学习 · 计算机科学 2023-03-03 Renzhen Wang , Xixi Jia , Quanziang Wang , Yichen Wu , Deyu Meng

In real-world classification problems, the class balance in the training dataset does not necessarily reflect that of the test dataset, which can cause significant estimation bias. If the class ratio of the test dataset is known, instance…

机器学习 · 计算机科学 2012-06-22 Marthinus Du Plessis , Masashi Sugiyama

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

机器学习 · 计算机科学 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

The information noise-contrastive estimation (InfoNCE) loss function provides the basis of many self-supervised deep learning methods due to its strong empirical results and theoretic motivation. Previous work suggests a supervised…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Patrick Feeney , Michael C. Hughes

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

机器学习 · 计算机科学 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

Deep supervised learning has achieved great success in the last decade. However, its deficiencies of dependence on manual labels and vulnerability to attacks have driven people to explore a better solution. As an alternative,…

机器学习 · 计算机科学 2021-06-28 Xiao Liu , Fanjin Zhang , Zhenyu Hou , Zhaoyu Wang , Li Mian , Jing Zhang , Jie Tang

Though offering amazing contextualized token-level representations, current pre-trained language models actually take less attention on acquiring sentence-level representation during its self-supervised pre-training. If self-supervised…

计算与语言 · 计算机科学 2022-10-24 Bohong Wu , Hai Zhao

Weakly supervised multiple instance learning (MIL) is a challenging task given that only bag-level labels are provided, while each bag typically contains multiple instances. This topic has been extensively studied in histopathological image…

计算机视觉与模式识别 · 计算机科学 2025-08-01 Bodong Zhang , Hamid Manoochehri , Xiwen Li , Beatrice S. Knudsen , Tolga Tasdizen

Image classification datasets exhibit a non-negligible fraction of mislabeled examples, often due to human error when one class superficially resembles another. This issue poses challenges in supervised contrastive learning (SCL), where the…

计算机视觉与模式识别 · 计算机科学 2023-11-29 Zijun Long , George Killick , Lipeng Zhuang , Richard McCreadie , Gerardo Aragon Camarasa , Paul Henderson

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

计算机视觉与模式识别 · 计算机科学 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Rishab Balasubramanian , Kunal Rathore

For anomaly detection (AD), early approaches often train separate models for individual classes, yielding high performance but posing challenges in scalability and resource management. Recent efforts have shifted toward training a single…

计算机视觉与模式识别 · 计算机科学 2025-07-18 Lei Fan , Junjie Huang , Donglin Di , Anyang Su , Tianyou Song , Maurice Pagnucco , Yang Song