中文
相关论文

相关论文: Contrastive Regularization for Semi-Supervised Lea…

200 篇论文

Contrastive learning has been adopted as a core method for unsupervised visual representation learning. Without human annotation, the common practice is to perform an instance discrimination task: Given a query image crop, this task labels…

计算机视觉与模式识别 · 计算机科学 2020-10-07 Chen Wei , Huiyu Wang , Wei Shen , Alan Yuille

Constrained clustering allows the training of classification models using pairwise constraints only, which are weak and relatively easy to mine, while still yielding full-supervision-level model performance. While they perform well even in…

机器学习 · 计算机科学 2023-11-28 Jann Goschenhofer , Bernd Bischl , Zsolt Kira

Self-supervised instance discrimination is an effective contrastive pretext task to learn feature representations and address limited medical image annotations. The idea is to make features of transformed versions of the same images similar…

计算机视觉与模式识别 · 计算机科学 2022-11-17 Yejia Zhang , Xinrong Hu , Nishchal Sapkota , Yiyu Shi , Danny Z. Chen

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Traditional semi-supervised learning (SSL) assumes that the feature distributions of labeled and unlabeled data are consistent which rarely holds in realistic scenarios. In this paper, we propose a novel SSL setting, where unlabeled samples…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Jiachen Liang , Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Contrastive learning has achieved remarkable success in representation learning via self-supervision in unsupervised settings. However, effectively adapting contrastive learning to supervised learning tasks remains as a challenge in…

计算与语言 · 计算机科学 2022-01-24 Qianben Chen , Richong Zhang , Yaowei Zheng , Yongyi Mao

Overconfidence has been shown to impair generalization and calibration of a neural network. Previous studies remedy this issue by adding a regularization term to a loss function, preventing a model from making a peaked distribution. Label…

机器学习 · 计算机科学 2022-10-26 Dongkyu Lee , Ka Chun Cheung , Nevin L. Zhang

The recent advances in representation learning inspire us to take on the challenging problem of unsupervised image classification tasks in a principled way. We propose ContraCluster, an unsupervised image classification method that combines…

计算机视觉与模式识别 · 计算机科学 2023-04-20 Seongho Joe , Byoungjip Kim , Hoyoung Kang , Kyoungwon Park , Bogun Kim , Jaeseon Park , Joonseok Lee , Youngjune Gwon

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Jiale Chen

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

This paper presents a semi-supervised learning framework that is new in being designed for automatic modulation classification (AMC). By carefully utilizing unlabeled signal data with a self-supervised contrastive-learning pre-training…

机器学习 · 计算机科学 2022-03-31 Dongxin Liu , Peng Wang , Tianshi Wang , Tarek Abdelzaher

Unsupervised image clustering methods often introduce alternative objectives to indirectly train the model and are subject to faulty predictions and overconfident results. To overcome these challenges, the current research proposes an…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Sungwon Park , Sungwon Han , Sundong Kim , Danu Kim , Sungkyu Park , Seunghoon Hong , Meeyoung Cha

Detecting anomalies is one fundamental aspect of a safety-critical software system, however, it remains a long-standing problem. Numerous branches of works have been proposed to alleviate the complication and have demonstrated their…

机器学习 · 计算机科学 2023-01-31 Hyunsoo Cho , Jinseok Seol , Sang-goo Lee

In general, an experimental environment for deep learning assumes that the training and the test dataset are sampled from the same distribution. However, in real-world situations, a difference in the distribution between two datasets,…

计算机视觉与模式识别 · 计算机科学 2021-04-21 Daehee Kim , Seunghyun Park , Jinkyu Kim , Jaekoo Lee

Semi-supervised learning (SSL) algorithms struggle to perform well when exposed to imbalanced training data. In this scenario, the generated pseudo-labels can exhibit a bias towards the majority class, and models that employ these…

机器学习 · 计算机科学 2024-09-18 Zeju Li , Ying-Qiu Zheng , Chen Chen , Saad Jbabdi

Recent advances in semi-supervised learning (SSL) demonstrate that a combination of consistency regularization and pseudo-labeling can effectively improve image classification accuracy in the low-data regime. Compared to classification,…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Yuliang Zou , Zizhao Zhang , Han Zhang , Chun-Liang Li , Xiao Bian , Jia-Bin Huang , Tomas Pfister

This paper presents a simple yet effective two-stage framework for semi-supervised medical image segmentation. Unlike prior state-of-the-art semi-supervised segmentation methods that predominantly rely on pseudo supervision directly on…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Huimin Wu , Xiaomeng Li , Kwang-Ting Cheng

Federated learning enables multiple clients, such as mobile phones and organizations, to collaboratively learn a shared model for prediction while protecting local data privacy. However, most recent research and applications of federated…

机器学习 · 计算机科学 2021-08-24 Haowen Lin , Jian Lou , Li Xiong , Cyrus Shahabi

Semi-supervised object detection has recently achieved substantial progress. As a mainstream solution, the self-labeling-based methods train the detector on both labeled data and unlabeled data with pseudo labels predicted by the detector…

计算机视觉与模式识别 · 计算机科学 2022-04-19 Chengcheng Ma , Xingjia Pan , Qixiang Ye , Fan Tang , Weiming Dong , Changsheng Xu

Semi-supervised learning on class-imbalanced data, although a realistic problem, has been under studied. While existing semi-supervised learning (SSL) methods are known to perform poorly on minority classes, we find that they still generate…

计算机视觉与模式识别 · 计算机科学 2021-06-18 Chen Wei , Kihyuk Sohn , Clayton Mellina , Alan Yuille , Fan Yang