English
Related papers

Related papers: Enhancing Mixup-based Semi-Supervised Learning wit…

200 papers

Semi-Supervised Learning (SSL) aims to learn a model using a tiny labeled set and massive amounts of unlabeled data. To better exploit the unlabeled data the latest SSL methods use pseudo-labels predicted from a single discriminative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Zhongying Deng , Rihuan Ke , Carola-Bibiane Schonlieb , Angelica I Aviles-Rivero

Semi-supervised learning (SSL) tackles the label missing problem by enabling the effective usage of unlabeled data. While existing SSL methods focus on the traditional setting, a practical and challenging scenario called label Missing Not…

Machine Learning · Computer Science 2023-08-21 Yue Duan , Zhen Zhao , Lei Qi , Luping Zhou , Lei Wang , Yinghuan Shi

While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced. However, these SSL…

Machine Learning · Computer Science 2021-09-14 Jaehyung Kim , Youngbum Hur , Sejun Park , Eunho Yang , Sung Ju Hwang , Jinwoo Shin

Self-supervised learning (SSL) has emerged as a promising paradigm in medical imaging, addressing the chronic challenge of limited labeled data in healthcare settings. While SSL has shown impressive results, existing studies in the medical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Valay Bundele , Karahan Sarıtaş , Bora Kargi , Oğuz Ata Çal , Kıvanç Tezören , Zohreh Ghaderi , Hendrik Lensch

We propose UnMixMatch, a semi-supervised learning framework which can learn effective representations from unconstrained unlabelled data in order to scale up performance. Most existing semi-supervised methods rely on the assumption that…

Machine Learning · Computer Science 2024-01-17 Shuvendu Roy , Ali Etemad

Semi-Supervised Learning (SSL) has achieved great success in overcoming the difficulties of labeling and making full use of unlabeled data. However, SSL has a limited assumption that the numbers of samples in different classes are balanced,…

Machine Learning · Computer Science 2020-02-18 Minsung Hyun , Jisoo Jeong , Nojun Kwak

This paper addresses theory and applications of $\ell_p$-based Laplacian regularization in semi-supervised learning. The graph $p$-Laplacian for $p>2$ has been proposed recently as a replacement for the standard ($p=2$) graph Laplacian in…

Numerical Analysis · Mathematics 2022-01-28 Mauricio Flores , Jeff Calder , Gilad Lerman

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Machine Learning · Computer Science 2024-01-04 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Self-supervised learning (SSL) has achieved remarkable performance in various medical imaging tasks by dint of priors from massive unlabelled data. However, regarding a specific downstream task, there is still a lack of an instruction book…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Chuyan Zhang , Yun Gu

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled samples. With…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xinkai Yuan , Zilinghan Li , Gaoang Wang

Semi-supervised learning (SSL) algorithms struggle to perform well when exposed to imbalanced training data. In this scenario, the generated pseudo-labels can exhibit a bias towards the majority class, and models that employ these…

Machine Learning · Computer Science 2024-09-18 Zeju Li , Ying-Qiu Zheng , Chen Chen , Saad Jbabdi

Self-supervised learning (SSL) has developed rapidly in recent years. However, most of the mainstream methods are computationally expensive and rely on two (or more) augmentations for each image to construct positive pairs. Moreover, they…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yun-Hao Cao , Jianxin Wu

Deep neural networks are powerful, massively parameterized machine learning models that have been shown to perform well in supervised learning tasks. However, very large amounts of labeled data are usually needed to train deep neural…

Machine Learning · Computer Science 2020-12-02 Hanchen Xie , Mohamed E. Hussein , Aram Galstyan , Wael Abd-Almageed

Mixup is a well-established data augmentation technique, which can extend the training distribution and regularize the neural networks by creating ''mixed'' samples based on the label-equivariance assumption, i.e., a proportional mixup of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Zongbo Han , Tianchi Xie , Bingzhe Wu , Qinghua Hu , Changqing Zhang

Feature attributions are a popular tool for explaining the behavior of Deep Neural Networks (DNNs), but have recently been shown to be vulnerable to attacks that produce divergent explanations for nearby inputs. This lack of robustness is…

Machine Learning · Computer Science 2020-10-23 Zifan Wang , Haofan Wang , Shakul Ramkumar , Matt Fredrikson , Piotr Mardziel , Anupam Datta

Semi-supervised learning (SSL) has become a crucial approach in deep learning as a way to address the challenge of limited labeled data. The success of deep neural networks heavily relies on the availability of large-scale high-quality…

Machine Learning · Computer Science 2023-09-13 Chien-Chih Wang , Shaoyuan Xu , Jinmiao Fu , Yang Liu , Bryan Wang

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

Pseudo-labeling is a crucial technique in semi-supervised learning (SSL), where artificial labels are generated for unlabeled data by a trained model, allowing for the simultaneous training of labeled and unlabeled data in a supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Khanh-Binh Nguyen , Joon-Sung Yang