English
Related papers

Related papers: A Semiparametric Efficient Approach To Label Shift…

200 papers

Self-training often falls short under distribution shifts due to an increased discrepancy between prediction confidence and actual accuracy. This typically necessitates computationally demanding methods such as neighborhood or…

Machine Learning · Computer Science 2024-11-04 Taejong Joo , Diego Klabjan

In this paper, we present a simple and efficient method for training deep neural networks in a semi-supervised setting where only a small portion of training data is labeled. We introduce self-ensembling, where we form a consensus…

Neural and Evolutionary Computing · Computer Science 2017-03-16 Samuli Laine , Timo Aila

We present label gradient alignment, a novel algorithm for semi-supervised learning which imputes labels for the unlabeled data and trains on the imputed labels. We define a semantically meaningful distance metric on the input space by…

Machine Learning · Computer Science 2019-02-07 Jacob Jackson , John Schulman

Classification is an essential and fundamental task in machine learning, playing a cardinal role in the field of natural language processing (NLP) and computer vision (CV). In a supervised learning setting, labels are always needed for the…

Computation and Language · Computer Science 2021-02-04 Irene Li

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

In semi-supervised representation learning frameworks, when the number of labelled data is very scarce, the quality and representativeness of these samples become increasingly important. Existing literature on semi-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Shuvendu Roy , Ali Etemad

Transfer learning aims to improve performance on a target task by leveraging information from related source tasks. We propose a nonparametric regression transfer learning framework that explicitly models heterogeneity in the source-target…

Statistics Theory · Mathematics 2026-03-19 Hélène Halconruy , Benjamin Bobbia , Paul Lejamtel

Semisupervised methods inevitably invoke some assumption that links the marginal distribution of the features to the regression function of the label. Most commonly, the cluster or manifold assumptions are used which imply that the…

Statistics Theory · Mathematics 2011-12-02 Martin Azizyan , Aarti Singh , Larry Wasserman

We consider a semi-supervised classification problem with non-stationary label-shift in which we observe a labelled data set followed by a sequence of unlabelled covariate vectors in which the marginal probabilities of the class labels may…

Statistics Theory · Mathematics 2024-05-29 Henry W J Reeve

Distance metric learning (DML) aims to find an appropriate way to reveal the underlying data relationship. It is critical in many machine learning, pattern recognition and data mining algorithms, and usually require large amount of label…

Machine Learning · Statistics 2018-11-13 Yong Luo , Yonggang Wen , Ling-Yu Duan , Dacheng Tao

In contemporary statistical learning, covariate shift correction plays an important role in transfer learning when distribution of the testing data is shifted from the training data. Importance weighting, as a natural and principle strategy…

Methodology · Statistics 2022-04-13 Molei Liu , Yi Zhang , Katherine P Liao , Tianxi Cai

Network traffic classification, which has numerous applications from security to billing and network provisioning, has become a cornerstone of today's computer networks. Previous studies have developed traffic classification techniques…

Networking and Internet Architecture · Computer Science 2020-05-19 Shahbaz Rezaei , Xin Liu

We address the challenging problem of Long-Tailed Semi-Supervised Learning (LTSSL) where labeled data exhibit imbalanced class distribution and unlabeled data follow an unknown distribution. Unlike in balanced SSL, the generated…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Chengcheng Ma , Ismail Elezi , Jiankang Deng , Weiming Dong , Changsheng Xu

When concept shifts and sample scarcity are present in the target domain of interest, nonparametric regression learners often struggle to generalize effectively. The technique of transfer learning remedies these issues by leveraging data or…

Machine Learning · Statistics 2025-01-22 Haotian Lin , Matthew Reimherr

Transfer learning is a critical technique in training deep neural networks for the challenging medical image segmentation task that requires enormous resources. With the abundance of medical image data, many research institutions release…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yuncheng Yang , Meng Wei , Junjun He , Jie Yang , Jin Ye , Yun Gu

Semi-supervised learning (SSL) has become an interesting research area due to its capacity for learning in scenarios where both labeled and unlabeled data are available. In this work, we focus on the task of transduction - when the…

Machine Learning · Computer Science 2022-06-15 Emílio Bergamim , Fabricio Breve

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully…

Artificial Intelligence · Computer Science 2026-01-09 Shogo Nakayama , Masahiro Okuda

As data volumes continue to grow, the labelling process increasingly becomes a bottleneck, creating demand for methods that leverage information from unlabelled data. Impressive results have been achieved in semi-supervised learning (SSL)…

Machine Learning · Computer Science 2020-07-07 Ivana Balažević , Carl Allen , Timothy Hospedales

Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community. In this paper, we introduced a new semi-supervised learning framework, SimMatch, which simultaneously considers…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Mingkai Zheng , Shan You , Lang Huang , Fei Wang , Chen Qian , Chang Xu

Semi-supervised instance segmentation poses challenges due to limited labeled data, causing difficulties in accurately localizing distinct object instances. Current teacher-student frameworks still suffer from performance constraints due to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Heeji Yoon , Heeseong Shin , Eunbeen Hong , Hyunwook Choi , Hansang Cho , Daun Jeong , Seungryong Kim