English
Related papers

Related papers: There Are Many Consistent Explanations of Unlabele…

200 papers

In many applications, training machine learning models involves using large amounts of human-annotated data. Obtaining precise labels for the data is expensive. Instead, training with weak supervision provides a low-cost alternative. We…

Machine Learning · Computer Science 2022-02-09 Chidubem Arachie , Bert Huang

Deep neural networks produce state-of-the-art results when trained on a large number of labeled examples but tend to overfit when small amounts of labeled examples are used for training. Creating a large number of labeled examples requires…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Attaullah Sahito , Eibe Frank , Bernhard Pfahringer

We propose a method for semi-supervised training of structured-output neural networks. Inspired by the framework of Generative Adversarial Networks (GAN), we train a discriminator network to capture the notion of a quality of network…

Computer Vision and Pattern Recognition · Computer Science 2017-02-09 Mateusz Koziński , Loïc Simon , Frédéric Jurie

These days deep learning is the fastest-growing area in the field of Machine Learning. Convolutional Neural Networks are currently the main tool used for image analysis and classification purposes. Although great achievements and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Agnieszka Mikołajczyk , Michał Grochowski

We investigate the convergence rates and data sample sizes required for training a machine learning model using a stochastic gradient descent (SGD) algorithm, where data points are sampled based on either their loss value or uncertainty…

Machine Learning · Computer Science 2024-11-26 Daniel Haimovich , Dima Karamshuk , Fridolin Linder , Niek Tax , Milan Vojnovic

Semi-supervised learning (SSL) is a key approach toward more data-efficient machine learning by jointly leverage both labeled and unlabeled data. We propose AlphaMatch, an efficient SSL method that leverages data augmentations, by…

Machine Learning · Computer Science 2020-11-25 Chengyue Gong , Dilin Wang , Qiang Liu

Federated learning (FL) is a promising way to use the computing power of mobile devices while maintaining the privacy of users. Current work in FL, however, makes the unrealistic assumption that the users have ground-truth labels on their…

Machine Learning · Computer Science 2021-03-10 Zhengming Zhang , Yaoqing Yang , Zhewei Yao , Yujun Yan , Joseph E. Gonzalez , Michael W. Mahoney

In semi-supervised learning (SSL), a technique called consistency regularization (CR) achieves high performance. It has been proved that the diversity of data used in CR is extremely important to obtain a model with high discrimination…

Machine Learning · Computer Science 2020-04-03 Hiroshi Kaizuka

Semi-supervised learning (SSL) arises in practice when labeled data are scarce or expensive to obtain, while large quantities of unlabeled data are readily available. With the growing adoption of machine learning techniques, it has become…

Machine Learning · Statistics 2026-05-29 Jiawei Shan , Zhifeng Chen , Yiming Dong , Yazhen Wang , Jiwei Zhao

With fully leveraging the value of unlabeled data, semi-supervised medical image segmentation algorithms significantly reduces the limitation of limited labeled data, achieving a significant improvement in accuracy. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jialu Zhou , Dianxi Shi , Shaowu Yang , Chunping Qiu , Luoxi Jing , Mengzhu Wang

Stochastic gradient descent (SGD) has been widely studied in the literature from different angles, and is commonly employed for solving many big data machine learning problems. However, the averaging technique, which combines all iterative…

Machine Learning · Computer Science 2020-05-28 Zhishuai Guo , Yan Yan , Tianbao Yang

Concept shift is a prevailing problem in natural tasks like medical image segmentation where samples usually come from different subpopulations with variant correlations between features and labels. One common type of concept shift in…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Yijun Dong , Yuege Xie , Rachel Ward

Semi-supervised learning provides an effective paradigm for leveraging unlabeled data to improve a model's performance. Among the many strategies proposed, graph-based methods have shown excellent properties, in particular since they allow…

Machine Learning · Statistics 2021-03-29 Mourad El Hamri , Younès Bennani

Semi-supervised Learning (SSL) has witnessed great success owing to the impressive performances brought by various methods based on pseudo labeling and consistency regularization. However, we argue that existing methods might fail to…

Well-annotated medical images are costly and sometimes even impossible to acquire, hindering landmark detection accuracy to some extent. Semi-supervised learning alleviates the reliance on large-scale annotated data by exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Runnan Chen , Yuexin Ma , Lingjie Liu , Nenglun Chen , Zhiming Cui , Guodong Wei , Wenping Wang

Learned reweighting (LRW) approaches to supervised learning use an optimization criterion to assign weights for training instances, in order to maximize performance on a representative validation dataset. We pose and formalize the problem…

Machine Learning · Computer Science 2024-04-01 Nishant Jain , Arun S. Suggala , Pradeep Shenoy

Semi-supervised learning acts as an effective way to leverage massive unlabeled data. In this paper, we propose a novel training strategy, termed as Semi-supervised Contrastive Learning (SsCL), which combines the well-known contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yuhang Zhang , Xiaopeng Zhang , Robert. C. Qiu , Jie Li , Haohang Xu , Qi Tian

Semi-supervised semantic segmentation (SSSS) aims to improve segmentation performance by utilizing large amounts of unlabeled data with limited labeled samples. Existing methods often suffer from coupling, where over-reliance on initial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Ebenezer Tarubinga , Jenifer Kalafatovich , Seong-Whan Lee

In this paper, we introduce a realistic and challenging domain adaptation problem called Universal Semi-supervised Model Adaptation (USMA), which i) requires only a pre-trained source model, ii) allows the source and target domain to have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Zizheng Yan , Yushuang Wu , Yipeng Qin , Xiaoguang Han , Shuguang Cui , Guanbin Li

The scarcity of labeled data often limits the application of supervised deep learning techniques for medical image segmentation. This has motivated the development of semi-supervised techniques that learn from a mixture of labeled and…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Gerda Bortsova , Florian Dubost , Laurens Hogeweg , Ioannis Katramados , Marleen de Bruijne