English
Related papers

Related papers: AlphaMatch: Improving Consistency for Semi-supervi…

200 papers

The current success of deep neural networks (DNNs) in an increasingly broad range of tasks involving artificial intelligence strongly depends on the quality and quantity of labeled training data. In general, the scarcity of labeled data,…

Computation and Language · Computer Science 2018-11-21 Shun Kiyono , Jun Suzuki , Kentaro Inui

Self-supervised learning (SSL) has become the de facto training paradigm of large models, where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Despite demonstrating comparable performance with…

Machine Learning · Computer Science 2024-06-05 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

Given a small set of labeled data and a large set of unlabeled data, semi-supervised learning (SSL) attempts to leverage the location of the unlabeled datapoints in order to create a better classifier than could be obtained from supervised…

Machine Learning · Computer Science 2022-05-25 Michael C. Burkhart , Kyle Shan

Semi-supervised learning (SSL) is a widely used technique in scenarios where labeled data is scarce and unlabeled data is abundant. While SSL is popular for image and text classification, it is relatively underexplored for the task of…

Computation and Language · Computer Science 2024-07-03 Gaurav Sahu , Olga Vechtomova , Issam H. Laradji

Consistency regularization on label predictions becomes a fundamental technique in semi-supervised learning, but it still requires a large number of training iterations for high performance. In this study, we analyze that the consistency…

Machine Learning · Computer Science 2022-06-10 Doyup Lee , Sungwoong Kim , Ildoo Kim , Yeongjae Cheon , Minsu Cho , Wook-Shin Han

Quantum entanglement lies at the heart in quantum information processing tasks. Although many criteria have been proposed, efficient and scalable methods to detect the entanglement of generally given quantum states are still not available…

Quantum Physics · Physics 2023-08-30 Lifeng Zhang , Zhihua Chen , Shao-Ming Fei

Self-Supervised Learning (SSL) is crucial for real-world applications, especially in data-hungry domains such as healthcare and self-driving cars. In addition to a lack of labeled data, these applications also suffer from distributional…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Ha Manh Bui , Iliana Maifeld-Carucci

The capability of the traditional semi-supervised learning (SSL) methods is far from real-world application due to severely biased pseudo-labels caused by (1) class imbalance and (2) class distribution mismatch between labeled and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Youngtaek Oh , Dong-Jin Kim , In So Kweon

Self-supervised learning (SSL) has emerged as a promising alternative to create supervisory signals to real-world problems, avoiding the extensive cost of manual labeling. SSL is particularly attractive for unsupervised tasks such as…

Machine Learning · Computer Science 2023-07-31 Jaemin Yoo , Tiancheng Zhao , Leman Akoglu

Semi-supervised learning (SSL) has become an interesting research area due to its capacity for learning in scenarios where both labeled and unlabeled data are available. In this work, we focus on the task of transduction - when the…

Machine Learning · Computer Science 2022-06-15 Emílio Bergamim , Fabricio Breve

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Pseudo-labeling is a key component in semi-supervised learning (SSL). It relies on iteratively using the model to generate artificial labels for the unlabeled data to train against. A common property among its various methods is that they…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Islam Nassar , Samitha Herath , Ehsan Abbasnejad , Wray Buntine , Gholamreza Haffari

Semi-supervised learning (SSL) has achieved significant progress by leveraging both labeled data and unlabeled data. Existing SSL methods overlook a common real-world scenario when labeled data is extremely scarce, potentially as limited as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Hezhao Liu , Yang Lu , Mengke Li , Yiqun Zhang , Shreyank N Gowda , Chen Gong , Hanzi Wang

Recent semi-supervised learning (SSL) methods typically include a filtering strategy to improve the quality of pseudo labels. However, these filtering strategies are usually hand-crafted and do not change as the model is updated, resulting…

Machine Learning · Computer Science 2023-09-19 Lei Zhu , Zhanghan Ke , Rynson Lau

Compared to supervised learning, semi-supervised learning reduces the dependence of deep learning on a large number of labeled samples. In this work, we use a small number of labeled samples and perform data augmentation on unlabeled…

Machine Learning · Computer Science 2020-01-14 Qiuyu Zhu , Tiantian Li

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the requirement of a large number of human annotations of quality. In this work, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Shankhanil Mitra , Saiyam Jogani , Rajiv Soundararajan

In typical medical image classification problems, labeled data is scarce while unlabeled data is more available. Semi-supervised learning and self-supervised learning are two different research directions that can improve accuracy by…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhe Huang , Ruijie Jiang , Shuchin Aeron , Michael C. Hughes

Recently proposed consistency-based Semi-Supervised Learning (SSL) methods such as the $\Pi$-model, temporal ensembling, the mean teacher, or the virtual adversarial training, have advanced the state of the art in several SSL tasks. These…

Machine Learning · Statistics 2021-01-19 Atin Ghosh , Alexandre H. Thiery

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

Machine Learning · Computer Science 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo