English
Related papers

Related papers: Semi-supervised learning using teacher-student mod…

200 papers

In Self-Supervised Learning (SSL), Audio-Visual Correspondence (AVC) is a popular task to learn deep audio and video features from large unlabeled datasets. The key step in AVC is to randomly sample audio and video clips from the dataset…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-06 Shanshan Wang , Soumya Tripathy , Toni Heittola , Annamaria Mesaros

In this paper, we address a complex but practical scenario in semi-supervised learning (SSL) named open-set SSL, where unlabeled data contain both in-distribution (ID) and out-of-distribution (OOD) samples. Unlike previous methods that only…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Ganlong Zhao , Guanbin Li , Yipeng Qin , Jinjin Zhang , Zhenhua Chai , Xiaolin Wei , Liang Lin , Yizhou Yu

Due to the semantic complexity of the Relation extraction (RE) task, obtaining high-quality human labelled data is an expensive and noisy process. To improve the sample efficiency of the models, semi-supervised learning (SSL) methods aim to…

Computation and Language · Computer Science 2023-06-21 Komal K. Teru

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts. This study investigates class-level confidence as an indicator of learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Zhimin Chen , Bing Li

Semi-Supervised Learning (SSL) has achieved great success in overcoming the difficulties of labeling and making full use of unlabeled data. However, SSL has a limited assumption that the numbers of samples in different classes are balanced,…

Machine Learning · Computer Science 2020-02-18 Minsung Hyun , Jisoo Jeong , Nojun Kwak

Deep learning models achieve strong performance for radiology image classification, but their practical application is bottlenecked by the need for large labeled training datasets. Semi-supervised learning (SSL) approaches leverage small…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Balagopal Unnikrishnan , Cuong Nguyen , Shafa Balaram , Chao Li , Chuan Sheng Foo , Pavitra Krishnaswamy

Accurate segmentation of ultrasound (US) images of the cervical muscles is crucial for precision healthcare. The demand for automatic computer-assisted methods is high. However, the scarcity of labeled data hinders the development of these…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Fangyijie Wang , Kathleen M. Curran , Guénolé Silvestre

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

There has been increasing attention to semi-supervised learning (SSL) approaches in machine learning to forming a classifier in situations where the training data for a classifier consists of a limited number of classified observations but…

Machine Learning · Statistics 2021-11-10 Daniel Ahfock , Geoffrey J. McLachlan

In this work, we develop a joint sample discovery and iterative model evolution method for semi-supervised learning on very small labeled training sets. We propose a master-teacher-student model framework to provide multi-layer guidance…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Yang Li , Jianhe Yuan , Zhiqun Zhao , Hao Sun , Zhihai He

Self-supervised learning (SSL) algorithms have emerged as powerful tools that can leverage large quantities of unlabeled audio data to pre-train robust representations that support strong performance on diverse downstream tasks. Up to now…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-05 Mattson Ogg

The recent success of large pre-trained language models (PLMs) heavily hinges on massive labeled data, which typically produces inferior performance in low-resource scenarios. To remedy this dilemma, we study self-training as one of the…

Machine Learning · Computer Science 2023-10-23 Jianing Wang , Qiushi Sun , Nuo Chen , Chengyu Wang , Jun Huang , Ming Gao , Xiang Li

Semi-supervised learning (SSL) has attracted enormous attention due to its vast potential of mitigating the dependence on large labeled datasets. The latest methods (e.g., FixMatch) use a combination of consistency regularization and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yuhao Chen , Xin Tan , Borui Zhao , Zhaowei Chen , Renjie Song , Jiajun Liang , Xuequan Lu

Compared to supervised learning, semi-supervised learning reduces the dependence of deep learning on a large number of labeled samples. In this work, we use a small number of labeled samples and perform data augmentation on unlabeled…

Machine Learning · Computer Science 2020-01-14 Qiuyu Zhu , Tiantian Li

Federated Learning is a distributed machine learning paradigm dealing with decentralized and personal datasets. Since data reside on devices like smartphones and virtual assistants, labeling is entrusted to the clients, or labels are…

Machine Learning · Computer Science 2022-02-28 Vasileios Tsouvalas , Aaqib Saeed , Tanir Ozcelebi

In this work, we examine the robustness of state-of-the-art semi-supervised learning (SSL) algorithms when applied to morphological classification in modern radio astronomy. We test whether SSL can achieve performance comparable to the…

Astrophysics of Galaxies · Physics 2022-02-02 Inigo V. Slijepcevic , Anna M. M. Scaife

The remarkable success of today's deep neural networks highly depends on a massive number of correctly labeled data. However, it is rather costly to obtain high-quality human-labeled data, leading to the active research area of training…

Machine Learning · Computer Science 2020-11-04 Jiacheng Wang , Yue Ma , Shuang Gao

Self-supervised learning (SSL) is a machine learning approach where the data itself provides supervision, eliminating the need for external labels. The model is forced to learn about the data structure or context by solving a pretext task.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Markus Marks , Manuel Knott , Neehar Kondapaneni , Elijah Cole , Thijs Defraeye , Fernando Perez-Cruz , Pietro Perona

Automated brain lesion segmentation provides valuable information for the analysis and intervention of patients. In particular, methods based on convolutional neural networks (CNNs) have achieved state-of-the-art segmentation performance.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Wenhui Cui , Yanlin Liu , Yuxing Li , Menghao Guo , Yiming Li , Xiuli Li , Tianle Wang , Xiangzhu Zeng , Chuyang Ye

Semi-supervised learning (SSL) effectively leverages unlabeled data and has been proven successful across various fields. Current safe SSL methods believe that unseen classes in unlabeled data harm the performance of SSL models. However,…

Machine Learning · Computer Science 2025-03-04 Rundong He , Yicong Dong , Lanzhe Guo , Yilong Yin , Tailin Wu