English
Related papers

Related papers: Comparison of semi-supervised deep learning algori…

200 papers

Semi-supervised learning (SSL) uses unlabeled data to improve the performance of machine learning models when labeled data is scarce. However, its real-world applications often face the label distribution mismatch problem, in which the…

Machine Learning · Computer Science 2025-08-05 Jinsoo Bae , Seoung Bum Kim , Hyungrok Do

Speech discrete representation has proven effective in various downstream applications due to its superior compression rate of the waveform, fast convergence during training, and compatibility with other modalities. Discrete units extracted…

Sound · Computer Science 2024-06-17 Jiatong Shi , Xutai Ma , Hirofumi Inaguma , Anna Sun , Shinji Watanabe

Acoustic scene classification (ASC) predominantly relies on supervised approaches. However, acquiring labeled data for training ASC models is often costly and time-consuming. Recently, self-supervised learning (SSL) has emerged as a…

Sound · Computer Science 2024-08-28 Yiqiang Cai , Shengchen Li , Xi Shao

Machine hearing or listening represents an emerging area. Conventional approaches rely on the design of handcrafted features specialized to a specific audio task and that can hardly generalized to other audio fields. For example,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Imad Rida , Romain Hérault , Gilles Gasso

Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely on the fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sneha Paul , Zachary Patterson , Nizar Bouguila

After its sweeping success in vision and language tasks, pure attention-based neural architectures (e.g. DeiT) are emerging to the top of audio tagging (AT) leaderboards, which seemingly obsoletes traditional convolutional neural networks…

Sound · Computer Science 2022-08-25 Juncheng B Li , Shuhui Qu , Po-Yao Huang , Florian Metze

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Semi-supervised learning and domain adaptation techniques have drawn increasing attention in the field of domestic sound event detection thanks to the availability of large amounts of unlabeled data and the relative ease to generate…

Sound · Computer Science 2022-08-18 Fang-Ching Chen , Kuan-Dar Chen , Yi-Wen Liu

Deep learning techniques have greatly enhanced the performance of fire detection in videos. However, video-based fire detection models heavily rely on labeled data, and the process of data labeling is particularly costly and time-consuming,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Qinghua Lin , Zuoyong Li , Kun Zeng , Haoyi Fan , Wei Li , Xiaoguang Zhou

The high cost of data labeling presents a major barrier to deploying machine learning systems at scale. Semi-supervised learning (SSL) mitigates this challenge by utilizing unlabeled data alongside limited labeled examples, while the…

Machine Learning · Computer Science 2025-05-30 Jichan Chung , Irene Y. Chen

Non-intrusive speech quality assessment (SQA) systems suffer from limited training data and costly human annotations, hindering their generalization to real-time conferencing calls. In this work, we propose leveraging large language models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-11 Fredrik Cumlin , Xinyu Liang , Anubhab Ghosh , Saikat Chatterjee

Adversarial audio attacks can be considered as a small perturbation unperceptive to human ears that is intentionally added to the audio signal and causes a machine learning model to make mistakes. This poses a security concern about the…

Machine Learning · Computer Science 2019-11-26 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

Contrastive learning and equivariant learning are effective methods for self-supervised learning (SSL) for audio content analysis. Yet, their application to music information retrieval (MIR) faces a dilemma: the former is more effective on…

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

Recently, deep neural network (DNN)-based speech enhancement (SE) systems have been used with great success. During training, such systems require clean speech data - ideally, in large quantity with a variety of acoustic conditions, many…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-27 Koichi Saito , Stefan Uhlich , Giorgio Fabbro , Yuki Mitsufuji

Semi-supervised learning (SSL) is an active area of research which aims to utilize unlabelled data in order to improve the accuracy of speech recognition systems. The current study proposes a methodology for integration of two key ideas: 1)…

Computation and Language · Computer Science 2020-08-11 Prakhar Swarup , Debmalya Chakrabarty , Ashtosh Sapru , Hitesh Tulsiani , Harish Arsikere , Sri Garimella

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

Masked latent prediction has emerged as a leading paradigm in self-supervised learning (SSL), especially for general audio and music representation learning. While recent methods have demonstrated strong performance, the role of the…

Sound · Computer Science 2025-08-19 Aurian Quelennec , Pierre Chouteau , Geoffroy Peeters , Slim Essid

Deep learning with noisy labels is a challenging task. Recent prominent methods that build on a specific sample selection (SS) strategy and a specific semi-supervised learning (SSL) model achieved state-of-the-art performance. Intuitively,…

Machine Learning · Computer Science 2020-12-03 Zhuowei Wang , Jing Jiang , Bo Han , Lei Feng , Bo An , Gang Niu , Guodong Long

This paper presents a novel deep learning architecture for acoustic model in the context of Automatic Speech Recognition (ASR), termed as MixNet. Besides the conventional layers, such as fully connected layers in DNN-HMM and memory cells in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-03 Vishwanath Pratap Singh , Shakti P. Rath , Abhishek Pandey