English
Related papers

Related papers: Pseudo strong labels for large scale weakly superv…

200 papers

Recent progress in speech recognition has relied on models trained on vast amounts of labeled data. However, classroom Automatic Speech Recognition (ASR) faces the real-world challenge of abundant weak transcripts paired with only a small…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-24 Ahmed Adel Attia , Dorottya Demszky , Jing Liu , Carol Espy-Wilson

The study of label noise in sound event recognition has recently gained attention with the advent of larger and noisier datasets. This work addresses the problem of missing labels, one of the big weaknesses of large audio datasets, and one…

The major driving force behind the immense success of deep learning models is the availability of large datasets along with their clean labels. Unfortunately, this is very difficult to obtain, which has motivated research on the training of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Devraj Mandal , Shrisha Bharadwaj , Soma Biswas

Self-training (ST) and self-supervised learning (SSL) methods have demonstrated strong improvements in automatic speech recognition (ASR). In spite of these advances, to the best of our knowledge, there is no analysis of how the composition…

Machine Learning · Computer Science 2023-03-03 Dan Berrebbi , Ronan Collobert , Navdeep Jaitly , Tatiana Likhomanenko

Supervised deep learning depends on massive accurately annotated examples, which is usually impractical in many real-world scenarios. A typical alternative is learning from multiple noisy annotators. Numerous earlier works assume that all…

Machine Learning · Computer Science 2022-03-09 Shikun Li , Tongliang Liu , Jiyong Tan , Dan Zeng , Shiming Ge

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak

Neural natural language generation (NLG) and understanding (NLU) models are data-hungry and require massive amounts of annotated data to be competitive. Recent frameworks address this bottleneck with generative models that synthesize weak…

Computation and Language · Computer Science 2021-02-09 Ernie Chang , Vera Demberg , Alex Marin

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Many datasets and approaches in ambient sound analysis use weakly labeled data.Weak labels are employed because annotating every data sample with a strong label is too expensive.Yet, their impact on the performance in comparison to strong…

Sound · Computer Science 2020-12-08 Nicolas Turpault , Romain Serizel , Emmanuel Vincent

Audio-Visual Source Localization (AVSL) is the task of identifying specific sounding objects in the scene given audio cues. In our work, we focus on semi-supervised AVSL with pseudo-labeling. To address the issues with vanilla hard…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Yuxin Guo , Shijie Ma , Yuhao Zhao , Hu Su , Wei Zou

We describe a novel weakly labeled Audio Event Classification approach based on a self-supervised attention model. The weakly labeled framework is used to eliminate the need for expensive data labeling procedure and self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-09 Bongjun Kim , Shabnam Ghaffarzadegan

Image-level weakly-supervised semantic segmentation (WSSS) reduces the usually vast data annotation cost by surrogate segmentation masks during training. The typical approach involves training an image classification network using global…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Arvi Jonnarth , Yushan Zhang , Michael Felsberg

Weakly supervised learning with scribble annotations uses sparse user-drawn strokes to indicate segmentation labels on a small subset of pixels. This annotation reduces the cost of dense pixel-wise labeling, but suffers inherently from…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Yeva Gabrielyan , Varduhi Yeghiazaryan , Irina Voiculescu

In the weakly supervised learning paradigm, labeling functions automatically assign heuristic, often noisy, labels to data samples. In this work, we provide a method for learning from weak labels by separating two types of complementary…

Machine Learning · Computer Science 2022-10-26 Andreas Stephan , Vasiliki Kougia , Benjamin Roth

Weakly supervised text classification methods typically train a deep neural classifier based on pseudo-labels. The quality of pseudo-labels is crucial to final performance but they are inevitably noisy due to their heuristic nature, so…

Computation and Language · Computer Science 2022-10-26 Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Lack of large-scale note-level labeled data is the major obstacle to singing transcription from polyphonic music. We address the issue by using pseudo labels from vocal pitch estimation models given unlabeled data. The proposed method first…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Sangeun Kum , Jongpil Lee , Keunhyoung Luke Kim , Taehyoung Kim , Juhan Nam

Annotating time boundaries of sound events is labor-intensive, limiting the scalability of strongly supervised learning in audio detection. To reduce annotation costs, weakly-supervised learning with only clip-level labels has been widely…

Sound · Computer Science 2025-10-30 Keisuke Imoto

Class-imbalanced graph node classification is a practical yet underexplored research problem. Although recent studies have attempted to address this issue, they typically assume clean and reliable labels when processing class-imbalanced…

Machine Learning · Computer Science 2025-07-28 Riting Xia , Rucong Wang , Yulin Liu , Anchen Li , Xueyan Liu , Yan Zhang

Creating large, good quality labeled data has become one of the major bottlenecks for developing machine learning applications. Multiple techniques have been developed to either decrease the dependence of labeled data (zero/few-shot…

Computation and Language · Computer Science 2023-02-08 Abhinav Bohra , Huy Nguyen , Devashish Khatwani