English
Related papers

Related papers: Continuous Soft Pseudo-Labeling in ASR

200 papers

We propose a novel semi-supervised learning (SSL) method that adopts selective training with pseudo labels. In our method, we generate hard pseudo-labels and also estimate their confidence, which represents how likely each pseudo-label is…

Machine Learning · Computer Science 2021-03-16 Masato Ishii

In semi-supervised learning, methods that rely on confidence learning to generate pseudo-labels have been widely proposed. However, increasing research finds that when faced with noisy and biased data, the model's representation network is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Yanbiao Ma , Licheng Jiao , Fang Liu , Lingling Li , Shuyuan Yang , Xu Liu

To safely deploy autonomous vehicles, onboard perception systems must work reliably at high accuracy across a diverse set of environments and geographies. One of the most common techniques to improve the efficacy of such systems in new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Benjamin Caine , Rebecca Roelofs , Vijay Vasudevan , Jiquan Ngiam , Yuning Chai , Zhifeng Chen , Jonathon Shlens

Pseudo-labeling is a popular semi-supervised learning technique to leverage unlabeled data when labeled samples are scarce. The generation and selection of pseudo-labels heavily rely on labeled data. Existing approaches implicitly assume…

Machine Learning · Computer Science 2024-06-21 Nabeel Seedat , Nicolas Huynh , Fergus Imrie , Mihaela van der Schaar

There is a family of label modification approaches including self and non-self label correction (LC), and output regularisation. They are widely used for training robust deep neural networks (DNNs), but have not been mathematically and…

Machine Learning · Computer Science 2022-09-07 Xinshao Wang , Yang Hua , Elyor Kodirov , Sankha Subhra Mukherjee , David A. Clifton , Neil M. Robertson

Recently, unified speech-text models, such as SpeechGPT, VioLA, and AudioPaLM, have achieved remarkable performance on various speech tasks. These models discretize speech signals into tokens (speech discretization) and use a shared…

Computation and Language · Computer Science 2024-02-06 Qian Chen , Wen Wang , Qinglin Zhang , Siqi Zheng , Shiliang Zhang , Chong Deng , Yukun Ma , Hai Yu , Jiaqing Liu , Chong Zhang

Person re-identification aims to match a person's identity across multiple camera streams. Deep neural networks have been successfully applied to the challenging person re-identification task. One remarkable bottleneck is that the existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Guodong Ding , Shanshan Zhang , Salman Khan , Zhenmin Tang , Jian Zhang , Fatih Porikli

Self-training (ST) is a simple yet effective semi-supervised learning method. However, why and how ST improves generalization performance by using potentially erroneous pseudo-labels is still not well understood. To deepen the understanding…

Machine Learning · Statistics 2024-05-08 Takashi Takahashi

Annotating large-scale LiDAR point clouds for 3D semantic segmentation is costly and time-consuming, which motivates the use of semi-supervised learning (SemiSL). Standard LiDAR SemiSL methods typically adopt a two-step training paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Bin Yang , Alexandru Paul Condurache

Partial Label Learning (PLL) aims to train a classifier when each training instance is associated with a set of candidate labels, among which only one is correct but is not accessible during the training phase. The common strategy dealing…

Machine Learning · Computer Science 2020-02-28 Yao Yao , Chen Gong , Jiehui Deng , Jian Yang

Despite significant advances, the performance of state-of-the-art continual learning approaches hinges on the unrealistic scenario of fully labeled data. In this paper, we tackle this challenge and propose an approach for continual…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Zhiqi Kang , Enrico Fini , Moin Nabi , Elisa Ricci , Karteek Alahari

Partial label learning (PLL) is a class of weakly supervised learning where each training instance consists of a data and a set of candidate labels containing a unique ground truth label. To tackle this problem, a majority of current…

Machine Learning · Computer Science 2021-02-09 Junghoon Seo , Joon Suk Huh

As the size of pre-trained speech recognition models increases, running these large models in low-latency or resource-constrained environments becomes challenging. In this work, we leverage pseudo-labelling to assemble a large-scale…

Computation and Language · Computer Science 2023-11-02 Sanchit Gandhi , Patrick von Platen , Alexander M. Rush

Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Yang Zou , Zhiding Yu , Xiaofeng Liu , B. V. K. Vijaya Kumar , Jinsong Wang

Partial label learning (PLL) learns from training examples each associated with multiple candidate labels, among which only one is valid. In recent years, benefiting from the strong capability of dealing with ambiguous supervision and the…

Artificial Intelligence · Computer Science 2024-02-28 Qian-Wei Wang , Bowen Zhao , Mingyan Zhu , Tianxiang Li , Zimo Liu , Shu-Tao Xia

Dataset pruning reduces the storage and training costs of deep learning by selecting an informative subset from a large dataset. However, most existing pruning methods require fully labeled data, which limits their applicability in…

Machine Learning · Computer Science 2026-05-25 Yeseul Cho , Baekrok Shin , Changmin Kang , Chulhee Yun

Surgical tool detection in minimally invasive surgery is an essential part of computer-assisted interventions. Current approaches are mostly based on supervised methods which require large fully labeled data to train supervised models and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Mansoor Ali , Gilberto Ochoa-Ruiz , Sharib Ali

With the rapid progress of speech language models (SLMs), discrete speech tokens have emerged as a core interface between speech and text, enabling unified modeling across modalities. Recent speech tokenization approaches aim to isolate…

Computation and Language · Computer Science 2025-06-23 Daejin Jo , Jeeyoung Yun , Byungseok Roh , Sungwoong Kim

Recent advances in pre-trained vision-language models have demonstrated remarkable zero-shot generalization capabilities. To further enhance these models' adaptability to various downstream tasks, prompt tuning has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yang Chen , Yanbin Wei , Ke Jin , Yi Kong , James Kwok , Yu Zhang

Semi-Supervised Video Paragraph Grounding (SSVPG) aims to localize multiple sentences in a paragraph from an untrimmed video with limited temporal annotations. Existing methods focus on teacher-student consistency learning and video-level…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yaokun Zhong , Siyu Jiang , Jian Zhu , Jian-Fang Hu