English
Related papers

Related papers: Curriculum learning for self-supervised speaker ve…

200 papers

Information on speaker characteristics can be useful as side information in improving speaker recognition accuracy. However, such information is often private. This paper investigates how privacy-preserving learning can improve a speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Filip Granqvist , Matt Seigel , Rogier van Dalen , Áine Cahill , Stephen Shum , Matthias Paulik

Deep neural networks achieve remarkable performances on a wide range of tasks with the aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor-exhaustive to obtain on realistic tasks. To mitigate the requirement…

Machine Learning · Computer Science 2022-11-10 Baixu Chen , Junguang Jiang , Ximei Wang , Pengfei Wan , Jianmin Wang , Mingsheng Long

We describe a novel weakly labeled Audio Event Classification approach based on a self-supervised attention model. The weakly labeled framework is used to eliminate the need for expensive data labeling procedure and self-supervised…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-09 Bongjun Kim , Shabnam Ghaffarzadegan

A number of studies have successfully developed speaker verification or presentation attack detection systems. However, studies integrating the two tasks remain in the preliminary stages. In this paper, we propose two approaches for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-29 Hye-jin Shim , Jee-weon Jung , Ju-ho Kim , Seung-bin Kim , Ha-Jin Yu

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

We propose dynamic curriculum learning via data parameters for noise robust keyword spotting. Data parameter learning has recently been introduced for image processing, where weight parameters, so-called data parameters, for target classes…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-22 Takuya Higuchi , Shreyas Saxena , Mehrez Souden , Tien Dung Tran , Masood Delfarah , Chandra Dhir

Fine tuning self supervised pretrained models using pseudo labels can effectively improve speech recognition performance. But, low quality pseudo labels can misguide decision boundaries and degrade performance. We propose a simple yet…

Sound · Computer Science 2022-11-01 Zezhong Jin , Dading Zhong , Xiao Song , Zhaoyi Liu , Naipeng Ye , Qingcheng Zeng

Pseudo-label learning methods have been widely applied in weakly-supervised temporal action localization. Existing works directly utilize weakly-supervised base model to generate instance-level pseudo-labels for training the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Quan Zhang , Yuxin Qi , Xi Tang , Rui Yuan , Xi Lin , Ke Zhang , Chun Yuan

We present a simple and effective self-supervised learning approach for speech recognition. The approach learns a model to predict the masked speech signals, in the form of discrete labels generated with a random-projection quantizer. In…

Computation and Language · Computer Science 2022-07-01 Chung-Cheng Chiu , James Qin , Yu Zhang , Jiahui Yu , Yonghui Wu

Curriculum learning techniques are a viable solution for improving the accuracy of automatic models, by replacing the traditional random training with an easy-to-hard strategy. However, the standard curriculum methodology does not…

Computer Vision and Pattern Recognition · Computer Science 2020-09-23 Petru Soviany

Speech representation learning approaches for non-semantic tasks such as language recognition have either explored supervised embedding extraction methods using a classifier model or self-supervised representation learning approaches using…

Computation and Language · Computer Science 2023-06-08 Shikhar Vashishth , Shikhar Bharadwaj , Sriram Ganapathy , Ankur Bapna , Min Ma , Wei Han , Vera Axelrod , Partha Talukdar

Most previous neural text-to-speech (TTS) methods are mainly based on supervised learning methods, which means they depend on a large training dataset and hard to achieve comparable performance under low-resource conditions. To address this…

Sound · Computer Science 2022-10-27 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is…

Computation and Language · Computer Science 2020-10-28 Chien-Sheng Wu , Steven Hoi , Caiming Xiong

Curriculum learning can improve neural network training by guiding the optimization to desirable optima. We propose a novel curriculum learning approach for image classification that adapts the loss function by changing the label…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Urun Dogan , Aniket Anand Deshmukh , Marcin Machura , Christian Igel

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

Machine Learning · Computer Science 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Recent research in speaker verification has increasingly focused on achieving robust and reliable recognition under challenging channel conditions and noisy environments. Identifying speakers in radio communications is particularly…

Sound · Computer Science 2024-06-18 Wenhao Yang , Jianguo Wei , Wenhuan Lu , Lei Li , Xugang Lu

Supervised neural approaches are hindered by their dependence on large, meticulously annotated datasets, a requirement that is particularly cumbersome for sequential tasks. The quality of annotations tends to deteriorate with the transition…

One paradigm for learning from few labeled examples while making best use of a large amount of unlabeled data is unsupervised pretraining followed by supervised fine-tuning. Although this paradigm uses unlabeled data in a task-agnostic way,…

Machine Learning · Computer Science 2020-10-27 Ting Chen , Simon Kornblith , Kevin Swersky , Mohammad Norouzi , Geoffrey Hinton
‹ Prev 1 8 9 10 Next ›