English
Related papers

Related papers: Jeffreys divergence-based regularization of neural…

200 papers

In far-field speaker verification, the performance of speaker embeddings is susceptible to degradation when there is a mismatch between the conditions of enrollment and test speech. To solve this problem, we propose the feature-level and…

Sound · Computer Science 2021-06-18 Li Zhang , Qing Wang , Kong Aik Lee , Lei Xie , Haizhou Li

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

Machine Learning · Statistics 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

Previous work has proposed many new loss functions and regularizers that improve test accuracy on image classification tasks. However, it is not clear whether these loss functions learn better representations for downstream tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Simon Kornblith , Ting Chen , Honglak Lee , Mohammad Norouzi

The problem of detecting whether a test sample is from in-distribution (i.e., training distribution by a classifier) or out-of-distribution sufficiently different from it arises in many real-world machine learning applications. However, the…

Machine Learning · Statistics 2018-02-27 Kimin Lee , Honglak Lee , Kibok Lee , Jinwoo Shin

This paper presents a comprehensive review of loss functions and performance metrics in deep learning, highlighting key developments and practical insights across diverse application areas. We begin by outlining fundamental considerations…

Trans-dimensional random field language models (TRF LMs) where sentences are modeled as a collection of random fields, have shown close performance with LSTM LMs in speech recognition and are computationally more efficient in inference.…

Computation and Language · Computer Science 2017-10-31 Bin Wang , Zhijian Ou

In this paper, we propose an iterative framework for self-supervised speaker representation learning based on a deep neural network (DNN). The framework starts with training a self-supervision speaker embedding network by maximizing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Danwei Cai , Weiqing Wang , Ming Li

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications. However, deep neural networks are also known to have very little control over its uncertainty for unseen…

Machine Learning · Computer Science 2019-04-23 Wenhu Chen , Yilin Shen , Hongxia Jin , William Wang

Speaker segmentation consists in partitioning a conversation between one or more speakers into speaker turns. Usually addressed as the late combination of three sub-tasks (voice activity detection, speaker change detection, and overlapped…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-11 Hervé Bredin , Antoine Laurent

Speaker identification, determining which character said each utterance in literary text, benefits many downstream tasks. Most existing approaches use expert-defined rules or rule-based features to directly approach this task, but these…

Computation and Language · Computer Science 2022-10-13 Ben Zhou , Dian Yu , Dong Yu , Dan Roth

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Echo path delay (or ref-delay) estimation is a big challenge in acoustic echo cancellation. Different devices may introduce various ref-delay in practice. Ref-delay inconsistency slows down the convergence of adaptive filters, and also…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Yi Zhang , Chengyun Deng , Shiqian Ma , Yongtao Sha , Hui Song

This paper proposes an online target speaker voice activity detection system for speaker diarization tasks, which does not require a priori knowledge from the clustering-based diarization system to obtain the target speaker embeddings. By…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-16 Weiqing Wang , Ming Li

Deep learning-based speech enhancement for real-time applications recently made large advancements. Due to the lack of a tractable perceptual optimization target, many myths around training losses emerged, whereas the contribution to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-28 Sebastian Braun , Ivan Tashev

Deep neural network based speaker recognition systems can easily be deceived by an adversary using minuscule imperceptible perturbations to the input speech samples. These adversarial attacks pose serious security threats to the speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-02 Monisankha Pal , Arindam Jati , Raghuveer Peri , Chin-Cheng Hsu , Wael AbdAlmageed , Shrikanth Narayanan

In this work, we introduce metric learning (ML) to enhance the deep embedding learning for text-independent speaker verification (SV). Specifically, the deep speaker embedding network is trained with conventional cross entropy loss and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-24 Yafeng Chen , Wu Guo , Jingjing Shi , Jiajun Qi , Tan Liu

Choosing a suitable loss function is essential when learning by empirical risk minimisation. In many practical cases, the datasets used for training a classifier may contain incorrect labels, which prompts the interest for using loss…

Machine Learning · Computer Science 2024-05-15 Henrique K. Miyamoto , Fábio C. C. Meneghetti , Sueli I. R. Costa

With the explosive growth of deep learning applications and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial recognition system, some individuals…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Dasol Choi , Dongbin Na

Cross-entropy loss and focal loss are the most common choices when training deep neural networks for classification problems. Generally speaking, however, a good loss function can take on much more flexible forms, and should be tailored for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhaoqi Leng , Mingxing Tan , Chenxi Liu , Ekin Dogus Cubuk , Xiaojie Shi , Shuyang Cheng , Dragomir Anguelov

Building multispeaker neural network-based text-to-speech synthesis systems commonly relies on the availability of large amounts of high quality recordings from each speaker and conditioning the training process on the speaker's identity or…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-04 Beata Lorincz , Adriana Stan , Mircea Giurgiu