English
Related papers

Related papers: Cosine Scoring with Uncertainty for Neural Speaker…

200 papers

We introduce a new automatic evaluation method for speaker similarity assessment, that is consistent with human perceptual scores. Modern neural text-to-speech models require a vast amount of clean training data, which is why many solutions…

Sound · Computer Science 2022-07-04 Deja Kamil , Sanchez Ariadna , Roth Julian , Cotescu Marius

Personalized speech enhancement (PSE) models can improve the audio quality of teleconferencing systems by adapting to the characteristics of a speaker's voice. However, most existing methods require a separate speaker embedding model to…

Sound · Computer Science 2024-06-17 Tanel Pärnamaa , Ando Saabas

Modeling voice identity is challenging due to its multifaceted nature. In generative speech systems, identity is often assessed using automatic speaker verification (ASV) embeddings, designed for discrimination rather than characterizing…

Most speech enhancement (SE) models learn a point estimate and do not make use of uncertainty estimation in the learning process. In this paper, we show that modeling heteroscedastic uncertainty by minimizing a multivariate Gaussian…

Sound · Computer Science 2023-03-09 Kuan-Lin Chen , Daniel D. E. Wong , Ke Tan , Buye Xu , Anurag Kumar , Vamsi Krishna Ithapu

We investigate deep neural network performance in the textindependent speaker recognition task. We demonstrate that using angular softmax activation at the last classification layer of a classification neural network instead of a simple…

Sound · Computer Science 2018-04-27 Sergey Novoselov , Andrey Shulipa , Ivan Kremnev , Alexandr Kozlov , Vadim Shchemelinin

The superior performance of some of today's state-of-the-art deep learning models is to some extent owed to extensive (self-)supervised contrastive pretraining on large-scale datasets. In contrastive learning, the network is presented with…

Machine Learning · Computer Science 2022-07-20 Shervin Ardeshir , Navid Azizan

Speech enhancement aims to improve the perceptual quality of the speech signal by suppression of the background noise. However, excessive suppression may lead to speech distortion and speaker information loss, which degrades the performance…

Sound · Computer Science 2021-10-05 Yi Ma , Kong Aik Lee , Ville Hautamaki , Haizhou Li

In this work we focus on confidence modeling for neural semantic parsers which are built upon sequence-to-sequence models. We outline three major causes of uncertainty, and design various metrics to quantify these factors. These metrics are…

Computation and Language · Computer Science 2018-05-15 Li Dong , Chris Quirk , Mirella Lapata

In stochastic simulation, input uncertainty refers to the output variability arising from the statistical noise in specifying the input models. This uncertainty can be measured by a variance contribution in the output, which, in the…

Methodology · Statistics 2021-05-20 Henry Lam , Huajie Qian

Accurately quantifying uncertainty in large language models (LLMs) is crucial for their reliable deployment, especially in high-stakes applications. Current state-of-the-art methods for measuring semantic uncertainty in LLMs rely on strict…

Machine Learning · Computer Science 2024-10-31 Yashvir S. Grewal , Edwin V. Bonilla , Thang D. Bui

Static word embeddings are ubiquitous in computational social science applications and contribute to practical decision-making in a variety of fields including law and healthcare. However, assessing the statistical uncertainty in downstream…

Computation and Language · Computer Science 2024-06-19 Andrea Vallebueno , Cassandra Handan-Nader , Christopher D. Manning , Daniel E. Ho

Speech recognition technologies are gaining enormous popularity in various industrial applications. However, building a good speech recognition system usually requires large amounts of transcribed data, which is expensive to collect. To…

Computation and Language · Computer Science 2019-11-01 Dongwei Jiang , Xiaoning Lei , Wubo Li , Ne Luo , Yuxuan Hu , Wei Zou , Xiangang Li

Under noisy environments, to achieve the robust performance of speaker recognition is still a challenging task. Motivated by the promising performance of multi-task training in a variety of image processing tasks, we explore the potential…

Sound · Computer Science 2019-05-14 Jianfeng Zhou , Tao Jiang , Lin Li , Qingyang Hong , Zhe Wang , Bingyin Xia

Predicting audio quality in voice synthesis and conversion systems is a critical yet challenging task, especially when traditional methods like Mean Opinion Scores (MOS) are cumbersome to collect at scale. This paper addresses the gap in…

Sound · Computer Science 2023-12-27 Aditya Ravuri , Erica Cooper , Junichi Yamagishi

Probabilistic Linear Discriminant Analysis (PLDA) was the dominant and necessary back-end for early speaker recognition approaches, like i-vector and x-vector. However, with the development of neural networks and margin-based loss…

Sound · Computer Science 2022-04-26 Zhuo Li , Runqiu Xiao , Zihan Zhang , Zhenduo Zhao , Wenchao Wang , Pengyuan Zhang

Application for semantic segmentation models in areas such as autonomous vehicles and human computer interaction require real-time predictive capabilities. The challenges of addressing real-time application is amplified by the need to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ethan Goan , Clinton Fookes

In this paper, we explore vector quantization for acoustic unit discovery. Leveraging unlabelled data, we aim to learn discrete representations of speech that separate phonetic content from speaker-specific details. We propose two neural…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-20 Benjamin van Niekerk , Leanne Nortje , Herman Kamper

Recognition of speech, and in particular the ability to generalize and learn from small sets of labelled examples like humans do, depends on an appropriate representation of the acoustic input. We formulate the problem of finding robust…

This paper explores applying the wav2vec2 framework to speaker recognition instead of speech recognition. We study the effectiveness of the pre-trained weights on the speaker recognition task, and how to pool the wav2vec2 output sequence…

Sound · Computer Science 2022-05-09 Nik Vaessen , David A. van Leeuwen

Effective interlocutors account for the uncertain goals, beliefs, and emotions of others. But even the best human conversationalist cannot perfectly anticipate the trajectory of a dialogue. How well can language models represent inherent…

Computation and Language · Computer Science 2024-02-06 Anthony Sicilia , Hyunwoo Kim , Khyathi Raghavi Chandu , Malihe Alikhani , Jack Hessel