English
Related papers

Related papers: Speaker Sincerity Detection based on Covariance Fe…

200 papers

Previous research on word embeddings has shown that sparse representations, which can be either learned on top of existing dense embeddings or obtained through model constraints during training time, have the benefit of increased…

Computation and Language · Computer Science 2018-09-26 Valentin Trifonov , Octavian-Eugen Ganea , Anna Potapenko , Thomas Hofmann

Paralinguistic properties of speech are essential in analyzing and choosing optimal treatment options for patients with speech disorders. However, automatic modeling of these characteristics is difficult due to the lack of labeled speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-25 Jenthe Thienpondt , Geoffroy Vanderreydt , Abdessalem Hammami , Kris Demuynck

Contrastive predictive coding (CPC) aims to learn representations of speech by distinguishing future observations from a set of negative examples. Previous work has shown that linear classifiers trained on CPC features can accurately…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Benjamin van Niekerk , Leanne Nortje , Matthew Baas , Herman Kamper

This paper explores applying the wav2vec2 framework to speaker recognition instead of speech recognition. We study the effectiveness of the pre-trained weights on the speaker recognition task, and how to pool the wav2vec2 output sequence…

Sound · Computer Science 2022-05-09 Nik Vaessen , David A. van Leeuwen

Non-intrusive intelligibility prediction is important for its application in realistic scenarios, where a clean reference signal is difficult to access. The construction of many non-intrusive predictors require either ground truth…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehai Tu , Ning Ma , Jon Barker

We introduce and analyze a novel approach to the problem of speaker identification in multi-party recorded meetings. Given a speech segment and a set of available candidate profiles, we propose a novel data-driven way to model the distance…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Nikolaos Flemotomos , Dimitrios Dimitriadis

This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are from the source or…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-08 Gautam Bhattacharya , Joao Monteiro , Jahangir Alam , Patrick Kenny

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

Wav2vec 2.0 is a recently proposed self-supervised framework for speech representation learning. It follows a two-stage training process of pre-training and fine-tuning, and performs well in speech recognition tasks especially ultra-low…

Sound · Computer Science 2021-01-15 Zhiyun Fan , Meng Li , Shiyu Zhou , Bo Xu

Research has shown that trust is an essential aspect of human-computer interaction directly determining the degree to which the person is willing to use the system. An automatic prediction of the level of trust that a user has on a certain…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-03 Leonardo Pepino , Pablo Riera , Lara Gauder , Agustín Gravano , Luciana Ferrer

Conversational speech not only contains several variants of neutral speech but is also prominently interlaced with several speaker generated non-speech sounds such as laughter and breath. A robust speaker recognition system should be…

Sound · Computer Science 2017-05-29 Sri Harsha Dumpala , Ashish Panda , Sunil Kumar Kopparapu

Despite improvements in automatic speaker verification (ASV), vulnerability against spoofing attacks remains a major concern. In this study, we investigate the integration of ASV and countermeasure (CM) subsystems into a modular spoof-aware…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-17 Oguzhan Kurnaz , Tomi Kinnunen , Cemal Hanilci

We propose an approach to extract speaker embeddings that are robust to speaking style variations in text-independent speaker verification. Typically, speaker embedding extraction includes training a DNN for speaker classification and using…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-29 Amber Afshan , Abeer Alwan

Level assessment for foreign language students is necessary for putting them in the right level group, furthermore, interviewing students is a very time-consuming task, so we propose to automate the evaluation of speaker fluency level by…

Machine Learning · Statistics 2018-09-03 Alan Preciado-Grijalva , Ramon F. Brena

Speaker verification systems usually suffer from the mismatch problem between training and evaluation data, such as speaker population mismatch, the channel and environment variations. In order to address this issue, it requires the system…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Xu Li , Jinghua Zhong , Jianwei Yu , Shoukang Hu , Xixin Wu , Xunying Liu , Helen Meng

This paper deals with the estimation of a high-dimensional covariance with a conditional sparsity structure and fast-diverging eigenvalues. By assuming sparse error covariance matrix in an approximate factor model, we allow for the presence…

Statistics Theory · Mathematics 2013-01-15 Jianqing Fan , Yuan Liao , Martina Mincheva

Recent studies have explored the use of deep generative models of speech spectra based of variational autoencoders (VAEs), combined with unsupervised noise models, to perform speech enhancement. These studies developed iterative algorithms…

Sound · Computer Science 2019-05-15 Manuel Pariente , Antoine Deleforge , Emmanuel Vincent

Recent works have proposed that activations in language models can be modelled as sparse linear combinations of vectors corresponding to features of input text. Under this assumption, these works aimed to reconstruct feature directions…

Machine Learning · Computer Science 2023-10-17 Mingyang Deng , Lucas Tao , Joe Benton

In this paper, we introduce a streaming keyphrase detection system that can be easily customized to accurately detect any phrase composed of words from a large vocabulary. The system is implemented with an end-to-end trained automatic…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Rajeev Rikhye , Quan Wang , Qiao Liang , Yanzhang He , Ding Zhao , Yiteng , Huang , Arun Narayanan , Ian McGraw

Speech is the most natural way of expressing ourselves as humans. Identifying emotion from speech is a nontrivial task due to the ambiguous definition of emotion itself. Speaker Emotion Recognition (SER) is essential for understanding human…

Sound · Computer Science 2024-11-07 Pourya Jafarzadeh , Amir Mohammad Rostami , Padideh Choobdar