English
Related papers

Related papers: Optimizing Multi-Taper Features for Deep Speaker V…

200 papers

Self-supervised learning approaches have lately achieved great success on a broad spectrum of machine learning problems. In the field of speech processing, one of the most successful recent self-supervised models is wav2vec 2.0. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-10 Marie Kunešová , Zbyněk Zajíc

Systems based on automatic speech recognition (ASR) technology can provide important functionality in computer assisted language learning applications. This is a young but growing area of research motivated by the large number of students…

Sound · Computer Science 2016-02-29 Zhenhao Ge , Sudhendu R. Sharma , Mark J. T. Smith

Self-supervised learning methods such as wav2vec 2.0 have shown promising results in learning speech representations from unlabelled and untranscribed speech data that are useful for speech recognition. Since these representations are…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-22 Shehzeen Hussain , Van Nguyen , Shuhua Zhang , Erik Visser

We propose a new method for speaker diarization that can handle overlapping speech with 2+ people. Our method is based on compositional embeddings [1]: Like standard speaker embedding methods such as x-vector [2], compositional embedding…

Sound · Computer Science 2021-02-11 Zeqian Li , Jacob Whitehill

Adapters are an efficient, composable alternative to full fine-tuning of pre-trained models and help scale the deployment of large ASR models to many tasks. In practice, a task ID is commonly prepended to the input during inference to route…

Computation and Language · Computer Science 2023-10-23 Hillary Ngai , Rohan Agrawal , Neeraj Gaur , Ronny Huang , Parisa Haghani , Pedro Moreno Mengibar

The use of multitaper estimates for spectral proper orthogonal decomposition (SPOD) is explored. Multitaper and multitaper-Welch estimators that use discrete prolate spheroidal sequences (DPSS) as orthogonal data windows are compared to the…

Fluid Dynamics · Physics 2022-09-14 Oliver T. Schmidt

Pre-trained acoustic representations such as wav2vec and DeCoAR have attained impressive word error rates (WER) for speech recognition benchmarks, particularly when labeled data is limited. But little is known about what phonetic properties…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-16 Danni Ma , Neville Ryant , Mark Liberman

This work presents a novel framework based on feed-forward neural network for text-independent speaker classification and verification, two related systems of speaker recognition. With optimized features and model training, it achieves 100%…

Sound · Computer Science 2017-03-20 Zhenhao Ge , Ananth N. Iyer , Srinath Cheluvaraja , Ram Sundaram , Aravind Ganapathiraju

We study multi-task learning for two orthogonal speech technology tasks: speech and speaker recognition. We use wav2vec2 as a base architecture with two task-specific output heads. We experiment with different architectural decisions to mix…

Sound · Computer Science 2023-05-29 Nik Vaessen , David A. van Leeuwen

State-of-the-art Deep Learning systems for speaker verification are commonly based on speaker embedding extractors. These architectures are usually composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Federico Costa , Miquel India , Javier Hernando

Recent techniques for speech deepfake detection often rely on pre-trained self-supervised models. These systems, initially developed for Automatic Speech Recognition (ASR), have proved their ability to offer a meaningful representation of…

Past studies on end-to-end meeting transcription have focused on model architecture and have mostly been evaluated on simulated meeting data. We present a novel study aiming to optimize the use of a Speaker-Attributed ASR (SA-ASR) system in…

Computation and Language · Computer Science 2024-09-06 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

The common target speech separation directly estimate the target source, ignoring the interrelationship between different speakers at each frame. We propose a multiple-target speech separation model (MTSS) to simultaneously extract each…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Bang Zeng , Hongbing Suo , Yulong Wan , Ming Li

Most state-of-the-art Deep Learning systems for speaker verification are based on speaker embedding extractors. These architectures are commonly composed of a feature extractor front-end together with a pooling layer to encode…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-12 Miquel India , Pooyan Safari , Javier Hernando

Personal Voice Activity Detection (PVAD) is crucial for identifying target speaker segments in the mixture, yet its performance heavily depends on the quality of speaker embeddings. A key practical limitation is the short enrollment…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-21 Fuyuan Feng , Wenbin Zhang , Yu Gao , Longting Xu , Xiaofeng Mou , Yi Xu

Text-independent speaker verification is an important artificial intelligence problem that has a wide spectrum of applications, such as criminal investigation, payment certification, and interest-based customer services. The purpose of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-22 Jiwei Xu , Xinggang Wang , Bin Feng , Wenyu Liu

Deep embedding based text-independent speaker verification has demonstrated superior performance to traditional methods in many challenging scenarios. Its loss functions can be generally categorized into two classes, i.e., verification and…

Machine Learning · Computer Science 2019-11-20 Zhongxin Bai , Xiao-Lei Zhang , Jingdong Chen

We propose a Multi-Stage, Multi-Codebook (MSMC) approach to high-performance neural TTS synthesis. A vector-quantized, variational autoencoder (VQ-VAE) based feature analyzer is used to encode Mel spectrograms of speech training data by…

Sound · Computer Science 2022-09-23 Haohan Guo , Fenglong Xie , Frank K. Soong , Xixin Wu , Helen Meng

Voice-based biometric systems are highly prone to spoofing attacks. Recently, various countermeasures have been developed for detecting different kinds of attacks such as replay, speech synthesis (SS) and voice conversion (VC). Most of the…

Multimedia · Computer Science 2020-08-07 Dipjyoti Paul , Md Sahidullah , Goutam Saha

Speech is a natural form of communication for human beings, and computers with the ability to understand speech and speak with a human voice are expected to contribute to the development of more natural man-machine interfaces. Computers…

Sound · Computer Science 2013-05-15 Neema Mishra , Urmila Shrawankar , V M Thakare