English
Related papers

Related papers: Speaker Cluster-Based Speaker Adaptive Training fo…

200 papers

A key challenge for automatic speech recognition (ASR) systems is to model the speaker level variability. In this paper, compact speaker dependent learning hidden unit contributions (LHUC) are used to facilitate both speaker adaptive…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Jiajun Deng , Xurong Xie , Tianzi Wang , Mingyu Cui , Boyang Xue , Zengrui Jin , Mengzhe Geng , Guinan Li , Xunying Liu , Helen Meng

Conventional deep neural networks (DNN) for speech acoustic modeling rely on Gaussian mixture models (GMM) and hidden Markov model (HMM) to obtain binary class labels as the targets for DNN training. Subword classes in speech recognition…

Computation and Language · Computer Science 2017-09-07 Pranay Dighe , Afsaneh Asaei , Herve Bourlard

Most neural-network based speaker-adaptive acoustic models for speech synthesis can be categorized into either layer-based or input-code approaches. Although both approaches have their own pros and cons, most existing works on speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-02 Hieu-Thi Luong , Junichi Yamagishi

Speaker adaptation is important to build robust automatic speech recognition (ASR) systems. In this work, we investigate various methods for speaker adaptive training (SAT) based on feature-space approaches for a conformer-based acoustic…

Computation and Language · Computer Science 2022-06-28 Mohammad Zeineldeen , Jingjing Xu , Christoph Lüscher , Ralf Schlüter , Hermann Ney

Text-independent speaker recognition using short utterances is a highly challenging task due to the large variation and content mismatch between short utterances. I-vector based systems have become the standard in speaker verification…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-18 Jinxi Guo , Ning Xu , Kailun Qian , Yang Shi , Kaiyuan Xu , Yingnian Wu , Abeer Alwan

The state-of-the-art speaker diarization systems use agglomerative hierarchical clustering (AHC) which performs the clustering of previously learned neural embeddings. While the clustering approach attempts to identify speaker clusters, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-07 Prachi Singh , Sriram Ganapathy

We present Deep Speaker, a neural speaker embedding system that maps utterances to a hypersphere where speaker similarity is measured by cosine similarity. The embeddings generated by Deep Speaker can be used for many tasks, including…

Computation and Language · Computer Science 2017-05-08 Chao Li , Xiaokong Ma , Bing Jiang , Xiangang Li , Xuewei Zhang , Xiao Liu , Ying Cao , Ajay Kannan , Zhenyao Zhu

In this work, we conducted an empirical comparative study of the performance of text-independent speaker verification in emotional and stressful environments. This work combined deep models with shallow architecture, which resulted in novel…

Sound · Computer Science 2021-12-28 Ismail Shahin , Ali Bou Nassif , Nawel Nemmour , Ashraf Elnagar , Adi Alhudhaif , Kemal Polat

In this paper, we propose a fully supervised speaker diarization approach, named unbounded interleaved-state recurrent neural networks (UIS-RNN). Given extracted speaker-discriminative embeddings (a.k.a. d-vectors) from input utterances,…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-20 Aonan Zhang , Quan Wang , Zhenyao Zhu , John Paisley , Chong Wang

While machine learning techniques are traditionally resource intensive, we are currently witnessing an increased interest in hardware and energy efficient approaches. This need for resource-efficient machine learning is primarily driven by…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-23 Lukas Pfeifenberger , Matthias Zöhrer , Günther Schindler , Wolfgang Roth , Holger Fröning , Franz Pernkopf

In this paper, a novel method using 3D Convolutional Neural Network (3D-CNN) architecture has been proposed for speaker verification in the text-independent setting. One of the main challenges is the creation of the speaker models. Most of…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Amirsina Torfi , Jeremy Dawson , Nasser M. Nasrabadi

In automatic speech processing systems, speaker diarization is a crucial front-end component to separate segments from different speakers. Inspired by the recent success of deep neural networks (DNNs) in semantic inferencing, triplet…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-07 Huan Song , Megan Willi , Jayaraman J. Thiagarajan , Visar Berisha , Andreas Spanias

Speakers tend to engage in adaptive behavior, known as entrainment, when they become similar to their interlocutor in various aspects of speaking. We present an unsupervised deep learning framework that derives meaningful representation…

Computation and Language · Computer Science 2023-12-27 Jay Kejriwal , Stefan Benus , Lina M. Rojas-Barahona

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

Existing speaker verification (SV) systems often suffer from performance degradation if there is any language mismatch between model training, speaker enrollment, and test. A major cause of this degradation is that most existing SV methods…

Sound · Computer Science 2017-06-27 Lantian Li , Dong Wang , Askar Rozi , Thomas Fang Zheng

LSTM-based speaker verification usually uses a fixed-length local segment randomly truncated from an utterance to learn the utterance-level speaker embedding, while using the average embedding of all segments of a test utterance to verify…

Audio and Speech Processing · Electrical Eng. & Systems 2018-11-05 Bin Liu , Shuai Nie , Yaping Zhang , Shan Liang , Wenju Liu

It is well known that speaker identification performs extremely well in the neutral talking environments; however, the identification performance is declined sharply in the shouted talking environments. This work aims at proposing,…

Artificial Intelligence · Computer Science 2017-06-30 Ismail Shahin

Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-19 Xu Xiang , Shuai Wang , Houjun Huang , Yanmin Qian , Kai Yu

Deep clustering is a recently introduced deep learning architecture that uses discriminatively trained embeddings as the basis for clustering. It was recently applied to spectrogram segmentation, resulting in impressive results on…

Machine Learning · Computer Science 2016-07-11 Yusuf Isik , Jonathan Le Roux , Zhuo Chen , Shinji Watanabe , John R. Hershey

Human auditory cortex excels at selectively suppressing background noise to focus on a target speaker. The process of selective attention in the brain is known to contextually exploit the available audio and visual cues to better focus on…

Sound · Computer Science 2018-09-12 Mandar Gogate , Ahsan Adeel , Ricard Marxer , Jon Barker , Amir Hussain