English
Related papers

Related papers: Speaker Embedding Extraction with Phonetic Informa…

200 papers

Speaker diarization is the process of labeling different speakers in a speech signal. Deep speaker embeddings are generally extracted from short speech segments and clustered to determine the segments belong to same speaker identity. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Myungjong Kim , Vijendra Raj Apsingekar , Divya Neelagiri

Deep learning is still not a very common tool in speaker verification field. We study deep convolutional neural network performance in the text-prompted speaker verification task. The prompted passphrase is segmented into word states - i.e.…

Audio and Speech Processing · Electrical Eng. & Systems 2018-03-15 Sergey Novoselov , Oleg Kudashev , Vadim Schemelinin , Ivan Kremnev , Galina Lavrentyeva

This paper investigates the application of environmental feature representations for room verification tasks and acoustic meta-data estimation. Audio recordings contain both speaker and non-speaker information. We refer to the…

Sound · Computer Science 2022-03-10 Desmond Caulley

This work presents a novel back-end framework for speaker verification using graph attention networks. Segment-wise speaker embeddings extracted from multiple crops within an utterance are interpreted as node representations of a graph. The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Jee-weon Jung , Hee-Soo Heo , Ha-Jin Yu , Joon Son Chung

Challenges based on Computational Paralinguistics in the INTERSPEECH Conference have always had a good reception among the attendees owing to its competitive academic and research demands. This year, the INTERSPEECH 2020 Computational…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-25 José Vicente Egas-López

In this work, we propose a speaker anonymization pipeline that leverages high quality automatic speech recognition and synthesis systems to generate speech conditioned on phonetic transcriptions and anonymized speaker embeddings. Using…

Sound · Computer Science 2022-07-12 Sarina Meyer , Florian Lux , Pavel Denisov , Julia Koch , Pascal Tilli , Ngoc Thang Vu

Learning a good speaker embedding is important for many automatic speaker recognition tasks, including verification, identification and diarization. The embeddings learned by softmax are not discriminative enough for open-set verification…

Machine Learning · Computer Science 2019-08-13 Zhiyong Chen , Zongze Ren , Shugong Xu

Speaker embeddings become growing popular in the text-independent speaker verification task. In this paper, we propose two improvements during the training stage. The improvements are both based on triplet cause the training stage and the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-08 Zongze Ren , Zhiyong Chen , Shugong Xu

Over the recent years, various deep learning-based methods were proposed for extracting a fixed-dimensional embedding vector from speech signals. Although the deep learning-based embedding extraction methods have shown good performance in…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-08 Woo Hyun Kang , Jahangir Alam , Abderrahim Fathan

Unsupervised speech disentanglement aims at separating fast varying from slowly varying components of a speech signal. In this contribution, we take a closer look at the embedding vector representing the slowly varying signal components,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-20 Frederik Rautenberg , Michael Kuhlmann , Jana Wiechmann , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

In target speaker extraction, many studies rely on the speaker embedding which is obtained from an enrollment of the target speaker and employed as the guidance. However, solely using speaker embedding may not fully utilize the contextual…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-28 Xue Yang , Changchun Bao , Jing Zhou , Xianhong Chen

End-to-end models are fast replacing the conventional hybrid models in automatic speech recognition. Transformer, a sequence-to-sequence model, based on self-attention popularly used in machine translation tasks, has given promising results…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-19 Vishwas M. Shetty , Metilda Sagaya Mary N J , S. Umesh

This study investigates the explainability of embedding representations, specifically those used in modern audio spoofing detection systems based on deep neural networks, known as spoof embeddings. Building on established work in speaker…

Sound · Computer Science 2024-12-25 Xuechen Liu , Junichi Yamagishi , Md Sahidullah , Tomi kinnunen

Speaker embedding extractors (EEs), which map input audio to a speaker discriminant latent space, are of paramount importance in speaker diarisation. However, there are several challenges when adopting EEs for diarisation, from which we…

As a practical alternative of speech separation, target speaker extraction (TSE) aims to extract the speech from the desired speaker using additional speaker cue extracted from the speaker. Its main challenge lies in how to properly extract…

Sound · Computer Science 2023-01-18 Kai Liu , Xucheng Wan , Ziqing Du , Huan Zhou

In this paper, we demonstrate a method for training speaker embedding extractors using weak annotation. More specifically, we are using the full VoxCeleb recordings and the name of the celebrities appearing on each video without knowledge…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-10 Themos Stafylakis , Ladislav Mošner , Oldřich Plchot , Johan Rohdin , Anna Silnova , Lukáš Burget , Jan "Honza'' Černocký

Target speaker extraction (TSE) relies on a reference cue of the target to extract the target speech from a speech mixture. While a speaker embedding is commonly used as the reference cue, such embedding pre-trained with a large number of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-12 Ke Zhang , Junjie Li , Shuai Wang , Yangjie Wei , Yi Wang , Yannan Wang , Haizhou Li

In this paper, a novel architecture for speaker recognition is proposed by cascading speech enhancement and speaker processing. Its aim is to improve speaker recognition performance when speech signals are corrupted by noise. Instead of…

Computation and Language · Computer Science 2020-05-25 Yanpei Shi , Qiang Huang , Thomas Hain

In this paper, we propose an innovative approach to perform speaker recognition by fusing two recently introduced deep neural networks (DNNs) namely - SincNet and X-Vector. The idea behind using SincNet filters on the raw speech waveform is…

Computation and Language · Computer Science 2020-04-07 Mayank Tripathi , Divyanshu Singh , Seba Susan

Contrary to i-vectors, speaker embeddings such as x-vectors are incapable of leveraging unlabelled utterances, due to the classification loss over training speakers. In this paper, we explore an alternative training strategy to enable the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Themos Stafylakis , Johan Rohdin , Oldrich Plchot , Petr Mizera , Lukas Burget