中文
相关论文

相关论文: Speaker Embedding Extraction with Phonetic Informa…

200 篇论文

Target speaker extraction aims to separate the voice of a specific speaker from mixed speech. Traditionally, this process has relied on extracting a speaker embedding from a reference speech, in which a speaker recognition model is…

音频与语音处理 · 电气工程与系统科学 2025-05-21 Bang Zeng , Ming Li

We investigate deep neural network performance in the textindependent speaker recognition task. We demonstrate that using angular softmax activation at the last classification layer of a classification neural network instead of a simple…

声音 · 计算机科学 2018-04-27 Sergey Novoselov , Andrey Shulipa , Ivan Kremnev , Alexandr Kozlov , Vadim Shchemelinin

In this paper, we propose an online speaker adaptation method for WaveNet-based neural vocoders in order to improve their performance on speaker-independent waveform generation. In this method, a speaker encoder is first constructed using a…

音频与语音处理 · 电气工程与系统科学 2020-08-17 Qiuchen Huang , Yang Ai , Zhenhua Ling

In this paper, we propose a new pooling method called spatial pyramid encoding (SPE) to generate speaker embeddings for text-independent speaker verification. We first partition the output feature maps from a deep residual network (ResNet)…

音频与语音处理 · 电气工程与系统科学 2019-12-30 Youngmoon Jung , Younggwan Kim , Hyungjun Lim , Yeunju Choi , Hoirin Kim

This article presents a novel approach for learning domain-invariant speaker embeddings using Generative Adversarial Networks. The main idea is to confuse a domain discriminator so that is can't tell if embeddings are from the source or…

音频与语音处理 · 电气工程与系统科学 2018-11-08 Gautam Bhattacharya , Joao Monteiro , Jahangir Alam , Patrick Kenny

Voice trigger detection is an important task, which enables activating a voice assistant when a target user speaks a keyword phrase. A detector is typically trained on speech data independent of speaker information and used for the voice…

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

Self-supervised speech representations are known to encode both speaker and phonetic information, but how they are distributed in the high-dimensional space remains largely unexplored. We hypothesize that they are encoded in orthogonal…

计算与语言 · 计算机科学 2023-12-12 Oli Liu , Hao Tang , Sharon Goldwater

Verifying the identity of a speaker is crucial in modern human-machine interfaces, e.g., to ensure privacy protection or to enable biometric authentication. Classical speaker verification (SV) approaches estimate a fixed-dimensional…

音频与语音处理 · 电气工程与系统科学 2022-06-29 Ahmad Aloradi , Wolfgang Mack , Mohamed Elminshawi , Emanuël A. P. Habets

One of the most popular speaker embeddings is x-vectors, which are obtained from an architecture that gradually builds a larger temporal context with layers. In this paper, we propose to derive speaker embeddings from Transformer's encoder…

音频与语音处理 · 电气工程与系统科学 2021-12-14 N J Metilda Sagaya Mary , S Umesh , Sandesh V Katta

The success of deep learning-based speaker verification systems is largely attributed to access to large-scale and diverse speaker identity data. However, collecting data from more identities is expensive, challenging, and often limited by…

音频与语音处理 · 电气工程与系统科学 2025-08-27 Tianchi Liu , Ruijie Tao , Qiongqiong Wang , Yidi Jiang , Hardik B. Sailor , Ke Zhang , Jingru Lin , Haizhou Li

Speaker extraction aims to extract the target speaker's voice from a multi-talker speech mixture given an auxiliary reference utterance. Recent studies show that speaker extraction benefits from the location or direction of the target…

音频与语音处理 · 电气工程与系统科学 2022-02-22 Meng Ge , Chenglin Xu , Longbiao Wang , Eng Siong Chng , Jianwu Dang , Haizhou Li

Most studies on speaker verification systems focus on long-duration utterances, which are composed of sufficient phonetic information. However, the performances of these systems are known to degrade when short-duration utterances are…

音频与语音处理 · 电气工程与系统科学 2020-08-05 Seung-bin Kim , Jee-weon Jung , Hye-jin Shim , Ju-ho Kim , Ha-Jin Yu

Due to improvements in artificial intelligence, speaker identification (SI) technologies have brought a great direction and are now widely used in a variety of sectors. One of the most important components of SI is feature extraction, which…

声音 · 计算机科学 2021-12-16 Noor Ahmad Al Hindawi , Ismail Shahin , Ali Bou Nassif

Articulatory-to-acoustic mapping seeks to reconstruct speech from a recording of the articulatory movements, for example, an ultrasound video. Just like speech signals, these recordings represent not only the linguistic content, but are…

Incremental improvements in accuracy of Convolutional Neural Networks are usually achieved through use of deeper and more complex models trained on larger datasets. However, enlarging dataset and models increases the computation and storage…

音频与语音处理 · 电气工程与系统科学 2018-07-24 Mahdi Hajibabaei , Dengxin Dai

The SpeakerBeam-FE (SBF) method is proposed for speaker extraction. It attempts to overcome the problem of unknown number of speakers in an audio recording during source separation. The mask approximation loss of SBF is sub-optimal, which…

音频与语音处理 · 电气工程与系统科学 2019-03-26 Chenglin Xu , Wei Rao , Eng Siong Chng , Haizhou Li

Recent research has demonstrated impressive results in video-to-speech synthesis which involves reconstructing speech solely from visual input. However, previous works have struggled to accurately synthesize speech due to a lack of…

声音 · 计算机科学 2023-08-16 Jeongsoo Choi , Joanna Hong , Yong Man Ro

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

音频与语音处理 · 电气工程与系统科学 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

音频与语音处理 · 电气工程与系统科学 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li