中文
相关论文

相关论文: VAE-based Domain Adaptation for Speaker Verificati…

200 篇论文

While mel-spectrograms have been widely utilized as intermediate representations in zero-shot text-to-speech (TTS), their inherent redundancy leads to inefficiency in learning text-speech alignment. Compact VAE-based latent representations…

音频与语音处理 · 电气工程与系统科学 2025-12-02 Zhikang Niu , Shujie Hu , Jeongsoo Choi , Yushen Chen , Peining Chen , Pengcheng Zhu , Yunting Yang , Bowen Zhang , Jian Zhao , Chunhui Wang , Xie Chen

Speaker embeddings are ubiquitous, with applications ranging from speaker recognition and diarization to speech synthesis and voice anonymisation. The amount of information held by these embeddings lends them versatility, but also raises…

音频与语音处理 · 电气工程与系统科学 2024-09-12 Francisco Teixeira , Alberto Abad , Bhiksha Raj , Isabel Trancoso

In this paper, a hierarchical attention network to generate utterance-level embeddings (H-vectors) for speaker identification is proposed. Since different parts of an utterance may have different contributions to speaker identities, the use…

计算与语言 · 计算机科学 2019-10-22 Yanpei Shi , Qiang Huang , Thomas Hain

Selective manipulation of data attributes using deep generative models is an active area of research. In this paper, we present a novel method to structure the latent space of a Variational Auto-Encoder (VAE) to encode different…

机器学习 · 计算机科学 2020-07-30 Ashis Pati , Alexander Lerch

In real-life applications, the performance of speaker recognition systems always degrades when there is a mismatch between training and evaluation data. Many domain adaptation methods have been successfully used for eliminating the domain…

声音 · 计算机科学 2020-11-18 Qing Wang , Wei Rao , Pengcheng Guo , Lei Xie

This paper presents a statistical method of single-channel speech enhancement that uses a variational autoencoder (VAE) as a prior distribution on clean speech. A standard approach to speech enhancement is to train a deep neural network…

The Variational Autoencoder (VAE) has proven to be an effective model for producing semantically meaningful latent representations for natural data. However, it has thus far seen limited application to sequential data, and, as we…

机器学习 · 计算机科学 2019-11-12 Adam Roberts , Jesse Engel , Colin Raffel , Curtis Hawthorne , Douglas Eck

Cross-domain speech enhancement (SE) is often faced with severe challenges due to the scarcity of noise and background information in an unseen target domain, leading to a mismatch between training and test conditions. This study puts…

声音 · 计算机科学 2024-09-04 Chien-Chun Wang , Li-Wei Chen , Hung-Shin Lee , Berlin Chen , Hsin-Min Wang

This paper presents an improved deep embedding learning method based on convolutional neural network (CNN) for text-independent speaker verification. Two improvements are proposed for x-vector embedding learning: (1) Multi-scale convolution…

音频与语音处理 · 电气工程与系统科学 2020-01-15 Bin Gu , Wu Guo

Deploying a well-optimized pre-trained speaker recognition model in a new domain often leads to a significant decline in performance. While fine-tuning is a commonly employed solution, it demands ample adaptation data and suffers from…

声音 · 计算机科学 2024-06-13 Tianhao Wang , Lantian Li , Dong Wang

In this paper, we address the problem of speaker recognition in challenging acoustic conditions using a novel method to extract robust speaker-discriminative speech representations. We adopt a recently proposed unsupervised adversarial…

音频与语音处理 · 电气工程与系统科学 2019-11-05 Raghuveer Peri , Monisankha Pal , Arindam Jati , Krishna Somandepalli , Shrikanth Narayanan

Despite the significant improvements in speaker recognition enabled by deep neural networks, unsatisfactory performance persists under noisy environments. In this paper, we train the speaker embedding network to learn the "clean" embedding…

音频与语音处理 · 电气工程与系统科学 2020-02-14 Danwei Cai , Weicheng Cai , Ming Li

Accent variability has posed a huge challenge to automatic speech recognition~(ASR) modeling. Although one-hot accent vector based adaptation systems are commonly used, they require prior knowledge about the target accent and cannot handle…

声音 · 计算机科学 2022-04-22 Xun Gong , Yizhou Lu , Zhikai Zhou , Yanmin Qian

The classical i-vectors and the latest end-to-end deep speaker embeddings are the two representative categories of utterance-level representations in automatic speaker verification systems. Traditionally, once i-vectors or deep speaker…

音频与语音处理 · 电气工程与系统科学 2018-06-12 Weicheng Cai , Jinkun Chen , Ming Li

This work presents a framework based on feature disentanglement to learn speaker embeddings that are robust to environmental variations. Our framework utilises an auto-encoder as a disentangler, dividing the input speaker embedding into…

声音 · 计算机科学 2024-06-21 KiHyun Nam , Hee-Soo Heo , Jee-weon Jung , Joon Son Chung

Emotional state of a speaker is found to have significant effect in speech production, which can deviate speech from that arising from neutral state. This makes identifying speakers with different emotions a challenging task as generally…

音频与语音处理 · 电气工程与系统科学 2020-10-09 Biswajit Dev Sarma , Rohan Kumar Das

In this paper, we present a novel technique for a non-parallel voice conversion (VC) with the use of cyclic variational autoencoder (CycleVAE)-based spectral modeling. In a variational autoencoder(VAE) framework, a latent space, usually…

音频与语音处理 · 电气工程与系统科学 2019-07-25 Patrick Lumban Tobing , Yi-Chiao Wu , Tomoki Hayashi , Kazuhiro Kobayashi , Tomoki Toda

Being one of the most popular generative framework, variational autoencoders(VAE) are known to suffer from a phenomenon termed posterior collapse, i.e. the latent variational distributions collapse to the prior, especially when a strong…

机器学习 · 计算机科学 2021-03-23 Renfei Tu , Yang Liu , Yongzeng Xue , Cheng Wang , Maozu Guo

This paper presents a refinement framework of WaveNet vocoders for variational autoencoder (VAE) based voice conversion (VC), which reduces the quality distortion caused by the mismatch between the training data and testing data.…

音频与语音处理 · 电气工程与系统科学 2020-04-09 Wen-Chin Huang , Yi-Chiao Wu , Hsin-Te Hwang , Patrick Lumban Tobing , Tomoki Hayashi , Kazuhiro Kobayashi , Tomoki Toda , Yu Tsao , Hsin-Min Wang

A variational autoencoder (VAE) is a probabilistic machine learning framework for posterior inference that projects an input set of high-dimensional data to a lower-dimensional, latent space. The latent space learned with a VAE offers…

机器学习 · 计算机科学 2022-11-16 Rafael Pastrana