中文
相关论文

相关论文: Cross-Speaker Emotion Transfer for Low-Resource Te…

200 篇论文

Text-to-speech (TTS) systems are being built using end-to-end deep learning approaches. However, these systems require huge amounts of training data. We present our approach to built production quality TTS and perform speaker adaptation in…

机器学习 · 计算机科学 2023-12-05 Raviraj Joshi , Nikesh Garera

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

音频与语音处理 · 电气工程与系统科学 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Voice conversion (VC) is a task to transform a person's voice to different style while conserving linguistic contents. Previous state-of-the-art on VC is based on sequence-to-sequence (seq2seq) model, which could mislead linguistic…

音频与语音处理 · 电气工程与系统科学 2019-11-28 Tae-Ho Kim , Sungjae Cho , Shinkook Choi , Sejik Park , Soo-Young Lee

Automatic speech recognition (ASR) needs to be robust to speaker differences. Voice Conversion (VC) modifies speaker characteristics of input speech. This is an attractive feature for ASR data augmentation. In this paper, we demonstrate…

In this work, we introduce a framework for cross-lingual speech synthesis, which involves an upstream Voice Conversion (VC) model and a downstream Text-To-Speech (TTS) model. The proposed framework consists of 4 stages. In the first two…

音频与语音处理 · 电气工程与系统科学 2023-09-18 Dariusz Piotrowski , Renard Korzeniowski , Alessio Falai , Sebastian Cygert , Kamil Pokora , Georgi Tinchev , Ziyao Zhang , Kayoko Yanagisawa

During the last few years, spoken language technologies have known a big improvement thanks to Deep Learning. However Deep Learning-based algorithms require amounts of data that are often difficult and costly to gather. Particularly,…

声音 · 计算机科学 2019-01-15 Noé Tits , Kevin El Haddad , Thierry Dutoit

This paper presents a novel framework to build a voice conversion (VC) system by learning from a text-to-speech (TTS) synthesis system, that is called TTS-VC transfer learning. We first develop a multi-speaker speech synthesis system with…

音频与语音处理 · 电气工程与系统科学 2021-01-07 Mingyang Zhang , Yi Zhou , Li Zhao , Haizhou Li

Cross-lingual voice conversion (VC) is an important and challenging problem due to significant mismatches of the phonetic set and the speech prosody of different languages. In this paper, we build upon the neural text-to-speech (TTS) model,…

声音 · 计算机科学 2021-02-04 Shengkui Zhao , Hao Wang , Trung Hieu Nguyen , Bin Ma

One-shot voice conversion (VC) aims to convert speech from any source speaker to an arbitrary target speaker with only a few seconds of reference speech from the target speaker. This relies heavily on disentangling the speaker's identity…

音频与语音处理 · 电气工程与系统科学 2023-01-02 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Accent conversion aims to convert the accent of a source speech to a target accent, meanwhile preserving the speaker's identity. This paper introduces a novel non-autoregressive framework for accent conversion that learns accent-agnostic…

计算与语言 · 计算机科学 2024-01-09 Xi Chen , Jiakun Pei , Liumeng Xue , Mingyang Zhang

Accent Conversion (AC) seeks to change the accent of speech from one (source) to another (target) while preserving the speech content and speaker identity. However, many AC approaches rely on source-target parallel speech data. We propose a…

音频与语音处理 · 电气工程与系统科学 2023-05-24 Yi Zhou , Zhizheng Wu , Mingyang Zhang , Xiaohai Tian , Haizhou Li

Voice conversion (VC) techniques aim to modify speaker identity of an utterance while preserving the underlying linguistic information. Most VC approaches ignore modeling of the speaking style (e.g. emotion and emphasis), which may contain…

音频与语音处理 · 电气工程与系统科学 2020-05-20 Songxiang Liu , Yuewen Cao , Shiyin Kang , Na Hu , Xunying Liu , Dan Su , Dong Yu , Helen Meng

In this paper, we focus on improving the performance of the text-dependent speaker verification system in the scenario of limited training data. The speaker verification system deep learning based text-dependent generally needs a large…

声音 · 计算机科学 2020-11-24 Xiaoyi Qin , Yaogen Yang , Lin Yang , Xuyang Wang , Junjie Wang , Ming Li

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

Recently, sequence-to-sequence (seq-to-seq) models have been successfully applied in text-to-speech (TTS) to synthesize speech for single-language text. To synthesize speech for multiple languages usually requires multi-lingual speech from…

声音 · 计算机科学 2022-11-18 Haitong Zhang , Yue Lin

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

Spoken language understanding (SLU) systems often exhibit suboptimal performance in processing atypical speech, typically caused by neurological conditions and motor impairments. Recent advancements in Text-to-Speech (TTS) synthesis-based…

With the development of automatic speech recognition (ASR) and text-to-speech (TTS) technology, high-quality voice conversion (VC) can be achieved by extracting source content information and target speaker information to reconstruct…

声音 · 计算机科学 2023-02-24 Houjian Guo , Chaoran Liu , Carlos Toshinori Ishi , Hiroshi Ishiguro

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

计算与语言 · 计算机科学 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

This paper introduces FastVC, an end-to-end model for fast Voice Conversion (VC). The proposed model can convert speech of arbitrary length from multiple source speakers to multiple target speakers. FastVC is based on a conditional…

音频与语音处理 · 电气工程与系统科学 2021-05-07 Oriol Barbany Mayor , Milos Cernak