English
Related papers

Related papers: Multi-Scale Accent Modeling and Disentangling for …

200 papers

We propose a neural text-to-speech (TTS) model that can imitate a new speaker's voice using only a small amount of speech sample. We demonstrate voice imitation using only a 6-seconds long speech sample without any other information such as…

Sound · Computer Science 2018-06-05 Younggun Lee , Taesu Kim , Soo-Young Lee

Training a multi-speaker Text-to-Speech (TTS) model from scratch is computationally expensive and adding new speakers to the dataset requires the model to be re-trained. The naive solution of sequential fine-tuning of a model for new…

Computation and Language · Computer Science 2022-04-01 Hamed Hemati , Damian Borth

Most text-to-speech (TTS) methods use high-quality speech corpora recorded in a well-designed environment, incurring a high cost for data collection. To solve this problem, existing noise-robust TTS methods are intended to use noisy speech…

Sound · Computer Science 2022-06-30 Takaaki Saeki , Kentaro Tachibana , Ryuichi Yamamoto

Humans often speak in a continuous manner which leads to coherent and consistent prosody properties across neighboring utterances. However, most state-of-the-art speech synthesis systems only consider the information within each sentence…

Sound · Computer Science 2023-05-19 Ya-Jie Zhang , Wei Song , Yanghao Yue , Zhengchen Zhang , Youzheng Wu , Xiaodong He

Conversational Text-to-Speech (CTTS) aims to accurately express an utterance with the appropriate style within a conversational setting, which attracts more attention nowadays. While recognizing the significance of the CTTS task, prior…

Computation and Language · Computer Science 2024-10-15 Rui Liu , Zhenqi Jia , Jie Yang , Yifan Hu , Haizhou Li

While the performance of cross-lingual TTS based on monolingual corpora has been significantly improved recently, generating cross-lingual speech still suffers from the foreign accent problem, leading to limited naturalness. Besides,…

Sound · Computer Science 2023-09-06 Tao Li , Chenxu Hu , Jian Cong , Xinfa Zhu , Jingbei Li , Qiao Tian , Yuping Wang , Lei Xie

Recent studies have outlined the accessibility challenges faced by blind or visually impaired, and less-literate people, in interacting with social networks, in-spite of facilitating technologies such as monotone text-to-speech (TTS) screen…

Social and Information Networks · Computer Science 2024-10-28 Suparna De , Ionut Bostan , Nishanth Sastry

Controllable text-to-speech (TTS) systems face significant challenges in achieving independent manipulation of speaker timbre and speaking style, often suffering from entanglement between these attributes. We present DMP-TTS, a latent…

Sound · Computer Science 2025-12-11 Kang Yin , Chunyu Qiang , Sirui Zhao , Xiaopeng Wang , Yuzhe Liang , Pengfei Cai , Tong Xu , Chen Zhang , Enhong Chen

The goal of accent conversion (AC) is to convert speech accents while preserving content and speaker identity. Previous methods either required reference utterances during inference, did not preserve speaker identity well, or used…

Sound · Computer Science 2024-10-08 Tuan Nam Nguyen , Ngoc Quan Pham , Alexander Waibel

There are significant challenges for speaker adaptation in text-to-speech for languages that are not widely spoken or for speakers with accents or dialects that are not well-represented in the training data. To address this issue, we…

Sound · Computer Science 2023-05-30 Ambuj Mehrish , Abhinav Ramesh Kashyap , Li Yingting , Navonil Majumder , Soujanya Poria

This work presents a lifelong learning approach to train a multilingual Text-To-Speech (TTS) system, where each language was seen as an individual task and was learned sequentially and continually. It does not require pooled data from all…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-20 Mu Yang , Shaojin Ding , Tianlong Chen , Tong Wang , Zhangyang Wang

Zero-shot Text-To-Speech (TTS) synthesis shows great promise for personalized voice customization through voice cloning. However, current methods for achieving zero-shot TTS heavily rely on large model scales and extensive training datasets…

Sound · Computer Science 2025-01-16 Qianniu Chen , Xiaoyang Hao , Bowen Li , Yue Liu , Li Lu

Vocoders received renewed attention as main components in statistical parametric text-to-speech (TTS) synthesis and speech transformation systems. Even though there are vocoding techniques give almost accepted synthesized speech, their high…

Sound · Computer Science 2021-06-22 Mohammed Salah Al-Radhi , Tamás Gábor Csapó , Géza Németh

We introduce an open source high-quality Mandarin TTS dataset MSceneSpeech (Multiple Scene Speech Dataset), which is intended to provide resources for expressive speech synthesis. MSceneSpeech comprises numerous audio recordings and texts…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-22 Qian Yang , Jialong Zuo , Zhe Su , Ziyue Jiang , Mingze Li , Zhou Zhao , Feiyang Chen , Zhefeng Wang , Baoxing Huai

Current synthetic speech detection (SSD) methods perform well on certain datasets but still face issues of robustness and interpretability. A possible reason is that these methods do not analyze the deficiencies of synthetic speech. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Yuxiang Zhang , Zhuo Li , Jingze Lu , Wenchao Wang , Pengyuan Zhang

Speech synthesis is the artificial production of human speech. A typical text-to-speech system converts a language text into a waveform. There exist many English TTS systems that produce mature, natural, and human-like speech synthesizers.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-23 Fady Fahmy , Mahmoud Khalil , Hazem Abbas

Spoken dialogue generation is crucial for applications like podcasts, dynamic commentary, and entertainment content, but poses significant challenges compared to single-utterance text-to-speech (TTS). Key requirements include accurate…

With the advancement of speech synthesis technology, users have higher expectations for the naturalness and expressiveness of synthesized speech. But previous research ignores the importance of prompt selection. This study proposes a…

Sound · Computer Science 2025-04-15 Dan Luo , Chengyuan Ma , Weiqin Li , Jun Wang , Wei Chen , Zhiyong Wu

In this paper, we propose a novel unsupervised text-to-speech acoustic model training scheme, named UTTS, which does not require text-audio pairs. UTTS is a multi-speaker speech synthesizer that supports zero-shot voice cloning, it is…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Jiachen Lian , Chunlei Zhang , Gopala Krishna Anumanchipalli , Dong Yu

This paper proposes a neural sequence-to-sequence text-to-speech (TTS) model which can control latent attributes in the generated speech that are rarely annotated in the training data, such as speaking style, accent, background noise, and…

Computation and Language · Computer Science 2018-12-31 Wei-Ning Hsu , Yu Zhang , Ron J. Weiss , Heiga Zen , Yonghui Wu , Yuxuan Wang , Yuan Cao , Ye Jia , Zhifeng Chen , Jonathan Shen , Patrick Nguyen , Ruoming Pang