English
Related papers

Related papers: Text-to-speech synthesis from dark data with evalu…

200 papers

Modern speech synthesis techniques can produce natural-sounding speech given sufficient high-quality data and compute resources. However, such data is not readily available for many languages. This paper focuses on speech synthesis for…

Computation and Language · Computer Science 2022-07-05 Perez Ogayo , Graham Neubig , Alan W Black

Recently, zero-shot text-to-speech (TTS) systems, capable of synthesizing any speaker's voice from a short audio prompt, have made rapid advancements. However, the quality of the generated speech significantly deteriorates when the audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-11 Xiaofei Wang , Sefik Emre Eskimez , Manthan Thakker , Hemin Yang , Zirun Zhu , Min Tang , Yufei Xia , Jinzhu Li , Sheng Zhao , Jinyu Li , Naoyuki Kanda

In the development of neural text-to-speech systems, model pre-training with a large amount of non-target speakers' data is a common approach. However, in terms of ultimately achieved system performance for target speaker(s), the actual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-11 Guangyan Zhang , Yichong Leng , Daxin Tan , Ying Qin , Kaitao Song , Xu Tan , Sheng Zhao , Tan Lee

Training end-to-end speech translation (ST) systems requires sufficiently large-scale data, which is unavailable for most language pairs and domains. One practical solution to the data scarcity issue is to convert machine translation data…

Computation and Language · Computer Science 2023-02-09 Jinming Zhao , Gholamreza Haffar , Ehsan Shareghi

Artificial speech synthesis has made a great leap in terms of naturalness as recent Text-to-Speech (TTS) systems are capable of producing speech with similar quality to human recordings. However, not all speaking styles are easy to model:…

Synthetic data generated by text-to-speech (TTS) systems can be used to improve automatic speech recognition (ASR) systems in low-resource or domain mismatch tasks. It has been shown that TTS-generated outputs still do not have the same…

Computation and Language · Computer Science 2023-10-13 Nick Rossenbach , Benedikt Hilmes , Ralf Schlüter

Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of developing high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is…

Computation and Language · Computer Science 2019-06-19 Wei Fang , Yu-An Chung , James Glass

This research paper presents a comprehensive review-based study on various Text-to-Speech (TTS) technologies. TTS technology is an important aspect of human-computer interaction, enabling machines to convert written text into audible…

Sound · Computer Science 2023-12-20 Md. Jalal Uddin Chowdhury , Ashab Hussan

Abstract End-to-end text-to-speech (TTS) systems has proved its great success in the presence of a large amount of high-quality training data recorded in anechoic room with high-quality microphone. Another approach is to use available…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-22 Viet Lam Phung , Phan Huy Kinh , Anh Tuan Dinh , Quoc Bao Nguyen

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda

This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training data and their…

Computation and Language · Computer Science 2024-07-08 Cong-Thanh Do , Shuhei Imai , Rama Doddipatla , Thomas Hain

Synthesizing the voices of unseen speakers remains a persisting challenge in multi-speaker text-to-speech (TTS). Existing methods model speaker characteristics through speaker conditioning during training, leading to increased model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-18 Ismail Rasim Ulgen , Shreeram Suresh Chandra , Junchen Lu , Berrak Sisman

Recent speech technologies have led to produce high quality synthesised speech due to recent advances in neural Text to Speech (TTS). However, such TTS models depend on extensive amounts of data that can be costly to produce and is hardly…

Computation and Language · Computer Science 2024-09-04 Asma Amalas , Mounir Ghogho , Mohamed Chetouani , Rachid Oulad Haj Thami

The recent text-to-speech (TTS) has achieved quality comparable to that of humans; however, its application in spoken dialogue has not been widely studied. This study aims to realize a TTS that closely resembles human dialogue. First, we…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-27 Kentaro Mitsui , Tianyu Zhao , Kei Sawada , Yukiya Hono , Yoshihiko Nankaku , Keiichi Tokuda

Although end-to-end text-to-speech (TTS) models such as Tacotron have shown excellent results, they typically require a sizable set of high-quality <text, audio> pairs for training, which are expensive to collect. In this paper, we propose…

Computation and Language · Computer Science 2018-08-31 Yu-An Chung , Yuxuan Wang , Wei-Ning Hsu , Yu Zhang , RJ Skerry-Ryan

Recently, end-to-end multi-speaker text-to-speech (TTS) systems gain success in the situation where a lot of high-quality speech plus their corresponding transcriptions are available. However, laborious paired data collection processes…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Tao Tu , Yuan-Jui Chen , Alexander H. Liu , Hung-yi Lee

Benefiting from the development of deep learning, text-to-speech (TTS) techniques using clean speech have achieved significant performance improvements. The data collected from real scenes often contains noise and generally needs to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Qiushi Zhu , Yu Gu , Rilin Chen , Chao Weng , Yuchen Hu , Lirong Dai , Jie Zhang

Incremental text-to-speech (TTS) synthesis generates utterances in small linguistic units for the sake of real-time and low-latency applications. We previously proposed an incremental TTS method that leverages a large pre-trained language…

Sound · Computer Science 2021-09-23 Takaaki Saeki , Shinnosuke Takamichi , Hiroshi Saruwatari

In recent years, text-to-speech (TTS) technology has witnessed impressive advancements, particularly with large-scale training datasets, showcasing human-level speech quality and impressive zero-shot capabilities on unseen speakers.…

Computation and Language · Computer Science 2024-06-04 Chen Chen , Yuchen Hu , Wen Wu , Helin Wang , Eng Siong Chng , Chao Zhang

Neural Text-to-speech (TTS) synthesis is a powerful technology that can generate speech using neural networks. One of the most remarkable features of TTS synthesis is its capability to produce speech in the voice of different speakers. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-19 Vinotha R , Hepsiba D , L. D. Vijay Anand , Deepak John Reji