English
Related papers

Related papers: LibriTTS-R: A Restored Multi-Speaker Text-to-Speec…

200 papers

Text-to-speech (TTS) synthesis is a technology that converts written text into spoken words, enabling a natural and accessible means of communication. This abstract explores the key aspects of TTS synthesis, encompassing its underlying…

Software Engineering · Computer Science 2024-01-26 Harini s , Manoj G M

We introduce ArVoice, a multi-speaker Modern Standard Arabic (MSA) speech corpus with diacritized transcriptions, intended for multi-speaker speech synthesis, and can be useful for other tasks such as speech-based diacritic restoration,…

Computation and Language · Computer Science 2025-05-28 Hawau Olamide Toyin , Rufael Marew , Humaid Alblooshi , Samar M. Magdy , Hanan Aldarmaki

We describe a neural network-based system for text-to-speech (TTS) synthesis that is able to generate speech audio in the voice of many different speakers, including those unseen during training. Our system consists of three independently…

Computation and Language · Computer Science 2019-01-04 Ye Jia , Yu Zhang , Ron J. Weiss , Quan Wang , Jonathan Shen , Fei Ren , Zhifeng Chen , Patrick Nguyen , Ruoming Pang , Ignacio Lopez Moreno , Yonghui Wu

Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of developing high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is…

Computation and Language · Computer Science 2019-06-19 Wei Fang , Yu-An Chung , James Glass

Scientific talks are a growing medium for disseminating research, and automatically identifying relevant literature that grounds or enriches a talk would be highly valuable for researchers and students alike. We introduce Reference…

Computation and Language · Computer Science 2025-10-29 Frederik Broy , Maike Züfle , Jan Niehues

Large-scale text-to-speech (TTS) systems are limited by the scarcity of clean, multilingual recordings. We introduce Sidon, a fast, open-source speech restoration model that converts noisy in-the-wild speech into studio-quality speech and…

Sound · Computer Science 2026-01-27 Wataru Nakata , Yuki Saito , Yota Ueda , Hiroshi Saruwatari

Natural language processing (NLP) and speech technologies have made significant progress in recent years; however, they remain largely focused on standardized language varieties. Dialects, despite their cultural significance and widespread…

Computation and Language · Computer Science 2026-04-14 Lena S. Oberkircher , Jesujoba O. Alabi , Dietrich Klakow , Jürgen Trouvain

We introduce a new collection of spoken English audio suitable for training speech recognition systems under limited or no supervision. It is derived from open-source audio books from the LibriVox project. It contains over 60K hours of…

Automatic speech recognition (ASR) research is driven by the availability of common datasets between industrial researchers and academics, encouraging comparisons and evaluations. LibriSpeech, despite its long success as an ASR benchmark,…

Computation and Language · Computer Science 2025-05-29 Titouan Parcollet , Yuan Tseng , Shucong Zhang , Rogier van Dalen

While automatic speech recognition (ASR) systems have achieved remarkable performance with large-scale datasets, their efficacy remains inadequate in low-resource settings, encompassing dialects, accents, minority languages, and long-tail…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Guanrou Yang , Fan Yu , Ziyang Ma , Zhihao Du , Zhifu Gao , Shiliang Zhang , Xie Chen

Many neural text-to-speech architectures can synthesize nearly natural speech from text inputs. These architectures must be trained with tens of hours of annotated and high-quality speech data. Compiling such large databases for every new…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-21 Kishor Kayyar Lakshminarayana , Christian Dittmar , Nicola Pia , Emanuël Habets

Tibetan text-to-speech (TTS) has long been challenged by scarce speech resources, significant dialectal variation, and the complex mapping between written text and spoken pronunciation. To address these issues, this work presents, to the…

Sound · Computer Science 2026-05-05 Jiaxu He , Chao Wang , Jie Lian , Yuqing Cai , Yongxiang Li , Renzeg Duojie , Jie Li

Recent advancements in large language models (LLMs) have driven significant progress in zero-shot text-to-speech (TTS) synthesis. However, existing foundation models rely on multi-stage processing or complex architectures for predicting…

The rapid development of neural text-to-speech (TTS) systems enabled its usage in other areas of natural language processing such as automatic speech recognition (ASR) or spoken language translation (SLT). Due to the large number of…

Computation and Language · Computer Science 2024-08-01 Nick Rossenbach , Ralf Schlüter , Sakriani Sakti

This work proposes GLM-TTS, a production-level TTS system designed for efficiency, controllability, and high-fidelity speech generation. GLM-TTS follows a two-stage architecture, consisting of a text-to-token autoregressive model and a…

Data augmentation is one of the most effective ways to make end-to-end automatic speech recognition (ASR) perform close to the conventional hybrid approach, especially when dealing with low-resource tasks. Using recent advances in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 Aleksandr Laptev , Roman Korostik , Aleksey Svischev , Andrei Andrusenko , Ivan Medennikov , Sergey Rybin

In this paper, we present StyleTTS 2, a text-to-speech (TTS) model that leverages style diffusion and adversarial training with large speech language models (SLMs) to achieve human-level TTS synthesis. StyleTTS 2 differs from its…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Vinay S. Raghavan , Gavin Mischler , Nima Mesgarani

In this study, we introduce ManaTTS, the most extensive publicly accessible single-speaker Persian corpus, and a comprehensive framework for collecting transcribed speech datasets for the Persian language. ManaTTS, released under the open…

Sound · Computer Science 2024-09-12 Mahta Fetrat Qharabagh , Zahra Dehghanian , Hamid R. Rabiee

The current public datasets for speech recognition (ASR) tend not to focus specifically on the fairness aspect, such as performance across different demographic groups. This paper introduces a novel dataset, Fair-Speech, a publicly released…

Artificial Intelligence · Computer Science 2024-08-26 Irina-Elena Veliche , Zhuangqun Huang , Vineeth Ayyat Kochaniyan , Fuchun Peng , Ozlem Kalinli , Michael L. Seltzer

Speech synthesis is the artificial production of human speech. A typical text-to-speech system converts a language text into a waveform. There exist many English TTS systems that produce mature, natural, and human-like speech synthesizers.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-23 Fady Fahmy , Mahmoud Khalil , Hazem Abbas