English
Related papers

Related papers: Low-data? No problem: low-resource, language-agnos…

200 papers

Text-to-speech (TTS) systems are an important component in voice-based e-commerce applications. These applications include end-to-end voice assistant and customer experience (CX) voice bot. Code-mixed TTS is also relevant in these…

Machine Learning · Computer Science 2023-12-05 Raviraj Joshi , Nikesh Garera

With the popularity of deep neural network, speech synthesis task has achieved significant improvements based on the end-to-end encoder-decoder framework in the recent days. More and more applications relying on speech synthesis technology…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-23 Dongyang Dai , Li Chen , Yuping Wang , Mu Wang , Rui Xia , Xuchen Song , Zhiyong Wu , Yuxuan Wang

High-quality audio data is a critical prerequisite for training robust text-to-speech models, which often limits the use of opportunistic or crowdsourced datasets. This paper presents an approach to overcome this limitation by implementing…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 José Giraldo , Martí Llopart-Font , Alex Peiró-Lilja , Carme Armentano-Oller , Gerard Sant , Baybars Külebi

Modern speech synthesis techniques can produce natural-sounding speech given sufficient high-quality data and compute resources. However, such data is not readily available for many languages. This paper focuses on speech synthesis for…

Computation and Language · Computer Science 2022-07-05 Perez Ogayo , Graham Neubig , Alan W Black

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

Recent studies have outlined the accessibility challenges faced by blind or visually impaired, and less-literate people, in interacting with social networks, in-spite of facilitating technologies such as monotone text-to-speech (TTS) screen…

Social and Information Networks · Computer Science 2024-10-28 Suparna De , Ionut Bostan , Nishanth Sastry

We present a speaker conditioned text-to-speech (TTS) system aimed at addressing challenges in generating speech for unseen speakers and supporting diverse Indian languages. Our method leverages a diffusion-based TTS architecture, where a…

This work focuses on modelling a speaker's accent that does not have a dedicated text-to-speech (TTS) frontend, including a grapheme-to-phoneme (G2P) module. Prior work on modelling accents assumes a phonetic transcription is available for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-12 Georgi Tinchev , Marta Czarnowska , Kamil Deja , Kayoko Yanagisawa , Marius Cotescu

The training of task-oriented dialogue systems is often confronted with the lack of annotated data. In contrast to previous work which augments training data through expensive crowd-sourcing efforts, we propose four different automatic…

Computation and Language · Computer Science 2019-12-06 Jun Quan , Deyi Xiong

The trend of scaling up speech generation models poses a threat of biometric information leakage of the identities of the voices in the training data, raising privacy and security concerns. In this paper, we investigate training…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Wen-Chin Huang , Yi-Chiao Wu , Tomoki Toda

Transfer tasks in text-to-speech (TTS) synthesis - where one or more aspects of the speech of one set of speakers is transferred to another set of speakers that do not feature these aspects originally - remains a challenging task. One of…

Advancements in conversational systems have revolutionized information access, surpassing the limitations of single queries. However, developing dialogue systems requires a large amount of training data, which is a challenge in low-resource…

Computation and Language · Computer Science 2024-03-05 Heydar Soudani , Evangelos Kanoulas , Faegheh Hasibi

Recent advances in neural TTS have led to models that can produce high-quality synthetic speech. However, these models typically require large amounts of training data, which can make it costly to produce a new voice with the desired…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-25 Marcel de Korte , Jaebok Kim , Esther Klabbers

Few-shot speaker adaptation is a specific Text-to-Speech (TTS) system that aims to reproduce a novel speaker's voice with a few training data. While numerous attempts have been made to the few-shot speaker adaptation system, there is still…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-17 Ji-Hoon Kim , Sang-Hoon Lee , Ji-Hyun Lee , Hong-Gyu Jung , Seong-Whan Lee

In psychotherapy interactions, the quality of a session is assessed by codifying the communicative behaviors of participants during the conversation through manual observation and annotation. Developing computational approaches for…

Computation and Language · Computer Science 2022-10-27 Zhuohao Chen , Nikolaos Flemotomos , Zac E. Imel , David C. Atkins , Shrikanth Narayanan

The difficulty of acquiring abundant, high-quality data, especially in multi-lingual contexts, has sparked interest in addressing low-resource scenarios. Moreover, current literature rely on fixed expressions from language IDs, which…

Sound · Computer Science 2024-09-30 Youngjae Kim , Yejin Jeon , Gary Geunbae Lee

Several high-resource Text to Speech (TTS) systems currently produce natural, well-established human-like speech. In contrast, low-resource languages, including Arabic, have very limited TTS systems due to the lack of resources. We propose…

Computation and Language · Computer Science 2023-01-27 Massa Baali , Tomoki Hayashi , Hamdy Mubarak , Soumi Maiti , Shinji Watanabe , Wassim El-Hajj , Ahmed Ali

Although end-to-end text-to-speech (TTS) models such as Tacotron have shown excellent results, they typically require a sizable set of high-quality <text, audio> pairs for training, which are expensive to collect. In this paper, we propose…

Computation and Language · Computer Science 2018-08-31 Yu-An Chung , Yuxuan Wang , Wei-Ning Hsu , Yu Zhang , RJ Skerry-Ryan

Non-parallel many-to-many voice conversion remains an interesting but challenging speech processing task. Many style-transfer-inspired methods such as generative adversarial networks (GANs) and variational autoencoders (VAEs) have been…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-17 Kaizhi Qian , Zeyu Jin , Mark Hasegawa-Johnson , Gautham J. Mysore

Recent years have seen an increased interest in the computational speech processing of Maltese, but resources remain sparse. In this paper, we consider data augmentation techniques for improving speech recognition for low-resource…

Computation and Language · Computer Science 2023-01-23 Andrea DeMarco , Carlos Mena , Albert Gatt , Claudia Borg , Aiden Williams , Lonneke van der Plas