English
Related papers

Related papers: Macedonian Speech Synthesis for Assistive Technolo…

200 papers

This paper proposes Virtuoso, a massively multilingual speech-text joint semi-supervised learning framework for text-to-speech synthesis (TTS) models. Existing multilingual TTS typically supports tens of languages, which are a small…

Recent advances in artificial speech and audio technologies have improved the abilities of deep-fake operators to falsify media and spread malicious misinformation. Anyone with limited coding skills can use freely available speech synthesis…

Text to speech (TTS), or speech synthesis, which aims to synthesize intelligible and natural speech given text, is a hot research topic in speech, language, and machine learning communities and has broad applications in the industry. As the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-26 Xu Tan , Tao Qin , Frank Soong , Tie-Yan Liu

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

This paper investigates the use of unsupervised text-to-speech synthesis (TTS) as a data augmentation method to improve accented speech recognition. TTS systems are trained with a small amount of accented speech training data and their…

Computation and Language · Computer Science 2024-07-08 Cong-Thanh Do , Shuhei Imai , Rama Doddipatla , Thomas Hain

On account of growing demands for personalization, the need for a so-called few-shot TTS system that clones speakers with only a few data is emerging. To address this issue, we propose Attentron, a few-shot TTS model that clones voices of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Seungwoo Choi , Seungju Han , Dongyoung Kim , Sungjoo Ha

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

We propose a novel training algorithm for a multi-speaker neural text-to-speech (TTS) model based on multi-task adversarial training. A conventional generative adversarial network (GAN)-based training algorithm significantly improves the…

Sound · Computer Science 2022-09-27 Yusuke Nakai , Yuki Saito , Kenta Udagawa , Hiroshi Saruwatari

Recent breakthroughs in multi-talker ASR (MT-ASR) and speaker diarization (SD) rely on synthetic data to mitigate the scarcity of large-scale conversational recordings, yet the impact of specific simulation choices remains poorly…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-18 Alexander Polok , Ivan Medennikov , Jan Černocký , Shinji Watanabe , Lukáš Burget , Samuele Cornell

Fine-tuning is a popular method for adapting text-to-speech (TTS) models to new speakers. However this approach has some challenges. Usually fine-tuning requires several hours of high quality speech per speaker. There is also that…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Cheng-Ping Hsieh , Subhankar Ghosh , Boris Ginsburg

This paper introduces a high-quality open-source text-to-speech (TTS) synthesis dataset for Mongolian, a low-resource language spoken by over 10 million people worldwide. The dataset, named MnTTS, consists of about 8 hours of transcribed…

Sound · Computer Science 2022-09-23 Yifan Hu , Pengkai Yin , Rui Liu , Feilong Bao , Guanglai Gao

In recent years, several text-to-speech systems have been proposed to synthesize natural speech in zero-shot, few-shot, and low-resource scenarios. However, these methods typically require training with data from many different speakers.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Kishor Kayyar Lakshminarayana , Frank Zalkow , Christian Dittmar , Nicola Pia , Emanuel A. P. Habets

Deep learning has the potential to enhance speech signals and increase their intelligibility for users of hearing aids. Deep models suited for real-world application should feature a low computational complexity and low processing delay of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-31 Nils L. Westhausen , Hendrik Kayser , Theresa Jansen , Bernd T. Meyer

A large and growing amount of speech content in real-life scenarios is being recorded on consumer-grade devices in uncontrolled environments, resulting in degraded speech quality. Transforming such low-quality device-degraded speech into…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-23 Haoyu Li , Junichi Yamagishi

Speech processing techniques are useful for analyzing speech and language development in children with Autism Spectrum Disorder (ASD), who are often varied and delayed in acquiring these skills. Early identification and intervention are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Anfeng Xu , Rajat Hebbar , Rimita Lahiri , Tiantian Feng , Lindsay Butler , Lue Shen , Helen Tager-Flusberg , Shrikanth Narayanan

Recent advances in Text-to-Speech (TTS) have improved quality and naturalness to near-human capabilities when considering isolated sentences. But something which is still lacking in order to achieve human-like communication is the dynamic…

Computation and Language · Computer Science 2021-04-21 Shubhi Tyagi , Marco Nicolis , Jonas Rohnke , Thomas Drugman , Jaime Lorenzo-Trueba

Recent years have seen an increased interest in the computational speech processing of Maltese, but resources remain sparse. In this paper, we consider data augmentation techniques for improving speech recognition for low-resource…

Computation and Language · Computer Science 2023-01-23 Andrea DeMarco , Carlos Mena , Albert Gatt , Claudia Borg , Aiden Williams , Lonneke van der Plas

Classroom environments are particularly challenging for children with hearing impairments, where background noise, multiple talkers, and reverberation degrade speech perception. These difficulties are greater for children than adults, yet…

Diffusion-based text-to-speech (TTS) systems have made remarkable progress in zero-shot speech synthesis, yet optimizing all components for perceptual metrics remains challenging. Prior work with DMOSpeech demonstrated direct metric…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-22 Yinghao Aaron Li , Xilin Jiang , Fei Tao , Cheng Niu , Kaifeng Xu , Juntong Song , Nima Mesgarani

High-fidelity speech can be synthesized by end-to-end text-to-speech models in recent years. However, accessing and controlling speech attributes such as speaker identity, prosody, and emotion in a text-to-speech system remains a challenge.…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Zexin Cai , Chuxiong Zhang , Ming Li