中文
相关论文

相关论文: Low-Resource Text-to-Speech Using Specific Data an…

200 篇论文

While neural text-to-speech (TTS) has achieved human-like natural synthetic speech, multilingual TTS systems are limited to resource-rich languages due to the need for paired text and studio-quality audio data. This paper proposes a method…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Takaaki Saeki , Soumi Maiti , Xinjian Li , Shinji Watanabe , Shinnosuke Takamichi , Hiroshi Saruwatari

Disordered speech recognition is a highly challenging task. The underlying neuro-motor conditions of people with speech disorders, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large…

声音 · 计算机科学 2022-01-20 Mengzhe Geng , Xurong Xie , Shansong Liu , Jianwei Yu , Shoukang Hu , Xunying Liu , Helen Meng

Full-duplex, spontaneous conversational data are essential for enhancing the naturalness and interactivity of synthesized speech in conversational TTS systems. We present two open-source dual-track conversational speech datasets, one in…

声音 · 计算机科学 2025-09-05 Zhitong Zhou , Qingqing Zhang , Lei Luo , Jiechen Liu , Ruohua Zhou

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We introduce Synth4Kws…

音频与语音处理 · 电气工程与系统科学 2026-02-06 Pai Zhu , Dhruuv Agarwal , Jacob W. Bartel , Kurt Partridge , Hyun Jin Park , Quan Wang

Neural text-to-speech synthesis (NTTS) models have shown significant progress in generating high-quality speech, however they require a large quantity of training data. This makes creating models for multiple styles expensive and…

Although end-to-end neural text-to-speech (TTS) methods (such as Tacotron2) are proposed and achieve state-of-the-art performance, they still suffer from two problems: 1) low efficiency during training and inference; 2) hard to model long…

计算与语言 · 计算机科学 2019-01-31 Naihan Li , Shujie Liu , Yanqing Liu , Sheng Zhao , Ming Liu , Ming Zhou

Automatic speech recognition (ASR) systems play a key role in many commercial products including voice assistants. Typically, they require large amounts of clean speech data for training which gives an undue advantage to large organizations…

音频与语音处理 · 电气工程与系统科学 2019-11-21 Bhavya Ghai , Buvana Ramanan , Klaus Mueller

Psychoacoustic studies have shown that locally-time reversed (LTR) speech, i.e., signal samples time-reversed within a short segment, can be accurately recognised by human listeners. This study addresses the question of how well a…

音频与语音处理 · 电气工程与系统科学 2021-10-12 Si-Ioi Ng , Tan Lee

With the similarity between music and speech synthesis from symbolic input and the rapid development of text-to-speech (TTS) techniques, it is worthwhile to explore ways to improve the MIDI-to-audio performance by borrowing from TTS…

声音 · 计算机科学 2023-03-22 Xuan Shi , Erica Cooper , Xin Wang , Junichi Yamagishi , Shrikanth Narayanan

Many speech synthesis datasets, especially those derived from audiobooks, naturally comprise sequences of utterances. Nevertheless, such data are commonly treated as individual, unordered utterances both when training a model and at…

计算与语言 · 计算机科学 2020-12-08 Pilar Oplustil-Gallegos , Simon King

Speech synthesis technology has witnessed significant advancements in recent years, enabling the creation of natural and expressive synthetic speech. One area of particular interest is the generation of synthetic child speech, which…

声音 · 计算机科学 2023-11-09 Rishabh Jain , Peter Corcoran

End-to-end speech-to-speech translation (S2ST) without relying on intermediate text representations is a rapidly emerging frontier of research. Recent works have demonstrated that the performance of such direct S2ST systems is approaching…

计算与语言 · 计算机科学 2022-06-29 Ye Jia , Yifan Ding , Ankur Bapna , Colin Cherry , Yu Zhang , Alexis Conneau , Nobuyuki Morioka

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

音频与语音处理 · 电气工程与系统科学 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

Recently, synthesizing personalized speech by text-to-speech (TTS) application is highly demanded. But the previous TTS models require a mass of target speaker speeches for training. It is a high-cost task, and hard to record lots of…

声音 · 计算机科学 2022-05-25 Xulong Zhang , Jianzong Wang , Ning Cheng , Jing Xiao

Scaling text-to-speech (TTS) to large-scale, multi-speaker, and in-the-wild datasets is important to capture the diversity in human speech such as speaker identities, prosodies, and styles (e.g., singing). Current large TTS systems usually…

音频与语音处理 · 电气工程与系统科学 2023-05-31 Kai Shen , Zeqian Ju , Xu Tan , Yanqing Liu , Yichong Leng , Lei He , Tao Qin , Sheng Zhao , Jiang Bian

State of the art (SOTA) neural text to speech (TTS) models can generate natural-sounding synthetic voices. These models are characterized by large memory footprints and substantial number of operations due to the long-standing focus on…

音频与语音处理 · 电气工程与系统科学 2023-05-24 Rowel Atienza

Although neural end-to-end text-to-speech models can synthesize highly natural speech, there is still room for improvements to its efficiency and naturalness. This paper proposes a non-autoregressive neural text-to-speech model augmented…

声音 · 计算机科学 2020-10-23 Isaac Elias , Heiga Zen , Jonathan Shen , Yu Zhang , Ye Jia , Ron Weiss , Yonghui Wu

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

计算与语言 · 计算机科学 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

The training of task-oriented dialogue systems is often confronted with the lack of annotated data. In contrast to previous work which augments training data through expensive crowd-sourcing efforts, we propose four different automatic…

计算与语言 · 计算机科学 2019-12-06 Jun Quan , Deyi Xiong

Own voice pickup for hearables in noisy environments benefits from using both an outer and an in-ear microphone outside and inside the occluded ear. Due to environmental noise recorded at both microphones, and amplification of the own voice…

音频与语音处理 · 电气工程与系统科学 2025-08-20 Mattes Ohlenbusch , Christian Rollwage , Simon Doclo