English
Related papers

Related papers: Position: Towards Responsible Evaluation for Text-…

200 papers

The construction of high-quality datasets is a cornerstone of modern text-to-speech (TTS) systems. However, the increasing scale of available data poses significant challenges, including storage constraints. To address these issues, we…

Sound · Computer Science 2025-07-14 Kentaro Seki , Shinnosuke Takamichi , Takaaki Saeki , Hiroshi Saruwatari

Novel text-to-speech systems can generate entirely new voices that were not seen during training. However, it remains a difficult task to efficiently create personalized voices from a high-dimensional speaker space. In this work, we use…

In recent years, there has been significant progress in Text-to-Speech (TTS) synthesis technology, enabling the high-quality synthesis of voices in common scenarios. In unseen situations, adaptive TTS requires a strong generalization…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-10 Zhipeng Li , Xiaofen Xing , Jun Wang , Shuaiqi Chen , Guoqiao Yu , Guanglu Wan , Xiangmin Xu

Speech-to-speech translation combines machine translation with speech synthesis, introducing evaluation challenges not present in either task alone. How to automatically evaluate speech-to-speech translation is an open question which has…

Computation and Language · Computer Science 2021-10-27 Elizabeth Salesky , Julian Mäder , Severin Klinger

The rapid advancement of speech-to-speech (S2S) large language models (LLMs) has significantly improved real-time spoken interaction. However, current evaluation frameworks remain inadequate for assessing performance in complex, multi-turn…

Computation and Language · Computer Science 2025-09-16 Yuhao Du , Qianwei Huang , Guo Zhu , Zhanchen Dai , Shunian Chen , Qiming Zhu , Le Pan , Minghao Chen , Yuhao Zhang , Li Zhou , Benyou Wang , Haizhou Li

Text-to-Speech (TTS) has recently seen great progress in synthesizing high-quality speech owing to the rapid development of parallel TTS systems, but producing speech with naturalistic prosodic variations, speaking styles and emotional…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yinghao Aaron Li , Cong Han , Nima Mesgarani

Prompt-based text-to-speech (TTS) aims to generate speech that adheres to fine-grained style cues provided in a text prompt. However, most prior works depend on neither plausible nor faithful measures to evaluate prompt adherence. That is,…

Sound · Computer Science 2026-01-12 Chanhee Cho , Nayeon Kim , Bugeun Kim

Transfer tasks in text-to-speech (TTS) synthesis - where one or more aspects of the speech of one set of speakers is transferred to another set of speakers that do not feature these aspects originally - remains a challenging task. One of…

Humans can perceive speakers' characteristics (e.g., identity, gender, personality and emotion) by their appearance, which are generally aligned to their voice style. Recently, vision-driven Text-to-speech (TTS) scholars grounded their…

Sound · Computer Science 2025-04-17 Tian-Hao Zhang , Jiawei Zhang , Jun Wang , Xinyuan Qian , Xu-Cheng Yin

The aim of this workshop is two-fold. First, it aims to establish a research community focused on design and evaluation of synthetic speech (TTS) interfaces that are tailored not only to goal oriented tasks (e.g., food ordering, online…

Human-Computer Interaction · Computer Science 2024-02-27 Mateusz Dubiel , Matthew Aylett , Anuschka Schmitt , Zilin Ma , Gary Hsieh , Thiemo Wambsganss

Representations of AI agents in user interfaces and robotics are predominantly White, not only in terms of facial and skin features, but also in the synthetic voices they use. In this paper we explore some unexpected challenges in the…

Computation and Language · Computer Science 2024-03-19 Claudio Pinhanez , Raul Fernandez , Marcelo Grave , Julio Nogima , Ron Hoory

Zero-shot multi-speaker text-to-speech (ZS-TTS) systems have advanced for English, however, it still lags behind due to insufficient resources. We address this gap for Arabic, a language of more than 450 million native speakers, by first…

Computation and Language · Computer Science 2024-07-09 Khai Duy Doan , Abdul Waheed , Muhammad Abdul-Mageed

Speech synthesis technology has witnessed significant advancements in recent years, enabling the creation of natural and expressive synthetic speech. One area of particular interest is the generation of synthetic child speech, which…

Sound · Computer Science 2023-11-09 Rishabh Jain , Peter Corcoran

Although current Text-To-Speech (TTS) models are able to generate high-quality speech samples, there are still challenges in developing emotion intensity controllable TTS. Most existing TTS models achieve emotion intensity control by…

Sound · Computer Science 2024-05-28 Haoxiang Shi , Jianzong Wang , Xulong Zhang , Ning Cheng , Jun Yu , Jing Xiao

This paper explores the potential of constructing an AI spoken dialogue system that "thinks how to respond" and "thinks how to speak" simultaneously, which more closely aligns with the human speech production process compared to the current…

Computation and Language · Computer Science 2023-09-21 Xinyu Zhou , Delong Chen , Yudong Chen

End-to-end Text-to-speech (TTS) system can greatly improve the quality of synthesised speech. But it usually suffers form high time latency due to its auto-regressive structure. And the synthesised speech may also suffer from some error…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-11 Dabiao Ma , Zhiba Su , Wenxuan Wang , Yuhao Lu

Text-to-image models often struggle to generate images that precisely match textual prompts. Prior research has extensively studied the evaluation of image-text alignment in text-to-image generation. However, existing evaluations primarily…

Computation and Language · Computer Science 2025-06-11 Huixuan Zhang , Xiaojun Wan

While controllable Text-to-Speech (TTS) has achieved notable progress, most existing methods remain limited to inter-utterance-level control, making fine-grained intra-utterance expression challenging due to their reliance on non-public…

Sound · Computer Science 2026-05-19 Qifan Liang , Yuansen Liu , Ruixin Wei , Nan Lu , Junchuan Zhao , Ye Wang

While flow-matching text-to-speech (TTS) achieves strong zero-shot speaker similarity and naturalness, it remains susceptible to content fidelity issues, particularly skip and repeat errors from imperfect alignment. We propose…

Sound · Computer Science 2026-05-22 Jinhyeok Yang , Hyeongju Kim , Yechan Yu , Joon Byun , Frederik Bous , Juheon Lee

The evaluation of intelligibility for TTS has reached a bottleneck, as existing assessments heavily rely on word-by-word accuracy metrics such as WER, which fail to capture the complexity of real-world speech or reflect human comprehension…

Sound · Computer Science 2025-10-31 Hitomi Jin Ling Tee , Chaoren Wang , Zijie Zhang , Zhizheng Wu