English
Related papers

Related papers: Why We Need Speech to Evaluate Speech Translation

200 papers

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-08 Jing Peng , Yucheng Wang , Bohan Li , Yiwei Guo , Hankun Wang , Yangui Fang , Yu Xi , Haoyu Li , Xu Li , Ke Zhang , Shuai Wang , Kai Yu

Warning: This paper may contain texts with uncomfortable content. Large Language Models (LLMs) have achieved remarkable performance in various tasks, including those involving multimodal data like speech. However, these models often exhibit…

Computation and Language · Computer Science 2025-05-22 Yi-Cheng Lin , Wei-Chih Chen , Hung-yi Lee

Although there has been significant advancement in the field of speech-to-speech translation, conventional models still require language-parallel speech data between the source and target languages for training. In this paper, we introduce…

Computation and Language · Computer Science 2024-03-21 Seung-Bin Kim , Sang-Hoon Lee , Seong-Whan Lee

Spoken language understanding research to date has generally carried a heavy text perspective. Most datasets are derived from text, which is then subsequently synthesized into speech, and most models typically rely on automatic…

Computation and Language · Computer Science 2025-02-11 Jie Chi , Maureen de Seyssel , Natalie Schluter

Non-reference speech quality models are important for a growing number of applications. The VoiceMOS 2022 challenge provided a dataset of synthetic voice conversion and text-to-speech samples with subjective labels. This study looks at the…

Sound · Computer Science 2022-09-15 Michael Chinen , Jan Skoglund , Chandan K A Reddy , Alessandro Ragano , Andrew Hines

Enhancing explainability in speech self-supervised learning (SSL) is important for developing reliable SSL-based speech processing systems. This study probes how speech SSL models encode speaker-specific information via a large-scale…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Aemon Yat Fei Chiu , Kei Ching Fung , Roger Tsz Yeung Li , Jingyu Li , Tan Lee

Unlike text, speech conveys information about the speaker, such as gender, through acoustic cues like pitch. This gives rise to modality-specific bias concerns. For example, in speech translation (ST), when translating from languages with…

Computation and Language · Computer Science 2026-04-29 Lina Conti , Dennis Fucci , Marco Gaido , Matteo Negri , Guillaume Wisniewski , Luisa Bentivogli

Utilizing Self-Supervised Learning (SSL) models for Speech Emotion Recognition (SER) has proven effective, yet limited research has explored cross-lingual scenarios. This study presents a comparative analysis between human performance and…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-01 Zhichen Han , Tianqi Geng , Hui Feng , Jiahong Yuan , Korin Richmond , Yuanchao Li

Speaker identity is one of the important characteristics of human speech. In voice conversion, we change the speaker identity from one to another, while keeping the linguistic content unchanged. Voice conversion involves multiple speech…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-18 Berrak Sisman , Junichi Yamagishi , Simon King , Haizhou Li

Many self-supervised speech models (S3Ms) have been introduced over the last few years, improving performance and data efficiency on various speech tasks. However, these empirical successes alone do not give a complete picture of what is…

Computation and Language · Computer Science 2024-02-01 Ankita Pasad , Chung-Ming Chien , Shane Settle , Karen Livescu

Prosody is essential for speech technology, shaping comprehension, naturalness, and expressiveness. However, current text-to-speech (TTS) systems still struggle to accurately capture human-like prosodic variation, in part because existing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-05 Cedric Chan , Jianjing Kuang

The conventional paradigm in speech translation starts with a speech recognition step to generate transcripts, followed by a translation step with the automatic transcripts as input. To address various shortcomings of this paradigm, recent…

Computation and Language · Computer Science 2020-08-31 Matthias Sperber , Hendra Setiawan , Christian Gollan , Udhyakumar Nallasamy , Matthias Paulik

Although proper handling of discourse significantly contributes to the quality of machine translation (MT), these improvements are not adequately measured in common translation quality metrics. Recent works in context-aware MT attempt to…

Computation and Language · Computer Science 2023-06-28 Patrick Fernandes , Kayo Yin , Emmy Liu , André F. T. Martins , Graham Neubig

Prosody is an integral part of communication, but remains an open problem in state-of-the-art speech synthesis. There are two major issues faced when modelling prosody: (1) prosody varies at a slower rate compared with other content in the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Zack Hodari , Alexis Moinet , Sri Karlapati , Jaime Lorenzo-Trueba , Thomas Merritt , Arnaud Joly , Ammar Abbas , Penny Karanasou , Thomas Drugman

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

Computation and Language · Computer Science 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Speech translation has traditionally been approached through cascaded models consisting of a speech recognizer trained on a corpus of transcribed speech, and a machine translation system trained on parallel texts. Several recent works have…

Computation and Language · Computer Science 2019-04-16 Matthias Sperber , Graham Neubig , Jan Niehues , Alex Waibel

Cross-lingual alignment in pretrained language models enables knowledge transfer across languages. Similar alignment has been reported in Whisper-style speech encoders, based on spoken translation retrieval using representational…

Computation and Language · Computer Science 2026-04-07 Ryan Soh-Eun Shim , Domenico De Cristofaro , Chengzhi Martin Hu , Alessandro Vietti , Barbara Plank

Advancements in spoken language processing have driven the development of spoken language models (SLMs), designed to achieve universal audio understanding by jointly learning text and audio representations for a wide range of tasks.…

Computation and Language · Computer Science 2025-10-31 Pedro Corrêa , João Lima , Victor Moreno , Lucas Ueda , Paula Dornhofer Paro Costa

Large Audio-Language Models (LALMs) as judges have emerged as a prominent approach for evaluating speech generation quality, yet their ability to assess speaker consistency across multi-turn dialogues remains unexplored. We present…

Computation and Language · Computer Science 2026-04-21 Jonggeun Lee , Junseong Pyo , Gyuhyeon Seo , Yohan Jo

Current speech translation systems, while having achieved impressive accuracies, are rather static in their behavior and do not adapt to real-world situations in ways human interpreters do. In order to improve their practical usefulness and…

Computation and Language · Computer Science 2025-08-12 Matthias Sperber , Maureen de Seyssel , Jiajun Bao , Matthias Paulik