English
Related papers

Related papers: CS3-Bench: Evaluating and Enhancing Speech-to-Spee…

200 papers

Speech language models have significantly advanced in generating realistic speech, with neural codec language models standing out. However, the integration of human feedback to align speech outputs to human preferences is often neglected.…

Computation and Language · Computer Science 2024-04-09 Dong Zhang , Zhaowei Li , Shimin Li , Xin Zhang , Pengyu Wang , Yaqian Zhou , Xipeng Qiu

General Large Language Models (LLMs) excel in reasoning, but those enhanced for translation struggle with reasoning tasks. To address this, we propose a novel translationenhanced recipe that begins with instruct models and applies…

Computation and Language · Computer Science 2025-10-13 Changjiang Gao , Zixian Huang , Jingyang Gong , Shujian Huang , Lei Li , Fei Yuan

While textless Spoken Language Models (SLMs) have shown potential in end-to-end speech-to-speech modeling, they still lag behind text-based Large Language Models (LLMs) in terms of semantic coherence and relevance. This work introduces the…

Computation and Language · Computer Science 2025-05-28 Guan-Ting Lin , Prashanth Gurunath Shivakumar , Aditya Gourav , Yile Gu , Ankur Gandhe , Hung-yi Lee , Ivan Bulyko

Speech accents pose a significant challenge to state-of-the-art automatic speech recognition (ASR) systems. Degradation in performance across underrepresented accents is a severe deterrent to the inclusive adoption of ASR. In this work, we…

Computation and Language · Computer Science 2023-10-30 Darshan Prabhu , Preethi Jyothi , Sriram Ganapathy , Vinit Unni

Code-switching is a widely prevalent linguistic phenomenon in multilingual societies like India. Building speech-to-text models for code-switched speech is challenging due to limited availability of datasets. In this work, we focus on the…

Computation and Language · Computer Science 2024-06-18 Bhavani Shankar , Preethi Jyothi , Pushpak Bhattacharyya

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been extensive studies on…

Computation and Language · Computer Science 2023-10-24 Ruochen Zhang , Samuel Cahyawijaya , Jan Christian Blaise Cruz , Genta Indra Winata , Alham Fikri Aji

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

It is well known that speaker identification yields very high performance in a neutral talking environment, on the other hand, the performance has been sharply declined in a shouted talking environment. This work aims at proposing,…

Sound · Computer Science 2017-07-07 Ismail Shahin

Large language models (LLMs) have driven substantial advances in speech language models (SpeechLMs), yielding strong performance in automatic speech recognition (ASR) under high-resource conditions. However, existing benchmarks…

Computation and Language · Computer Science 2026-03-23 Jianan Chen , Xiaoxue Gao , Tatsuya Kawahara , Nancy F. Chen

Acoustic-to-Word recognition provides a straightforward solution to end-to-end speech recognition without needing external decoding, language model re-scoring or lexicon. While character-based models offer a natural solution to the…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-22 Shruti Palaskar , Florian Metze

Accurate alignment between languages is fundamental for improving cross-lingual pre-trained language models (XLMs). Motivated by the natural phenomenon of code-switching (CS) in multilingual speakers, CS has been used as an effective data…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Fenia Christopoulou , Ignacio Iacobacci

While Speech Large Language Models (Speech-LLMs) show strong performance in many applications, their robustness is critically under-tested, especially to speech disfluency. Existing evaluations often rely on idealized inputs, overlooking…

Computation and Language · Computer Science 2025-10-20 Hongcheng Liu , Yixuan Hou , Heyang Liu , Yuhao Wang , Yanfeng Wang , Yu Wang

Recently, end-to-end models have become a popular approach as an alternative to traditional hybrid models in automatic speech recognition (ASR). The multi-speaker speech separation and recognition task is a central task in cocktail party…

Computation and Language · Computer Science 2018-11-07 Xuankai Chang , Yanmin Qian , Kai Yu , Shinji Watanabe

We describe the 2017 version of Microsoft's conversational speech recognition system, in which we update our 2016 system with recent developments in neural-network-based acoustic and language modeling to further advance the state of the art…

Computation and Language · Computer Science 2022-02-28 W. Xiong , L. Wu , F. Alleva , J. Droppo , X. Huang , A. Stolcke

We introduce a multilingual speaker change detection model (USM-SCD) that can simultaneously detect speaker turns and perform ASR for 96 languages. This model is adapted from a speech foundation model trained on a large quantity of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Guanlong Zhao , Yongqiang Wang , Jason Pelecanos , Yu Zhang , Hank Liao , Yiling Huang , Han Lu , Quan Wang

Chain-of-thought (CoT) has emerged as a critical mechanism for enhancing reasoning capabilities in large language models (LLMs), with self-consistency demonstrating notable promise in boosting performance. However, inherent linguistic…

Computation and Language · Computer Science 2025-04-03 Zhiwei Yu , Tuo Li , Changhong Wang , Hui Chen , Lang Zhou

There is widespread optimism that frontier Large Language Models (LLMs) and LLM-augmented systems have the potential to rapidly accelerate scientific discovery across disciplines. Today, many benchmarks exist to measure LLM knowledge and…

Automatic speech recognition systems have undoubtedly advanced with the integration of multilingual and multitask models such as Whisper, which have shown a promising ability to understand and process speech across a wide range of…

Computation and Language · Computer Science 2025-04-14 Xabier de Zuazo , Eva Navas , Ibon Saratxaga , Inma Hernáez Rioja

Designing machine intelligence to converse with a human user necessarily requires an understanding of how humans participate in conversation, and thus conversation modeling is an important task in natural language processing. New…

Computation and Language · Computer Science 2023-05-16 Sean Paulsen

Recent studies have augmented large language models (LLMs) with speech capabilities, leading to the development of speech language models (SpeechLMs). Earlier SpeechLMs focused on single-turn speech-based question answering (QA), where user…

Computation and Language · Computer Science 2025-02-10 Yifan Peng , Krishna C. Puvvada , Zhehuai Chen , Piotr Zelasko , He Huang , Kunal Dhawan , Ke Hu , Shinji Watanabe , Jagadeesh Balam , Boris Ginsburg