English
Related papers

Related papers: The X-LANCE Technical Report for Interspeech 2024 …

200 papers

Spoken Language Understanding (SLU) plays a crucial role in speech-centric multimedia applications, enabling machines to comprehend spoken language in scenarios such as meetings, interviews, and customer service interactions. SLU…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-18 Zhichao Sheng , Shilin Zhou , Chen Gong , Zhenghua Li

In this study, we reported our exploration of Text-To-Speech without Text (TTS without T) in the Zero Resource Speech Challenge 2020, in which participants proposed an end-to-end, unsupervised system that learned speech recognition and TTS…

Computation and Language · Computer Science 2020-11-03 Takashi Morita , Hiroki Koda

The INTERSPEECH 2020 Deep Noise Suppression (DNS) Challenge is intended to promote collaborative research in real-time single-channel Speech Enhancement aimed to maximize the subjective (perceptual) quality of the enhanced speech. A typical…

While the last decade has witnessed significant advancements in Automatic Speech Recognition (ASR) systems, performance of these systems for individuals with speech disabilities remains inadequate, partly due to limited public training…

This paper introduces StyleSpeech, a novel Text-to-Speech~(TTS) system that enhances the naturalness and accuracy of synthesized speech. Building upon existing TTS technologies, StyleSpeech incorporates a unique Style Decorator structure…

Sound · Computer Science 2024-12-31 Haowei Lou , Helen Paik , Wen Hu , Lina Yao

An unsupervised text-to-speech synthesis (TTS) system learns to generate speech waveforms corresponding to any written sentence in a language by observing: 1) a collection of untranscribed speech waveforms in that language; 2) a collection…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-17 Junrui Ni , Liming Wang , Heting Gao , Kaizhi Qian , Yang Zhang , Shiyu Chang , Mark Hasegawa-Johnson

Recently, deep learning-based Text-to-Speech (TTS) systems have achieved high-quality speech synthesis results. Recurrent neural networks have become a standard modeling technique for sequential data in TTS systems and are widely used.…

Sound · Computer Science 2024-03-19 Ziqi Liang , Haoxiang Shi , Jiawei Wang , Keda Lu

This manuscript describes the I4U submission to the 2020 NIST Speaker Recognition Evaluation (SRE'20) Conversational Telephone Speech (CTS) Challenge. The I4U's submission was resulted from active collaboration among researchers across…

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

Computation and Language · Computer Science 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

The front-end module in multi-channel automatic speech recognition (ASR) systems mainly use microphone array techniques to produce enhanced signals in noisy conditions with reverberation and echos. Recently, neural network (NN) based…

Sound · Computer Science 2020-11-19 Yuxiang Kong , Jian Wu , Quandong Wang , Peng Gao , Weiji Zhuang , Yujun Wang , Lei Xie

Speech-to-speech translation (S2ST) has been advanced with large language models (LLMs), which are fine-tuned on discrete speech units. In such approaches, modality adaptation from text to speech has been an issue. LLMs are trained on…

Computation and Language · Computer Science 2025-06-13 Hayato Futami , Emiru Tsunoo , Yosuke Kashiwagi , Yuki Ito , Hassan Shahmohammadi , Siddhant Arora , Shinji Watanabe

Conventional spoken language translation (SLT) systems are pipeline based systems, where we have an Automatic Speech Recognition (ASR) system to convert the modality of source from speech to text and a Machine Translation (MT) systems to…

Most research on task oriented dialog modeling is based on written text input. However, users interact with practical dialog systems often using speech as input. Typically, systems convert speech into text using an Automatic Speech…

Artificial Intelligence · Computer Science 2022-12-20 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Abhinav Rastogi , Jeffrey Zhao , Ye Jia , Wei Han , Yuan Cao , Aramys Miranda

Speech-to-speech translation (S2ST) converts input speech to speech in another language. A challenge of delivering S2ST in real time is the accumulated delay between the translation and speech synthesis modules. While recently incremental…

Computation and Language · Computer Science 2022-07-18 Danni Liu , Changhan Wang , Hongyu Gong , Xutai Ma , Yun Tang , Juan Pino

Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-12 Changhan Wang , Juan Pino , Jiatao Gu

With the rise of Speech Large Language Models (Speech LLMs), there has been growing interest in discrete speech tokens for their ability to integrate with text-based tokens seamlessly. Compared to most studies that focus on continuous…

Computation and Language · Computer Science 2024-11-14 Dingdong Wang , Mingyu Cui , Dongchao Yang , Xueyuan Chen , Helen Meng

We investigate the performance of self-supervised pretraining frameworks on pathological speech datasets used for automatic speech recognition (ASR). Modern end-to-end models require thousands of hours of data to train well, but only a…

Sound · Computer Science 2022-06-30 Lester Phillip Violeta , Wen-Chin Huang , Tomoki Toda

End-to-end (E2E) spoken language understanding (SLU) systems avoid an intermediate textual representation by mapping speech directly into intents with slot values. This approach requires considerable domain-specific training data. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Pu Wang , Bagher BabaAli , Hugo Van hamme

Text-to-Speech (TTS) synthesis using deep learning relies on voice quality. Modern TTS models are advanced, but they need large amount of data. Given the growing computational complexity of these models and the scarcity of large,…

Sound · Computer Science 2023-10-10 Ze Liu

In this report, we describe our submitted system for track 2 of the VoxCeleb Speaker Recognition Challenge 2022 (VoxSRC-22). We fuse a variety of good-performing models ranging from supervised models to self-supervised learning(SSL)…

Sound · Computer Science 2022-09-26 Gang Liu , Tianyan Zhou , Yong Zhao , Yu Wu , Zhuo Chen , Yao Qian , Jian Wu