English
Related papers

Related papers: NAIST Simultaneous Speech Translation System for I…

200 papers

This paper discusses the construction, fine-tuning, and deployment of BeaverTalk, a cascaded system for speech-to-text translation as part of the IWSLT 2025 simultaneous translation task. The system architecture employs a VAD segmenter for…

Computation and Language · Computer Science 2025-06-02 Matthew Raffel , Victor Agostinelli , Lizhong Chen

Direct speech-to-speech translation (S2ST) is an attractive research topic with many advantages compared to cascaded S2ST. However, direct S2ST suffers from the data scarcity problem because the corpora from speech of the source language to…

Sound · Computer Science 2022-11-01 Kun Wei , Long Zhou , Ziqiang Zhang , Liping Chen , Shujie Liu , Lei He , Jinyu Li , Furu Wei

Simultaneous translation models play a crucial role in facilitating communication. However, existing research primarily focuses on text-to-text or speech-to-text models, necessitating additional cascade components to achieve…

Computation and Language · Computer Science 2024-10-22 Zhengrui Ma , Qingkai Fang , Shaolei Zhang , Shoutao Guo , Yang Feng , Min Zhang

Simultaneous speech translation (SimulST) translates partial speech inputs incrementally. Although the monotonic correspondence between input and output is preferable for smaller latency, it is not the case for distant language pairs such…

Computation and Language · Computer Science 2023-06-16 Yuka Ko , Ryo Fukuda , Yuta Nishikawa , Yasumasa Kano , Katsuhito Sudoh , Satoshi Nakamura

Speech translation for low-resource languages remains fundamentally limited by the scarcity of high-quality, diverse parallel speech data, a challenge that is especially pronounced in African linguistic contexts. To address this, we…

This paper describes the ON-TRAC Consortium translation systems developed for the end-to-end model task of IWSLT Evaluation 2019 for the English-to-Portuguese language pair. ON-TRAC Consortium is composed of researchers from three French…

State-of-the-art text-to-speech (TTS) systems realize high naturalness in monolingual environments, synthesizing speech with correct multilingual accents (especially for Indic languages) and context-relevant emotions still poses difficulty…

Machine Learning · Computer Science 2025-06-23 Pranav Pawar , Akshansh Dwivedi , Jenish Boricha , Himanshu Gohil , Aditya Dubey

Nowadays, training end-to-end neural models for spoken language translation (SLT) still has to confront with extreme data scarcity conditions. The existing SLT parallel corpora are indeed orders of magnitude smaller than those available for…

Computation and Language · Computer Science 2019-10-09 Mattia Antonino Di Gangi , Matteo Negri , Marco Turchi

Speech to speech translation (S2ST) is a transformative technology that bridges global communication gaps, enabling real time multilingual interactions in diplomacy, tourism, and international trade. Our review examines the evolution of…

Computation and Language · Computer Science 2025-03-10 Mohammad Sarim , Saim Shakeel , Laeeba Javed , Jamaluddin , Mohammad Nadeem

Transformer-based text to speech (TTS) model (e.g., Transformer TTS~\cite{li2019neural}, FastSpeech~\cite{ren2019fastspeech}) has shown the advantages of training and inference efficiency over RNN-based model (e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-04 Mingjian Chen , Xu Tan , Yi Ren , Jin Xu , Hao Sun , Sheng Zhao , Tao Qin , Tie-Yan Liu

This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs. To enhance translation quality in this low-resource scenario, we…

Computation and Language · Computer Science 2025-07-29 Xuchen Wei , Yangxin Wu , Yaoyin Zhang , Henglyu Liu , Kehai Chen , Xuefeng Bai , Min Zhang

We present a direct speech-to-speech translation (S2ST) model that translates speech from one language to speech in another language without relying on intermediate text generation. We tackle the problem by first applying a self-supervised…

Computation and Language · Computer Science 2022-03-23 Ann Lee , Peng-Jen Chen , Changhan Wang , Jiatao Gu , Sravya Popuri , Xutai Ma , Adam Polyak , Yossi Adi , Qing He , Yun Tang , Juan Pino , Wei-Ning Hsu

Despite recent advances in speech-to-speech translation (S2ST), it remains difficult to achieve both high translation accuracy and practical flexibility. In this paper, we present S2ST-Omni, a compositional S2ST framework that integrates a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-07 Yu Pan , Xiongfei Wu , Yuguang Yang , Jixun Yao , Lei Ma , Jianjun Zhao

Simultaneous speech-to-text translation (Simul-S2TT) aims to translate speech into target text in real time, outputting translations while receiving source speech input, rather than waiting for the entire utterance to be spoken. Simul-S2TT…

Sound · Computer Science 2026-05-06 Pei Zhang , Yiming Wang , Jialong Tang , Baosong Yang , Rui Wang , Derek F. Wong , Fei Huang

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

Computation and Language · Computer Science 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

This paper describes our work in participation of the IWSLT-2021 offline speech translation task. Our system was built in a cascade form, including a speaker diarization module, an Automatic Speech Recognition (ASR) module and a Machine…

Computation and Language · Computer Science 2021-08-10 Minghan Wang , Yuxia Wang , Chang Su , Jiaxin Guo , Yingtao Zhang , Yujia Liu , Min Zhang , Shimin Tao , Xingshan Zeng , Liangyou Li , Hao Yang , Ying Qin

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-24 Hyeongju Kim , Jinhyeok Yang , Yechan Yu , Seunghun Ji , Jacob Morton , Frederik Bous , Joon Byun , Juheon Lee

The scope of the International Workshop on Spoken Language Translation (IWSLT) has recently broadened beyond traditional Speech Translation (ST) to encompass a wider array of tasks, including Speech Question Answering and Summarization.…

Computation and Language · Computer Science 2025-05-20 Sai Koneru , Maike Züfle , Thai-Binh Nguyen , Seymanur Akti , Jan Niehues , Alexander Waibel

Large Language Models (LLMs) are currently under exploration for various tasks, including Automatic Speech Recognition (ASR), Machine Translation (MT), and even End-to-End Speech Translation (ST). In this paper, we present KIT's offline…

Computation and Language · Computer Science 2024-06-25 Sai Koneru , Thai-Binh Nguyen , Ngoc-Quan Pham , Danni Liu , Zhaolin Li , Alexander Waibel , Jan Niehues

We introduce a text-to-speech(TTS) framework based on a neural transducer. We use discretized semantic tokens acquired from wav2vec2.0 embeddings, which makes it easy to adopt a neural transducer for the TTS framework enjoying its monotonic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-09 Minchan Kim , Myeonghun Jeong , Byoung Jin Choi , Dongjune Lee , Nam Soo Kim