English
Related papers

Related papers: Swiss German Speech to Text system evaluation

200 papers

Our research extends the Bilingual Evaluation Understudy (BLEU) evaluation technique for statistical machine translation to make it more adjustable and robust. We intend to adapt it to resemble human evaluation more. We perform experiments…

Computation and Language · Computer Science 2015-10-01 Krzysztof Wołk , Krzysztof Marasek

This paper describes the submission to the IWSLT 2021 Low-Resource Speech Translation Shared Task by IMS team. We utilize state-of-the-art models combined with several data augmentation, multi-task and transfer learning approaches for the…

Computation and Language · Computer Science 2021-07-01 Pavel Denisov , Manuel Mager , Ngoc Thang Vu

It has been known that direct speech-to-speech translation (S2ST) models usually suffer from the data scarcity issue because of the limited existing parallel materials for both source and target speech. Therefore to train a direct S2ST…

Sound · Computer Science 2023-04-11 Jiatong Shi , Yun Tang , Ann Lee , Hirofumi Inaguma , Changhan Wang , Juan Pino , Shinji Watanabe

We present a direct speech-to-speech translation (S2ST) model that translates speech from one language to speech in another language without relying on intermediate text generation. We tackle the problem by first applying a self-supervised…

Computation and Language · Computer Science 2022-03-23 Ann Lee , Peng-Jen Chen , Changhan Wang , Jiatao Gu , Sravya Popuri , Xutai Ma , Adam Polyak , Yossi Adi , Qing He , Yun Tang , Juan Pino , Wei-Ning Hsu

In many jurisdictions, the excessive workload of courts leads to high delays. Suitable predictive AI models can assist legal professionals in their work, and thus enhance and speed up the process. So far, Legal Judgment Prediction (LJP)…

Computation and Language · Computer Science 2021-10-05 Joel Niklaus , Ilias Chalkidis , Matthias Stürmer

This work provides a brief description of Human Language Technology (HLT) Laboratory, National University of Singapore (NUS) system submission for 2020 NIST conversational telephone speech (CTS) speaker recognition evaluation (SRE). The…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-15 Rohan Kumar Das , Ruijie Tao , Haizhou Li

We present a corpus of sentence-aligned triples of German audio, German text, and English translation, based on German audiobooks. The speech translation data consist of 110 hours of audio material aligned to over 50k parallel sentences. An…

Computation and Language · Computer Science 2020-03-05 Benjamin Beilharz , Xin Sun , Sariya Karimova , Stefan Riezler

Conventional spoken language translation (SLT) systems are pipeline based systems, where we have an Automatic Speech Recognition (ASR) system to convert the modality of source from speech to text and a Machine Translation (MT) systems to…

In the English speech-to-text (STT) machine learning task, acoustic models are conventionally trained on uncased Latin characters, and any necessary orthography (such as capitalization, punctuation, and denormalization of non-standard…

The increasing availability of audio data on the internet lead to a multitude of datasets for development and training of text to speech applications, based on neural networks. Highly differing quality of voice, low sampling rates, lack of…

Sound · Computer Science 2021-06-14 Pascal Puchtler , Johannes Wirth , René Peinl

In this paper, we describe our end-to-end multilingual speech translation system submitted to the IWSLT 2021 evaluation campaign on the Multilingual Speech Translation shared task. Our system is built by leveraging transfer learning across…

Computation and Language · Computer Science 2021-08-17 Yun Tang , Hongyu Gong , Xian Li , Changhan Wang , Juan Pino , Holger Schwenk , Naman Goyal

Sign language translation (SLT) is often decomposed into video-to-gloss recognition and gloss-to-text translation, where a gloss is a sequence of transcribed spoken-language words in the order in which they are signed. We focus here on…

Computation and Language · Computer Science 2021-05-18 Amit Moryossef , Kayo Yin , Graham Neubig , Yoav Goldberg

Direct speech-to-speech translation (S2ST) models suffer from data scarcity issues as there exists little parallel S2ST data, compared to the amount of data available for conventional cascaded systems that consist of automatic speech…

Computation and Language · Computer Science 2022-09-14 Sravya Popuri , Peng-Jen Chen , Changhan Wang , Juan Pino , Yossi Adi , Jiatao Gu , Wei-Ning Hsu , Ann Lee

Speech-to-Speech Translation (S2ST) models transform speech from one language to another target language with the same linguistic information. S2ST is important for bridging the communication gap among communities and has diverse…

Computation and Language · Computer Science 2024-11-25 Mahendra Gupta , Maitreyee Dutta , Chandresh Kumar Maurya

While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Michael Gref , Oliver Walter , Christoph Schmidt , Sven Behnke , Joachim Köhler

This paper presents HITSZ's submission for the IWSLT 2025 Indic track, focusing on speech-to-text translation (ST) for English-to-Indic and Indic-to-English language pairs. To enhance translation quality in this low-resource scenario, we…

Computation and Language · Computer Science 2025-07-29 Xuchen Wei , Yangxin Wu , Yaoyin Zhang , Henglyu Liu , Kehai Chen , Xuefeng Bai , Min Zhang

End-to-end speech-to-speech translation (S2ST) without relying on intermediate text representations is a rapidly emerging frontier of research. Recent works have demonstrated that the performance of such direct S2ST systems is approaching…

Computation and Language · Computer Science 2022-06-29 Ye Jia , Yifan Ding , Ankur Bapna , Colin Cherry , Yu Zhang , Alexis Conneau , Nobuyuki Morioka

This paper describes the University of Sydney& JD's joint submission of the IWSLT 2021 low resource speech translation task. We participated in the Swahili-English direction and got the best scareBLEU (25.3) score among all the…

Computation and Language · Computer Science 2021-07-27 Liang Ding , Di Wu , Dacheng Tao

A major focus of recent research in spoken language understanding (SLU) has been on the end-to-end approach where a single model can predict intents directly from speech inputs without intermediate transcripts. However, this approach…

Computation and Language · Computer Science 2021-06-15 Sujeong Cha , Wangrui Hou , Hyun Jung , My Phung , Michael Picheny , Hong-Kwang Kuo , Samuel Thomas , Edmilson Morais

End-to-end speech-to-speech translation (S2ST) systems typically struggle with a critical data bottleneck: the scarcity of parallel speech-to-speech corpora. To overcome this, we introduce RosettaSpeech, a novel zero-shot framework trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-17 Zhisheng Zheng , Xiaohang Sun , Tuan Dinh , Abhishek Yanamandra , Abhinav Jain , Zhu Liu , Sunil Hadap , Vimal Bhat , Manoj Aggarwal , Gerard Medioni , David Harwath