English
Related papers

Related papers: SimulEval: An Evaluation Toolkit for Simultaneous …

200 papers

Simultaneous speech translation (SST) aims to provide real-time translation of spoken language, even before the speaker finishes their sentence. Traditionally, SST has been addressed primarily by cascaded systems that decompose the task…

Computation and Language · Computer Science 2023-10-18 Peter Polák

Identifying whether a word carries the same meaning or different meaning in two contexts is an important research area in natural language processing which plays a significant role in many applications such as question answering, document…

Computation and Language · Computer Science 2021-04-13 Hansi Hettiarachchi , Tharindu Ranasinghe

Simultaneous Interpretation (SI) represents one of the most daunting frontiers in the translation industry, with product-level automatic systems long plagued by intractable challenges: subpar transcription and translation quality, lack of…

A growing body of research runs human subject evaluations to study whether providing users with explanations of machine learning models can help them with practical real-world use cases. However, running user studies is challenging and…

Human-Computer Interaction · Computer Science 2022-08-23 Valerie Chen , Nari Johnson , Nicholay Topin , Gregory Plumb , Ameet Talwalkar

Simultaneous Machine Translation (SiMT) generates translations while reading the source sentence, necessitating a policy to determine the optimal timing for reading and generating words. Despite the remarkable performance achieved by Large…

Computation and Language · Computer Science 2024-02-21 Shoutao Guo , Shaolei Zhang , Zhengrui Ma , Min Zhang , Yang Feng

Simultaneous translation is widely useful but remains challenging. Previous work falls into two main categories: (a) fixed-latency policies such as Ma et al. (2019) and (b) adaptive policies such as Gu et al. (2017). The former are simple…

Computation and Language · Computer Science 2019-09-13 Baigong Zheng , Renjie Zheng , Mingbo Ma , Liang Huang

This paper presents our findings for SemEval 2025 Task 2, a shared task on entity-aware machine translation (EA-MT). The goal of this task is to develop translation models that can accurately translate English sentences into target…

The primary objective of simultaneous machine translation (SiMT) is to minimize latency while preserving the quality of the final translation. Drawing inspiration from CPU branch prediction techniques, we propose incorporating branch…

Computation and Language · Computer Science 2023-12-25 Aoxiong Yin , Tianyun Zhong , Haoyuan Li , Siliang Tang , Zhou Zhao

Recent advancements in large language models (LLMs) showcase varied multilingual capabilities across tasks like translation, code generation, and reasoning. Previous assessments often limited their scope to fundamental natural language…

Computation and Language · Computer Science 2025-05-15 Yidan Zhang , Yu Wan , Boyi Deng , Baosong Yang , Haoran Wei , Fei Huang , Bowen Yu , Junyang Lin , Fei Huang , Jingren Zhou

Boosted by the simultaneous translation shared task at IWSLT 2020, promising end-to-end online speech translation approaches were recently proposed. They consist in incrementally encoding a speech input (in a source language) and decoding…

Computation and Language · Computer Science 2021-06-15 Ha Nguyen , Yannick Estève , Laurent Besacier

The study of the attention mechanism has sparked interest in many fields, such as language modeling and machine translation. Although its patterns have been exploited to perform different tasks, from neural network understanding to textual…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Matteo Negri , Marco Turchi

In this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022. We explore strategies to utilize an offline model in a simultaneous setting without the need to modify the original model. In our experiments,…

Computation and Language · Computer Science 2022-05-12 Peter Polák , Ngoc-Quan Ngoc , Tuan-Nam Nguyen , Danni Liu , Carlos Mullov , Jan Niehues , Ondřej Bojar , Alexander Waibel

Speech language models (Speech LMs) enable end-to-end speech-text modeling within a single model, offering a promising direction for spoken dialogue systems. The choice of speech-text jointly decoding paradigm plays a critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-12 Haibin Wu , Yuxuan Hu , Ruchao Fan , Xiaofei Wang , Kenichi Kumatani , Bo Ren , Jianwei Yu , Heng Lu , Lijuan Wang , Yao Qian , Jinyu Li

Simultaneous machine translation, which aims at a real-time translation, is useful in many live scenarios but very challenging due to the trade-off between accuracy and latency. To achieve the balance for both, the model needs to wait for…

Computation and Language · Computer Science 2023-03-22 Lei Lin , Shuangtao Li , Xiaodong Shi

LLMs have shown impressive progress in natural language processing. However, they still face significant challenges in TableQA, where real-world complexities such as diverse table structures, multilingual data, and domain-specific reasoning…

Computation and Language · Computer Science 2025-09-23 Junnan Zhu , Jingyi Wang , Bohan Yu , Xiaoyu Wu , Junbo Li , Lei Wang , Nan Xu

We introduce MT-LENS, a framework designed to evaluate Machine Translation (MT) systems across a variety of tasks, including translation quality, gender bias detection, added toxicity, and robustness to misspellings. While several toolkits…

Computation and Language · Computer Science 2024-12-17 Javier García Gilabert , Carlos Escolano , Audrey Mash , Xixian Liao , Maite Melero

Simultaneous Machine Translation (SiMT) requires high-quality translations under strict real-time constraints, which traditional policies with only READ/WRITE actions cannot fully address. We extend the action space of SiMT with four…

Computation and Language · Computer Science 2026-01-19 Qianen Zhang , Zeyu Yang , Satoshi Nakamura

Some methods of automatic simultaneous translation of a long-form speech allow revisions of outputs, trading accuracy for low latency. Deploying these systems for users faces the problem of presenting subtitles in a limited space, such as…

Computation and Language · Computer Science 2020-09-22 Dominik Macháček , Ondřej Bojar

Automatic evaluation metrics are essential for building multilingual translation systems. The common practice of evaluating these systems is averaging metric scores across languages, yet this is suspicious since metrics may suffer from…

Computation and Language · Computer Science 2026-04-21 Jingxuan Liu , Zhi Qu , Jin Tei , Hidetaka Kamigaito , Lemao Liu , Taro Watanabe

We introduce Hibiki, a decoder-only model for simultaneous speech translation. Hibiki leverages a multistream language model to synchronously process source and target speech, and jointly produces text and audio tokens to perform…

Computation and Language · Computer Science 2025-02-27 Tom Labiausse , Laurent Mazaré , Edouard Grave , Patrick Pérez , Alexandre Défossez , Neil Zeghidour