English
Related papers

Related papers: Average Token Delay: A Latency Metric for Simultan…

200 papers

Recent work in simultaneous machine translation is often trained with conventional full sentence translation corpora, leading to either excessive latency or necessity to anticipate as-yet-unarrived words, when dealing with a language pair…

Computation and Language · Computer Science 2021-10-20 HyoJung Han , Seokchan Ahn , Yoonjung Choi , Insoo Chung , Sangha Kim , Kyunghyun Cho

With the advances in deep learning, the performance of end-to-end (E2E) single-task models for speech and audio processing has been constantly improving. However, it is still challenging to build a general-purpose model with high…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-21 Xiaoyu Yang , Qiujia Li , Chao Zhang , Phil Woodland

Current sign language machine translation systems rely on recognizing hand movements, facial expressions and body postures, and natural language processing, to convert signs into text. Recent approaches use Transformer architectures to…

Artificial Intelligence · Computer Science 2025-04-17 Nada Shahin , Leila Ismail

Autonomous driving systems require real-time environmental perception to ensure user safety and experience. Streaming perception is a task of reporting the current state of the world, which is used to evaluate the delay and accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Yihui Huang , Ningjiang Chen

The landscape of extremely low-resource machine translation (MT) is characterized by perplexing variability in reported performance, often making results across different language pairs difficult to contextualize. For researchers focused on…

Computation and Language · Computer Science 2026-03-27 Danlu Chen , Ka Sing He , Jiahe Tian , Chenghao Xiao , Zhaofeng Wu , Taylor Berg-Kirkpatrick , Freda Shi

Professional translators often dictate their translations orally and have them typed afterwards. The TransTalk project aims at automating the second part of this process. Its originality as a dictation system lies in the fact that both the…

Simultaneous machine translation (SimulMT) models start translation before the end of the source sentence, making the translation monotonically aligned with the source sentence. However, the general full-sentence translation test set is…

Computation and Language · Computer Science 2023-03-14 Mengge Liu , Wen Zhang , Xiang Li , Jian Luan , Bin Wang , Yuhang Guo , Shuoying Chen

Simultaneous speech translation (SST) aims to provide real-time translation of spoken language, even before the speaker finishes their sentence. Traditionally, SST has been addressed primarily by cascaded systems that decompose the task…

Computation and Language · Computer Science 2023-10-18 Peter Polák

Simultaneous speech translation (SimulST) is the task in which output generation has to be performed on partial, incremental speech input. In recent years, SimulST has become popular due to the spread of cross-lingual application scenarios,…

Computation and Language · Computer Science 2022-05-06 Sara Papi , Matteo Negri , Marco Turchi

Spoken language change detection (LCD) refers to identifying the language transitions in a code-switched utterance. Similarly, identifying the speaker transitions in a multispeaker utterance is known as speaker change detection (SCD). Since…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-19 Jagabandhu Mishra , S. R. Mahadeva Prasanna

We present an architecture for voice trigger detection for virtual assistants. The main idea in this work is to exploit information in words that immediately follow the trigger phrase. We first demonstrate that by including more audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-03 Siddharth Sigtia , John Bridle , Hywel Richards , Pascal Clark , Erik Marchi , Vineet Garg

Recent advances in speech large language models (speech LLMs) have enabled seamless spoken interactions, but these systems still struggle with complex reasoning tasks. Previously, chain-of-thought (CoT) prompting or fine-tuning has been to…

Computation and Language · Computer Science 2025-10-10 Yi-Jen Shih , Desh Raj , Chunyang Wu , Wei Zhou , SK Bong , Yashesh Gaur , Jay Mahadeokar , Ozlem Kalinli , Mike Seltzer

Large language models (LLMs) have achieved remarkable success across diverse tasks, yet their inference processes are hindered by substantial time and energy demands due to single-token generation at each decoding step. While previous…

Computation and Language · Computer Science 2025-04-11 Zongyue Qin , Ziniu Hu , Zifan He , Neha Prakriya , Jason Cong , Yizhou Sun

The primary objective of simultaneous machine translation (SiMT) is to minimize latency while preserving the quality of the final translation. Drawing inspiration from CPU branch prediction techniques, we propose incorporating branch…

Computation and Language · Computer Science 2023-12-25 Aoxiong Yin , Tianyun Zhong , Haoyuan Li , Siliang Tang , Zhou Zhao

Large language models have demonstrated exceptional capability in natural language understanding and generation. However, their generation speed is limited by the inherently sequential nature of their decoding process, posing challenges for…

Computation and Language · Computer Science 2024-05-27 Chenxi Sun , Hongzhi Zhang , Zijia Lin , Jingyuan Zhang , Fuzheng Zhang , Zhongyuan Wang , Bin Chen , Chengru Song , Di Zhang , Kun Gai , Deyi Xiong

Targeting at both high efficiency and performance, we propose AlignTTS to predict the mel-spectrum in parallel. AlignTTS is based on a Feed-Forward Transformer which generates mel-spectrum from a sequence of characters, and the duration of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-05 Zhen Zeng , Jianzong Wang , Ning Cheng , Tian Xia , Jing Xiao

For crosslingual conversation and trade, Neural Machine Translation (NMT) is pivotal yet faces persistent challenges with monotony and repetition in generated content. Traditional solutions that rely on penalizing text redundancy or token…

Computation and Language · Computer Science 2024-10-01 Huangyu Dai , Ben Chen , Kaidi Chen , Ying Han , Zihan Liang , Wen Jiang

Temporal sentence grounding (TSG) is a highly challenging task aiming to localize the temporal segment within an untrimmed video corresponding to a given natural language description. Benefiting from the design of learnable queries, the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Yifan Wang , Ziyi Liu , Xiaolong Sun , Jiawei Wang , Hongmin Liu

While Large Language Models (LLMs) have shown remarkable abilities, they are hindered by significant resource consumption and considerable latency due to autoregressive processing. In this study, we introduce Adaptive N-gram Parallel…

Computation and Language · Computer Science 2024-07-11 Jie Ou , Yueming Chen , Wenhong Tian

Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the…

Computation and Language · Computer Science 2021-01-01 Jiatao Gu , Xiang Kong