English
Related papers

Related papers: Average Token Delay: A Latency Metric for Simultan…

200 papers

Although measuring intrinsic quality has been a key factor in the advancement of Machine Translation (MT), successfully deploying MT requires considering not just intrinsic quality but also the user experience, including aspects such as…

Computation and Language · Computer Science 2018-02-19 Marianna J. Martindale , Marine Carpuat

Conventional spoken language translation (SLT) systems are pipeline based systems, where we have an Automatic Speech Recognition (ASR) system to convert the modality of source from speech to text and a Machine Translation (MT) systems to…

Speculative decoding accelerates large language model (LLM) inference by using a lightweight draft model to propose tokens that are later verified by a stronger target model. While effective in centralized systems, its behavior in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Jingwei Song , Wanyi Chen , Xinyuan Song , Max , Chris Tong , Gufeng Chen , Tianyi Zhao , Eric Yang , Bill Shi , Lynn Ai

Augmenting large language models (LLMs) with auxiliary tokens has emerged as a promising strategy for enhancing model performance. In this work, we introduce a lightweight method termed latent tokens; these are dummy tokens that may be…

Machine Learning · Computer Science 2025-05-20 Yuchang Sun , Yanxi Chen , Yaliang Li , Bolin Ding

End-to-end text image translation (TIT), which aims at translating the source language embedded in images to the target language, has attracted intensive attention in recent research. However, data sparsity limits the performance of…

Computation and Language · Computer Science 2022-10-11 Cong Ma , Yaping Zhang , Mei Tu , Xu Han , Linghui Wu , Yang Zhao , Yu Zhou

Learning target side syntactic structure has been shown to improve Neural Machine Translation (NMT). However, incorporating syntax through latent variables introduces additional complexity in inference, as the models need to marginalize…

Artificial Intelligence · Computer Science 2019-09-02 Xuewen Yang , Yingru Liu , Dongliang Xie , Xin Wang , Niranjan Balasubramanian

Speech enhancement models should meet very low latency requirements typically smaller than 5 ms for hearing assistive devices. While various low-latency techniques have been proposed, comparing these methods in a controlled setup using DNNs…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Haibin Wu , Sebastian Braun

Alignment with human preferences is an important step in developing accurate and safe large language models. This is no exception in machine translation (MT), where better handling of language nuances and context-specific variations leads…

With the increased audiovisualisation of communication, the need for live subtitles in multilingual events is more relevant than ever. In an attempt to automatise the process, we aim at exploring the feasibility of simultaneous speech…

Computation and Language · Computer Science 2023-10-19 Alina Karakanta , Sara Papi , Matteo Negri , Marco Turchi

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

Computation and Language · Computer Science 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way

Recent studies have shown that dual encoder models trained with the sentence-level translation ranking task are effective methods for cross-lingual sentence embedding. However, our research indicates that token-level alignment is also…

Computation and Language · Computer Science 2023-05-17 Ziheng Li , Shaohan Huang , Zihan Zhang , Zhi-Hong Deng , Qiang Lou , Haizhen Huang , Jian Jiao , Furu Wei , Weiwei Deng , Qi Zhang

The rapid development of large pretrained language models has revolutionized not only the field of Natural Language Generation (NLG) but also its evaluation. Inspired by the recent work of BARTScore: a metric leveraging the BART language…

Computation and Language · Computer Science 2022-10-14 Moussa Kamal Eddine , Guokan Shang , Michalis Vazirgiannis

Large language models (LLMs) are typically developed through large-scale pre-training followed by task-specific fine-tuning. Recent advances highlight the importance of an intermediate mid-training stage, where models undergo multiple…

Computation and Language · Computer Science 2025-10-09 Kaixiang Mo , Yuxin Shi , Weiwei Weng , Zhiqiang Zhou , Shuman Liu , Haibo Zhang , Anxiang Zeng

While modern Transformer-based language models (LMs) have achieved major success in multi-task generalization, they often struggle to capture long-range dependencies within their context window. This work introduces a novel approach using…

Computation and Language · Computer Science 2025-09-23 Alok N. Shah , Khush Gupta , Keshav Ramji , Pratik Chaudhari

Simultaneous Interpretation (SI) represents one of the most daunting frontiers in the translation industry, with product-level automatic systems long plagued by intractable challenges: subpar transcription and translation quality, lack of…

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

Computation and Language · Computer Science 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

As research on machine translation moves to translating text beyond the sentence level, it remains unclear how effective automatic evaluation metrics are at scoring longer translations. In this work, we first propose a method for creating…

Computation and Language · Computer Science 2023-08-29 Daniel Deutsch , Juraj Juraska , Mara Finkelstein , Markus Freitag

Modern machine translation (MT) systems depend on large parallel corpora, often collected from the Internet. However, recent evidence indicates that (i) a substantial portion of these texts are machine-generated translations, and (ii) an…

Computation and Language · Computer Science 2025-11-06 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez

Recent advancements in text-to-speech (TTS) systems, such as FastSpeech and StyleSpeech, have significantly improved speech generation quality. However, these models often rely on duration generated by external tools like the Montreal…

Sound · Computer Science 2024-12-12 Haowei Lou , Helen Paik , Wen Hu , Lina Yao