English
Related papers

Related papers: SiLLM: Large Language Models for Simultaneous Mach…

200 papers

Large language models (LLMs) have significantly advanced various natural language processing (NLP) tasks. Recent research indicates that moderately-sized LLMs often outperform larger ones after task-specific fine-tuning. This study focuses…

Computation and Language · Computer Science 2024-10-14 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , George Foster , Gholamreza Haffari

Simultaneous speech-to-text translation (Simul-S2TT) aims to translate speech into target text in real time, outputting translations while receiving source speech input, rather than waiting for the entire utterance to be spoken. Simul-S2TT…

Sound · Computer Science 2026-05-06 Pei Zhang , Yiming Wang , Jialong Tang , Baosong Yang , Rui Wang , Derek F. Wong , Fei Huang

Large Language Models (LLMs) have demonstrated impressive performance on a wide range of natural language processing (NLP) tasks, primarily through in-context learning (ICL). In ICL, the LLM is provided with examples that represent a given…

Computation and Language · Computer Science 2025-02-19 Abdellah El Mekki , Muhammad Abdul-Mageed

We propose the on-the-fly ensembling of a machine translation model with an LLM, prompted on the same task and input. We perform experiments on 4 language pairs (both directions) with varying data amounts. We find that a slightly…

Computation and Language · Computer Science 2024-05-07 Hieu Hoang , Huda Khayrallah , Marcin Junczys-Dowmunt

Large language models (LLMs) that have been trained on multilingual but not parallel text exhibit a remarkable ability to translate between languages. We probe this ability in an in-depth study of the pathways language model (PaLM), which…

Computation and Language · Computer Science 2023-06-27 David Vilar , Markus Freitag , Colin Cherry , Jiaming Luo , Viresh Ratnakar , George Foster

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

Computation and Language · Computer Science 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Resolving semantic ambiguity has long been recognised as a central challenge in the field of Machine Translation. Recent work on benchmarking translation performance on ambiguous sentences has exposed the limitations of conventional Neural…

Computation and Language · Computer Science 2023-10-24 Vivek Iyer , Pinzhen Chen , Alexandra Birch

Simultaneous speech translation (SST) outputs translations in parallel with streaming speech input, balancing translation quality and latency. While large language models (LLMs) have been extended to handle the speech modality, streaming…

Computation and Language · Computer Science 2025-04-23 Keqi Deng , Wenxi Chen , Xie Chen , Philip C. Woodland

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

Large Language Models (LLMs) have revolutionised the field of Natural Language Processing (NLP) and have achieved state-of-the-art performance in practically every task in this field. However, the prevalent approach used in text generation,…

Computation and Language · Computer Science 2024-08-12 Nicolo Micheletti , Samuel Belkadi , Lifeng Han , Goran Nenadic

The ability of transformers to perform precision tasks such as question answering, Natural Language Inference (NLI) or summarising, have enabled them to be ranked as one of the best paradigm to address Natural Language Processing (NLP)…

Computation and Language · Computer Science 2021-05-18 Javier Huertas-Tato , Alejandro Martín , David Camacho

Simultaneous machine translation (SiMT) outputs translation while receiving the streaming source inputs, and hence needs a policy to determine where to start translating. The alignment between target and source words often implies the most…

Computation and Language · Computer Science 2022-03-18 Shaolei Zhang , Yang Feng

Large language models (LLMs) have demonstrated impressive capabilities in general scenarios, exhibiting a level of aptitude that approaches, in some aspects even surpasses, human-level intelligence. Among their numerous skills, the…

Computation and Language · Computer Science 2023-11-30 Zhiwei He , Tian Liang , Wenxiang Jiao , Zhuosheng Zhang , Yujiu Yang , Rui Wang , Zhaopeng Tu , Shuming Shi , Xing Wang

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

Computation and Language · Computer Science 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

Agents built on large language models (LLMs) have excelled in turn-by-turn human-AI collaboration but struggle with simultaneous tasks requiring real-time interaction. Latency issues and the challenge of inferring variable human strategies…

Artificial Intelligence · Computer Science 2025-05-29 Shao Zhang , Xihuai Wang , Wenhao Zhang , Chaoran Li , Junru Song , Tingyu Li , Lin Qiu , Xuezhi Cao , Xunliang Cai , Wen Yao , Weinan Zhang , Xinbing Wang , Ying Wen

Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model. Traditional methods rely on either a fixed wait-$k$ policy coupled with a standalone wait-$k$ translation…

Computation and Language · Computer Science 2023-10-24 Libo Zhao , Kai Fan , Wei Luo , Jing Wu , Shushu Wang , Ziqian Zeng , Zhongqiang Huang

Simultaneous machine translation (SimulMT) speeds up the translation process by starting to translate before the source sentence is completely available. It is difficult due to limited context and word order difference between languages.…

Computation and Language · Computer Science 2022-05-05 Chih-Chiang Chang , Shun-Po Chuang , Hung-yi Lee

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Simultaneous translation (ST) outputs translation while receiving the source inputs, and hence requires a policy to determine whether to translate a target token or wait for the next source token. The major challenge of ST is that each…

Computation and Language · Computer Science 2022-11-02 Shaolei Zhang , Yang Feng