English
Related papers

Related papers: Correct-and-Memorize: Learning to Translate from I…

200 papers

Recent work has shown exciting promise in updating large language models with new memories, so as to replace obsolete information or add specialized knowledge. However, this line of work is predominantly limited to updating single…

Computation and Language · Computer Science 2023-08-03 Kevin Meng , Arnab Sen Sharma , Alex Andonian , Yonatan Belinkov , David Bau

Large Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However,…

Computation and Language · Computer Science 2024-12-11 Dongfang Li , Zetian Sun , Xinshuo Hu , Baotian Hu , Min Zhang

Simultaneous machine translation, which aims at a real-time translation, is useful in many live scenarios but very challenging due to the trade-off between accuracy and latency. To achieve the balance for both, the model needs to wait for…

Computation and Language · Computer Science 2023-03-22 Lei Lin , Shuangtao Li , Xiaodong Shi

Existing neural machine translation (NMT) models generally translate sentences in isolation, missing the opportunity to take advantage of document-level information. In this work, we propose to augment NMT models with a very light-weight…

Computation and Language · Computer Science 2017-11-28 Zhaopeng Tu , Yang Liu , Shuming Shi , Tong Zhang

Translating in real-time, a.k.a. simultaneous translation, outputs translation words before the input sentence ends, which is a challenging problem for conventional machine translation methods. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2017-01-12 Jiatao Gu , Graham Neubig , Kyunghyun Cho , Victor O. K. Li

This paper addresses the problem of simultaneous machine translation (SiMT) by exploring two main concepts: (a) adaptive policies to learn a good trade-off between high translation quality and low latency; and (b) visual information to…

Computation and Language · Computer Science 2021-02-24 Julia Ive , Andy Mingren Li , Yishu Miao , Ozan Caglayan , Pranava Madhyastha , Lucia Specia

We present an approach to interactive-predictive neural machine translation that attempts to reduce human effort from three directions: Firstly, instead of requiring humans to select, correct, or delete segments, we employ the idea of…

Computation and Language · Computer Science 2018-06-07 Tsz Kin Lam , Julia Kreutzer , Stefan Riezler

Retrieval-Augmented Neural Machine Translation (RAMT) architectures retrieve examples from memory to guide the generation process. While most works in this trend explore new ways to exploit the retrieved examples, the upstream retrieval…

Computation and Language · Computer Science 2024-04-04 Maxime Bouthors , Josep Crego , Francois Yvon

Machine translation (MT) post-editing and research data collection often rely on inefficient, disconnected workflows. We introduce TranslationCorrect, an integrated framework designed to streamline these tasks. TranslationCorrect combines…

Computation and Language · Computer Science 2025-06-24 Syed Mekael Wasti , Shou-Yi Hung , Christopher Collins , En-Shiun Annie Lee

Simultaneous machine translation (SiMT) starts its translation before reading the whole source sentence and employs either fixed or adaptive policy to generate the target sentence. Compared to the fixed policy, the adaptive policy achieves…

Computation and Language · Computer Science 2022-10-24 Shoutao Guo , Shaolei Zhang , Yang Feng

As world knowledge advances and new task schemas emerge, Continual Learning (CL) becomes essential for keeping Large Language Models (LLMs) current and addressing their shortcomings. This process typically involves continual instruction…

Machine Learning · Computer Science 2024-12-17 Haokun Zhao , Haixia Han , Jie Shi , Chengyu Du , Jiaqing Liang , Yanghua Xiao

Simultaneous machine translation (SiMT) generates translation while reading the whole source sentence. However, existing SiMT models are typically trained using the same reference disregarding the varying amounts of available source…

Computation and Language · Computer Science 2023-10-27 Shoutao Guo , Shaolei Zhang , Yang Feng

Imposing constraints on machine translation systems presents a challenging issue because these systems are not trained to make use of constraints in generating adequate, fluent translations. In this paper, we leverage the capabilities of…

Computation and Language · Computer Science 2024-07-19 Pengcheng Huang , Yongyu Mu , Yuzhang Wu , Bei Li , Chunyang Xiao , Tong Xiao , Jingbo Zhu

Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of…

Computation and Language · Computer Science 2022-10-20 Yu Wan , Baosong Yang , Derek F. Wong , Yikai Zhou , Lidia S. Chao , Haibo Zhang , Boxing Chen

Human evaluation of machine translation is in an arms race with translation model quality: as our models get better, our evaluation methods need to be improved to ensure that quality gains are not lost in evaluation noise. To this end, we…

Computation and Language · Computer Science 2025-10-29 Parker Riley , Daniel Deutsch , Mara Finkelstein , Colten DiIanni , Juraj Juraska , Markus Freitag

There are common semantics shared across text and images. Given a sentence in a source language, whether depicting the visual scene helps translation into a target language? Existing multimodal neural machine translation methods (MNMT)…

Computation and Language · Computer Science 2021-04-14 Quanyu Long , Mingxuan Wang , Lei Li

While recent advances in deep learning led to significant improvements in machine translation, neural machine translation is often still not able to continuously adapt to the environment. For humans, as well as for machine translation,…

Computation and Language · Computer Science 2021-02-15 Jan Niehues

A neural multimodal machine translation (MMT) system is one that aims to perform better translation by extending conventional text-only translation models with multimodal information. Many recent studies report improvements when equipping…

Computation and Language · Computer Science 2021-06-01 Zhiyong Wu , Lingpeng Kong , Wei Bi , Xiang Li , Ben Kao

Large language models (LLMs) and multimodal models (MMs) have exhibited impressive capabilities in various domains, particularly in general language understanding and visual reasoning. However, these models, trained on massive data, may not…

Computation and Language · Computer Science 2024-12-19 Xinbo Wu , Max Hartman , Vidhata Arjun Jayaraman , Lav R. Varshney