English
Related papers

Related papers: Understanding In-Context Machine Translation for L…

200 papers

Recently, Large Language Models (LLMs) have shown impressive language capabilities. While most of the existing LLMs have very unbalanced performance across different languages, multilingual alignment based on translation parallel data is an…

Computation and Language · Computer Science 2024-06-19 Shimao Zhang , Changjiang Gao , Wenhao Zhu , Jiajun Chen , Xin Huang , Xue Han , Junlan Feng , Chao Deng , Shujian Huang

Prior works have demonstrated that a low-resource language pair can benefit from multilingual machine translation (MT) systems, which rely on many language pairs' joint training. This paper proposes two simple strategies to address the rare…

Computation and Language · Computer Science 2021-07-13 Thi-Vinh Ngo , Phuong-Thai Nguyen , Thanh-Le Ha , Khac-Quy Dinh , Le-Minh Nguyen

This paper introduces an advanced methodology for machine translation (MT) corpus generation, integrating semi-automated, human-in-the-loop post-editing with large language models (LLMs) to enhance efficiency and translation quality.…

Computation and Language · Computer Science 2025-02-19 Kamer Ali Yuksel , Ahmet Gunduz , Abdul Baseet Anees , Hassan Sawaf

Machine Translation (MT) plays a pivotal role in cross-lingual information access, public policy communication, and equitable knowledge dissemination. However, critical meaning errors, such as factual distortions, intent reversals, or…

Computation and Language · Computer Science 2026-02-13 Muskaan Chopra , Lorenz Sparrenberg , Rafet Sifa

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Large language models (LLMs) possess a remarkable ability to perform in-context learning (ICL), which enables them to handle multiple downstream tasks simultaneously without requiring task-specific fine-tuning. Recent studies have shown…

Computation and Language · Computer Science 2026-03-04 Wenchong He , Liqian Peng , Zhe Jiang , Alex Go

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

Sentence-level (SL) machine translation (MT) has reached acceptable quality for many high-resourced languages, but not document-level (DL) MT, which is difficult to 1) train with little amount of DL data; and 2) evaluate, as the main…

Computation and Language · Computer Science 2020-12-14 Matīss Rikters , Ryokan Ri , Tong Li , Toshiaki Nakazawa

This paper presents a study on strategies to enhance the translation capabilities of large language models (LLMs) in the context of machine translation (MT) tasks. The paper proposes a novel paradigm consisting of three stages: Secondary…

Computation and Language · Computer Science 2024-04-16 Jiaxin Guo , Hao Yang , Zongyao Li , Daimeng Wei , Hengchao Shang , Xiaoyu Chen

Achieving universal translation between all human language pairs is the holy-grail of machine translation (MT) research. While recent progress in massively multilingual MT is one step closer to reaching this goal, it is becoming evident…

Computation and Language · Computer Science 2022-01-14 Aditya Siddhant , Ankur Bapna , Orhan Firat , Yuan Cao , Mia Xu Chen , Isaac Caswell , Xavier Garcia

Machine translation in low-resource language pairs faces significant challenges due to the scarcity of parallel corpora and linguistic resources. This study focuses on the case of English-Marathi language pairs, where existing datasets are…

Computation and Language · Computer Science 2024-09-05 Nidhi Kowtal , Tejas Deshpande , Raviraj Joshi

In AI research, the optimization of Large Language Models (LLMs) remains a significant challenge, crucial for advancing the field's practical applications and sustainability. Building upon the foundational work of Professor Song Han's lab…

Computation and Language · Computer Science 2023-12-21 Tim Valicenti , Justice Vidal , Ritik Patnaik

Currently, multilingual machine translation is receiving more and more attention since it brings better performance for low resource languages (LRLs) and saves more space. However, existing multilingual machine translation models face a…

Computation and Language · Computer Science 2021-09-10 Mingliang Zhang , Fandong Meng , Yunhai Tong , Jie Zhou

In-context learning (ICL) is an important yet not fully understood ability of pre-trained large language models (LLMs). It can greatly enhance task performance using a few examples, termed demonstrations, without fine-tuning. Although…

Computation and Language · Computer Science 2025-06-03 Do Xuan Long , Duong Ngoc Yen , Do Xuan Trong , Luu Anh Tuan , Kenji Kawaguchi , Shafiq Joty , Min-Yen Kan , Nancy F. Chen

Recent Large Language Models (LLMs) have demonstrated impressive translation performance without requiring fine-tuning on additional parallel corpora. However, they still face significant challenges in certain scenarios, particularly when…

Computation and Language · Computer Science 2025-06-03 Seung-Woo Choi , Ga-Hyun Yoo , Jay-Yoon Lee

Neural approaches have achieved state-of-the-art accuracy on machine translation but suffer from the high cost of collecting large scale parallel data. Thus, a lot of research has been conducted for neural machine translation (NMT) with…

Computation and Language · Computer Science 2021-07-12 Rui Wang , Xu Tan , Renqian Luo , Tao Qin , Tie-Yan Liu

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

Low-resource machine translation (MT) has gained increasing attention as parallel data from low-resource language communities is collected, but many approaches for improving low-resource MT remain underexplored. We investigate a…

Computation and Language · Computer Science 2026-03-19 Ahmed Attia , Alham Fikri Aji

Multilingual large language models (MLLMs) are able to leverage in-context learning (ICL) to achieve high performance by leveraging cross-lingual knowledge transfer without parameter updates. However, their effectiveness is highly sensitive…

Computation and Language · Computer Science 2025-02-18 Masahiro Kaneko , Alham Fikri Aji , Timothy Baldwin

In Simultaneous Machine Translation (SiMT) systems, training with a simultaneous interpretation (SI) corpus is an effective method for achieving high-quality yet low-latency systems. However, it is very challenging to curate such a corpus…

Computation and Language · Computer Science 2024-04-19 Yusuke Sakai , Mana Makinae , Hidetaka Kamigaito , Taro Watanabe