English

Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach

Computation and Language 2024-11-14 v1

Abstract

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts remains challenging for LLMs. To address this issue, we propose a multi-step prompt chain that enhances translation faithfulness by prioritizing key terms crucial for semantic accuracy. Our method first identifies these keywords and retrieves their translations from a bilingual dictionary, integrating them into the LLM's context using Retrieval-Augmented Generation (RAG). We further mitigate potential output hallucinations caused by long prompts through an iterative self-checking mechanism, where the LLM refines its translations based on lexical and semantic constraints. Experiments using Llama and Qwen as base models on the FLORES-200 and WMT datasets demonstrate significant improvements over baselines, highlighting the effectiveness of our approach in enhancing translation faithfulness and robustness, particularly in low-resource scenarios.

Keywords

Cite

@article{arxiv.2411.08348,
  title  = {Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach},
  author = {Shangfeng Chen and Xiayang Shi and Pu Li and Yinlin Li and Jingjing Liu},
  journal= {arXiv preprint arXiv:2411.08348},
  year   = {2024}
}
R2 v1 2026-06-28T19:57:57.759Z