English
Related papers

Related papers: Improving Machine Translation with Large Language …

200 papers

To achieve generalized and robust natural-to-formal language conversion (N2F), large language models (LLMs) need to have strong capabilities of decomposition and composition in N2F when faced with an unfamiliar formal language and be able…

Computation and Language · Computer Science 2025-02-24 Ziyao Xu , Houfeng Wang

Large Language Models (LLMs) have revolutionized natural language processing by understanding and generating human-like text. However, the increasing demand for more sophisticated LLMs presents significant computational challenges due to…

Computation and Language · Computer Science 2025-01-14 Ze Yang , Yihong Jin , Xinhe Xu

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

Natural language understanding and generation models follow one of the two dominant architectural paradigms: language models (LMs) that process concatenated sequences in a single stack of layers, and encoder-decoder models (EncDec) that…

Computation and Language · Computer Science 2022-02-17 Biao Zhang , Behrooz Ghorbani , Ankur Bapna , Yong Cheng , Xavier Garcia , Jonathan Shen , Orhan Firat

This paper introduces a novel framework that leverages large language models (LLMs) for machine translation (MT). We start with one conjecture: an ideal translation should contain complete and accurate information for a strong enough LLM to…

Computation and Language · Computer Science 2024-11-06 Jianqiao Wangni

Leveraging large language models for machine translation has demonstrated promising results. However, it does require the large language models to possess the capability of handling both the source and target languages in machine…

Computation and Language · Computer Science 2024-10-18 Chengpeng Fu , Xiaocheng Feng , Yichong Huang , Wenshuai Huo , Baohang Li , Hui Wang , Bin Qin , Ting Liu

Recent evidence reveals that Neural Machine Translation (NMT) models with deeper neural networks can be more effective but are difficult to train. In this paper, we present a MultiScale Collaborative (MSC) framework to ease the training of…

Computation and Language · Computer Science 2020-05-12 Xiangpeng Wei , Heng Yu , Yue Hu , Yue Zhang , Rongxiang Weng , Weihua Luo

At present, Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory. Cooperative driving leverages the connectivity…

Robotics · Computer Science 2025-09-22 Shiyu Fang , Jiaqi Liu , Mingyu Ding , Yiming Cui , Chen Lv , Peng Hang , Jian Sun

Studies show that large language models (LLMs) produce buggy code translations. One promising avenue to improve translation accuracy is through intermediate representations, which provide structured guidance for the translation process. We…

Software Engineering · Computer Science 2025-09-18 Chi-en Amy Tai , Pengyu Nie , Lukasz Golab , Alexander Wong

We propose the on-the-fly ensembling of a machine translation model with an LLM, prompted on the same task and input. We perform experiments on 4 language pairs (both directions) with varying data amounts. We find that a slightly…

Computation and Language · Computer Science 2024-05-07 Hieu Hoang , Huda Khayrallah , Marcin Junczys-Dowmunt

Large Language Models (LLMs) have become extremely potent instruments with exceptional capacities for comprehending and producing human-like text in a wide range of applications. However, the increasing size and complexity of LLMs present…

Machine Learning · Computer Science 2024-06-18 Yingbing Huang , Lily Jiaxin Wan , Hanchen Ye , Manvi Jha , Jinghua Wang , Yuhong Li , Xiaofan Zhang , Deming Chen

Pre-trained language models based on masked language modeling (MLM) excel in natural language understanding (NLU) tasks. While fine-tuned MLM-based encoders consistently outperform causal language modeling decoders of comparable size,…

Computation and Language · Computer Science 2024-06-07 David Dukić , Jan Šnajder

Combinatorial optimization (CO) problems, central to decision-making scenarios like logistics and manufacturing, are traditionally solved using problem-specific algorithms requiring significant domain expertise. While large language models…

Artificial Intelligence · Computer Science 2025-09-24 Xia Jiang , Yaoxin Wu , Minshuo Li , Zhiguang Cao , Yingqian Zhang

Model-Driven Engineering (MDE) has seen significant advancements with the integration of Machine Learning (ML) and Deep Learning (DL) techniques. Building upon the groundwork of previous investigations, our study provides a concise overview…

Software Engineering · Computer Science 2024-10-24 Juri Di Rocco , Davide Di Ruscio , Claudio Di Sipio , Phuong T. Nguyen , Riccardo Rubei

When the complete source sentence is provided, Large Language Models (LLMs) perform excellently in offline machine translation even with a simple prompt "Translate the following sentence from [src lang] into [tgt lang]:". However, in many…

Computation and Language · Computer Science 2025-05-30 Biao Fu , Minpeng Liao , Kai Fan , Chengxi Li , Liang Zhang , Yidong Chen , Xiaodong Shi

Recent advancements in Large Language Models (LLMs) have attracted considerable interest among researchers to leverage these models to enhance Recommender Systems (RSs). Existing work predominantly utilizes LLMs to generate knowledge-rich…

Information Retrieval · Computer Science 2024-07-25 Zhongxiang Sun , Zihua Si , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu

Code translation is a crucial activity in the software development and maintenance process, and researchers have recently begun to focus on using pre-trained large language models (LLMs) for code translation. However, existing LLMs only…

Software Engineering · Computer Science 2025-09-30 Minghua He , Yue Chen , Fangkai Yang , Pu Zhao , Wenjie Yin , Yu Kang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

Large reasoning models (LRMs) have led to new possibilities in terms of problem-solving, through the devising of a natural language thought process prior to answering a query. While their capabilities are well known across mathematics and…

Computation and Language · Computer Science 2025-10-15 Armel Zebaze , Rachel Bawden , Benoît Sagot

The advent of large language models (LLMs) has marked a significant milestone in the realm of artificial intelligence, with their capabilities often matching or surpassing human expertise in various domains. Among these achievements, their…

Software Engineering · Computer Science 2024-07-12 Rabimba Karanjai , Lei Xu , Weidong Shi

This paper investigates how Large Language Models (LLMs) represent non-English tokens -- a question that remains underexplored despite recent progress. We propose a lightweight intervention method using representation steering, where a…

Computation and Language · Computer Science 2025-08-27 Omar Mahmoud , Buddhika Laknath Semage , Thommen George Karimpanal , Santu Rana