中文
相关论文

相关论文: Evaluating the Translation Performance of Large La…

200 篇论文

Large Language Models (LLMs) have gained significant attention due to their high performance on a wide range of natural language tasks since the release of ChatGPT. The LLMs learn to understand and generate language by training billions of…

计算与语言 · 计算机科学 2024-08-29 Wazir Ali , Sampo Pyysalo

Large language models (LLMs) implicitly learn to perform a range of language tasks, including machine translation (MT). Previous studies explore aspects of LLMs' MT capabilities. However, there exist a wide variety of languages for which…

计算与语言 · 计算机科学 2023-09-15 Nathaniel R. Robinson , Perez Ogayo , David R. Mortensen , Graham Neubig

This study evaluates the machine translation (MT) quality of two state-of-the-art large language models (LLMs) against a tradition-al neural machine translation (NMT) system across four language pairs in the legal domain. It combines…

计算与语言 · 计算机科学 2024-02-13 Vicent Briva-Iglesias , Joao Lucas Cavalheiro Camargo , Gokhan Dogru

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. However, these advances have not been reflected in the translation task, especially those with moderate model sizes (i.e., 7B or 13B…

计算与语言 · 计算机科学 2024-02-07 Haoran Xu , Young Jin Kim , Amr Sharaf , Hany Hassan Awadalla

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

计算与语言 · 计算机科学 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

计算与语言 · 计算机科学 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

Large, pre-trained transformer-based language models such as BERT have drastically changed the Natural Language Processing (NLP) field. We present a survey of recent work that uses these large language models to solve NLP tasks via…

Large Language Models (LLMs) have demonstrated exceptional natural language understanding abilities and have excelled in a variety of natural language processing (NLP)tasks in recent years. Despite the fact that most LLMs are trained…

计算与语言 · 计算机科学 2023-10-25 Xiang Zhang , Senyu Li , Bradley Hauer , Ning Shi , Grzegorz Kondrak

Large Language Models (LLMs) excel in translation among other things, demonstrating competitive performance for many language pairs in zero- and few-shot settings. But unlike dedicated neural machine translation models, LLMs are not trained…

计算与语言 · 计算机科学 2025-12-16 Yuri Balashov

Generation capabilities and language coverage of multilingual large language models (mLLMs) are advancing rapidly. However, evaluation practices for generative abilities of mLLMs are still lacking comprehensiveness, scientific rigor, and…

计算与语言 · 计算机科学 2025-09-15 Julia Kreutzer , Eleftheria Briakou , Sweta Agrawal , Marzieh Fadaee , Kocmi Tom

Large language models (LLMs) with billions of parameters and pretrained on massive amounts of data are now capable of near or better than state-of-the-art performance in a variety of downstream natural language processing tasks. Neural…

计算与语言 · 计算机科学 2024-07-08 Victor Agostinelli , Max Wild , Matthew Raffel , Kazi Ahmed Asif Fuad , Lizhong Chen

Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). However, careful evaluations by human reveal that the translations produced by LLMs still contain multiple errors. Importantly, feeding back such…

计算与语言 · 计算机科学 2024-06-24 Zhaopeng Feng , Yan Zhang , Hao Li , Bei Wu , Jiayu Liao , Wenqiang Liu , Jun Lang , Yang Feng , Jian Wu , Zuozhu Liu

Large Language Models (LLMs), such as Generative Pre-trained Transformers (GPTs) are revolutionizing the generation of human-like text, producing contextually relevant and syntactically correct content. Despite challenges like biases and…

计算与语言 · 计算机科学 2025-08-04 Alper Yaman , Jannik Schwab , Christof Nitsche , Abhirup Sinha , Marco Huber

Previous work on document-level NMT usually focuses on limited contexts because of degraded performance on larger contexts. In this paper, we investigate on using large contexts with three main contributions: (1) Different from previous…

计算与语言 · 计算机科学 2019-11-11 Liangyou Li , Xin Jiang , Qun Liu

Large language models (LLMs) have achieved remarkable success in machine translation, demonstrating impressive performance across diverse languages. However, translationese, characterized by overly literal and unnatural translations,…

计算与语言 · 计算机科学 2025-03-07 Yafu Li , Ronghao Zhang , Zhilin Wang , Huajian Zhang , Leyang Cui , Yongjing Yin , Tong Xiao , Yue Zhang

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. In this work, our aim is to explore the multilingual capabilities of large language models by using machine translation as a task involving…

Large language models (LLMs) have demonstrated strong performance in general-purpose machine translation, but their effectiveness in complex, domain-sensitive translation tasks remains underexplored. Recent advancements in Large Reasoning…

计算与语言 · 计算机科学 2025-05-27 Yongshi Ye , Biao Fu , Chongxuan Huang , Yidong Chen , Xiaodong Shi

Large Language Models (LLMs) have demonstrated impressive performance on a wide range of natural language processing (NLP) tasks, primarily through in-context learning (ICL). In ICL, the LLM is provided with examples that represent a given…

计算与语言 · 计算机科学 2025-02-19 Abdellah El Mekki , Muhammad Abdul-Mageed

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

计算与语言 · 计算机科学 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Consistency is a key requirement of high-quality translation. It is especially important to adhere to pre-approved terminology and adapt to corrected translations in domain-specific projects. Machine translation (MT) has achieved…

计算与语言 · 计算机科学 2023-05-10 Yasmin Moslem , Rejwanul Haque , John D. Kelleher , Andy Way