中文
相关论文

相关论文: Hindsight Quality Prediction Experiments in Multi-…

200 篇论文

Human-translated text displays distinct features from naturally written text in the same language. This phenomena, known as translationese, has been argued to confound the machine translation (MT) evaluation. Yet, we find that existing work…

计算与语言 · 计算机科学 2022-06-10 Jingwei Ni , Zhijing Jin , Markus Freitag , Mrinmaya Sachan , Bernhard Schölkopf

Despite the recent success of automatic metrics for assessing translation quality, their application in evaluating the quality of machine-translated chats has been limited. Unlike more structured texts like news, chat conversations are…

计算与语言 · 计算机科学 2024-03-14 Sweta Agrawal , Amin Farajian , Patrick Fernandes , Ricardo Rei , André F. T. Martins

Reinforcement learning has shown great promise in aligning language models with human preferences in a variety of text generation tasks, including machine translation. For translation tasks, rewards can easily be obtained from quality…

计算与语言 · 计算机科学 2024-10-15 Gahyun Yoo , Jay Yoon Lee

The landscape of extremely low-resource machine translation (MT) is characterized by perplexing variability in reported performance, often making results across different language pairs difficult to contextualize. For researchers focused on…

计算与语言 · 计算机科学 2026-03-27 Danlu Chen , Ka Sing He , Jiahe Tian , Chenghao Xiao , Zhaofeng Wu , Taylor Berg-Kirkpatrick , Freda Shi

Transformer architectures are increasingly effective at processing and generating very long chunks of texts, opening new perspectives for document-level machine translation (MT). In this work, we challenge the ability of MT systems to…

计算与语言 · 计算机科学 2025-04-29 Ziqian Peng , Rachel Bawden , François Yvon

Evaluating AI-generated research ideas typically relies on LLM judges or human panels -- both subjective and disconnected from actual research impact. We introduce HindSight, a time-split evaluation framework that measures idea quality by…

计算与语言 · 计算机科学 2026-03-18 Bo Jiang

Translating culture-related content is vital for effective cross-cultural communication. However, many culture-specific items (CSIs) often lack viable translations across languages, making it challenging to collect high-quality, diverse…

计算与语言 · 计算机科学 2024-10-22 Binwei Yao , Ming Jiang , Tara Bobinac , Diyi Yang , Junjie Hu

Traditionally, success in multilingual machine translation can be attributed to three key factors in training data: large volume, diverse translation directions, and high quality. In the current practice of fine-tuning large language models…

计算与语言 · 计算机科学 2024-10-07 Dawei Zhu , Pinzhen Chen , Miaoran Zhang , Barry Haddow , Xiaoyu Shen , Dietrich Klakow

Large language models (LLMs) have recently transformed both the academic and industrial landscapes due to their remarkable capacity to understand, analyze, and generate texts based on their vast knowledge and reasoning ability.…

计算与语言 · 计算机科学 2024-09-23 Song Wang , Yaochen Zhu , Haochen Liu , Zaiyi Zheng , Chen Chen , Jundong Li

Modern machine translation (MT) systems depend on large parallel corpora, often collected from the Internet. However, recent evidence indicates that (i) a substantial portion of these texts are machine-generated translations, and (ii) an…

计算与语言 · 计算机科学 2025-11-06 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez

Large reasoning models (LRMs) have led to new possibilities in terms of problem-solving, through the devising of a natural language thought process prior to answering a query. While their capabilities are well known across mathematics and…

计算与语言 · 计算机科学 2025-10-15 Armel Zebaze , Rachel Bawden , Benoît Sagot

Trainable evaluation metrics for machine translation (MT) exhibit strong correlation with human judgements, but they are often hard to interpret and might produce unreliable scores under noisy or out-of-domain data. Recent work has…

计算与语言 · 计算机科学 2022-12-01 Chrysoula Zerva , Taisiya Glushkova , Ricardo Rei , André F. T. Martins

Despite achieving remarkable performance, machine translation (MT) research remains underexplored in terms of translating cultural elements in languages, such as idioms, proverbs, and colloquial expressions. This paper investigates the…

计算与语言 · 计算机科学 2025-01-22 Minghan Wang , Viet-Thanh Pham , Farhad Moghimifar , Thuy-Trang Vu

This paper introduces a novel framework that leverages large language models (LLMs) for machine translation (MT). We start with one conjecture: an ideal translation should contain complete and accurate information for a strong enough LLM to…

计算与语言 · 计算机科学 2024-11-06 Jianqiao Wangni

Devising metrics to assess translation quality has always been at the core of machine translation (MT) research. Traditional automatic reference-based metrics, such as BLEU, have shown correlations with human judgements of adequacy and…

计算与语言 · 计算机科学 2019-10-15 Carolina Scarton , Mikel L. Forcada , Miquel Esplà-Gomis , Lucia Specia

Being able to rank the similarity of short text segments is an interesting bonus feature of neural machine translation. Translation-based similarity measures include direct and pivot translation probability, as well as translation…

计算与语言 · 计算机科学 2022-10-20 Jannis Vamvas , Rico Sennrich

Large language models (LLMs) have shown promising performance across various tasks. However, their autoregressive decoding process poses significant challenges for efficient deployment on existing AI hardware. Quantization alleviates memory…

机器学习 · 计算机科学 2025-12-01 Guanxi Lu , Hao Mark Chen , Zhiqiang Que , Wayne Luk , Hongxiang Fan

Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without relying on any reference. Recently, the predictor-estimator framework trains the predictor as a feature extractor, which…

计算与语言 · 计算机科学 2021-05-18 Qu Cui , Shujian Huang , Jiahuan Li , Xiang Geng , Zaixiang Zheng , Guoping Huang , Jiajun Chen

Learned metrics such as BLEURT have in recent years become widely employed to evaluate the quality of machine translation systems. Training such metrics requires data which can be expensive and difficult to acquire, particularly for…

计算与语言 · 计算机科学 2023-02-08 Amirkeivan Mohtashami , Mauro Verzetti , Paul K. Rubenstein

Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with…

计算与语言 · 计算机科学 2025-06-10 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal