English
Related papers

Related papers: UniTE: Unified Translation Evaluation

200 papers

It is expensive to evaluate the results of Machine Translation(MT), which usually requires manual translation as a reference. Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without…

Computation and Language · Computer Science 2022-04-19 Lei Lin

Neural machine translation (NMT) is often criticized for failures that happen without awareness. The lack of competency awareness makes NMT untrustworthy. This is in sharp contrast to human translators who give feedback or conduct further…

Computation and Language · Computer Science 2022-11-28 Pei Zhang , Baosong Yang , Haoran Wei , Dayiheng Liu , Kai Fan , Luo Si , Jun Xie

The use of large language models (LLMs) for evaluating outputs is becoming an increasingly effective and scalable approach. However, it remains uncertain whether this capability extends beyond task-specific evaluations to more general…

Computation and Language · Computer Science 2025-11-13 Rhitabrat Pokharel , Ameeta Agrawal

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

The capability to jointly process multi-modal information is becoming an essential task. However, the limited number of paired multi-modal data and the large computational requirements in multi-modal learning hinder the development. We…

Computation and Language · Computer Science 2025-06-09 Minsu Kim , Jee-weon Jung , Hyeongseop Rha , Soumi Maiti , Siddhant Arora , Xuankai Chang , Shinji Watanabe , Yong Man Ro

Machine translation (MT) plays an important role in benefiting linguists, sociologists, computer scientists, etc. by processing natural language to translate it into some other natural language. And this demand has grown exponentially over…

Computation and Language · Computer Science 2019-01-07 Ankush Garg , Mayank Agarwal

Simultaneous neural machine translation(SNMT) models start emitting the target sequence before they have processed the source sequence. The recent adaptive policies for SNMT use monotonic attention to perform read/write decisions based on…

Computation and Language · Computer Science 2021-09-08 Mohd Abbas Zaidi , Sathish Indurthi , Beomseok Lee , Nikhil Kumar Lakumarapu , Sangha Kim

Machine translation (MT) was developed as one of the hottest research topics in the natural language processing (NLP) literature. One important issue in MT is that how to evaluate the MT system reasonably and tell us whether the translation…

Computation and Language · Computer Science 2022-01-25 Lifeng Han

Machine Translation (MT) has developed rapidly since the release of Large Language Models and current MT evaluation is performed through comparison with reference human translations or by predicting quality scores from human-labeled data.…

Computation and Language · Computer Science 2024-11-11 Shun Wang , Ge Zhang , Han Wu , Tyler Loakman , Wenhao Huang , Chenghua Lin

Despite the recent remarkable advances in neural machine translation, translation quality for low-resource language pairs remains subpar. Ensembling multiple systems is a widely adopted technique to enhance performance, often accomplished…

Computation and Language · Computer Science 2026-03-10 Seokjin Oh , Keonwoong Noh , Woohwan Jung

Word-level quality estimation (WQE) aims to automatically identify fine-grained error spans in machine-translated outputs and has found many uses, including assisting translators during post-editing. Modern WQE techniques are often…

Computation and Language · Computer Science 2025-11-18 Gabriele Sarti , Vilém Zouhar , Malvina Nissim , Arianna Bisazza

Translation Quality Evaluation (TQE) is an essential step of the modern translation production process. TQE is critical in assessing both machine translation (MT) and human translation (HT) quality without reference translations. The…

Computation and Language · Computer Science 2024-06-24 Serge Gladkoff , Lifeng Han , Gleb Erofeev , Irina Sorokina , Goran Nenadic

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

Computation and Language · Computer Science 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. Previous MMT systems mainly focus on better access and use of visual information and tend to…

Computation and Language · Computer Science 2023-09-06 Yaoming Zhu , Zewei Sun , Shanbo Cheng , Luyang Huang , Liwei Wu , Mingxuan Wang

With the fast development of Machine Translation (MT) systems, especially the new boost from Neural MT (NMT) models, the MT output quality has reached a new level of accuracy. However, many researchers criticised that the current popular…

Computation and Language · Computer Science 2022-11-11 Lifeng Han

Task embedding, a meta-learning technique that captures task-specific information, has gained popularity, especially in areas such as multi-task learning, model editing, and interpretability. However, it faces challenges with the emergence…

Computation and Language · Computer Science 2024-07-15 Xinyu Wang , Hainiu Xu , Lin Gui , Yulan He

Traditional automatic evaluation metrics for machine translation have been widely criticized by linguists due to their low accuracy, lack of transparency, focus on language mechanics rather than semantics, and low agreement with human…

Computation and Language · Computer Science 2021-12-28 Serge Gladkoff , Lifeng Han

Significant advancements has recently been achieved in the field of multi-modal large language models (MLLMs), demonstrating their remarkable capabilities in understanding and reasoning across diverse tasks. However, these models are often…

Computation and Language · Computer Science 2024-08-06 Zhaowei Li , Wei Wang , YiQing Cai , Xu Qi , Pengyu Wang , Dong Zhang , Hang Song , Botian Jiang , Zhida Huang , Tao Wang

To facilitate effective translation modeling and translation studies, one of the crucial questions to address is how to assess translation quality. From the perspectives of accuracy, reliability, repeatability and cost, translation quality…

Computation and Language · Computer Science 2021-05-10 Lifeng Han , Gareth J. F. Jones , Alan F. Smeaton

Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text sentences while with only…

Computation and Language · Computer Science 2020-12-04 Haipeng Sun , Rui Wang , Kehai Chen , Xugang Lu , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao