Computation and Language · Computer Science
Beyond BLEU: Training Neural Machine Translation with Semantic Similarity
John Wieting, Taylor Berg-Kirkpatrick, Kevin Gimpel, Graham Neubig
2019-09-17
Computation and Language · Computer Science
Machine Translation Evaluation using Bi-directional Entailment
Rakesh Khobragade, Heaven Patel, Anand Namdev, Anish Mishra +1
2019-11-05
Computation and Language · Computer Science
A Critical Study of Automatic Evaluation in Sign Language Translation
Shakib Yazdani, Yasser Hamidullah, Cristina España-Bonet, Eleftherios Avramidis +1
2025-11-17
Computation and Language · Computer Science
DEMETR: Diagnosing Evaluation Metrics for Translation
Marzena Karpinska, Nishant Raj, Katherine Thai, Yixiao Song +2
2022-10-26
Computation and Language · Computer Science
On The Evaluation of Machine Translation Systems Trained With Back-Translation
Sergey Edunov, Myle Ott, Marc'Aurelio Ranzato, Michael Auli
2020-08-19
Computation and Language · Computer Science
Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task
Thibault Sellam, Amy Pu, Hyung Won Chung, Sebastian Gehrmann +4
2020-10-21
Computation and Language · Computer Science
Decoding and Diversity in Machine Translation
Nicholas Roberts, Davis Liang, Graham Neubig, Zachary C. Lipton
2020-11-30
Software Engineering · Computer Science
Does BLEU Score Work for Code Migration?
Ngoc Tran, Hieu Tran, Son Nguyen, Hoan Nguyen +1
2019-06-13
Computation and Language · Computer Science
It's Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information
Emanuele Bugliarello, Sabrina J. Mielke, Antonios Anastasopoulos, Ryan Cotterell +1
2020-05-19
Computation and Language · Computer Science
Neural and Statistical Methods for Leveraging Meta-information in Machine Translation
Shahram Khadivi, Patrick Wilken, Leonard Dahlmann, Evgeny Matusov
2017-08-11
Computation and Language · Computer Science
It is Not as Good as You Think! Evaluating Simultaneous Machine Translation on Interpretation Data
Jinming Zhao, Philip Arthur, Gholamreza Haffari, Trevor Cohn +1
2021-10-12
Programming Languages · Computer Science
Beyond BLEU: A Semantic Evaluation Method for Code Translation
Julius Näumann, Sven Keidel, Amir Molzam Sharifloo, Mira Mezini
2026-05-08
Computation and Language · Computer Science
Assessing Reference-Free Peer Evaluation for Machine Translation
Sweta Agrawal, George Foster, Markus Freitag, Colin Cherry
2021-04-13
Computation and Language · Computer Science
A Large-Scale Test Set for the Evaluation of Context-Aware Pronoun Translation in Neural Machine Translation
Mathias Müller, Annette Rios, Elena Voita, Rico Sennrich
2019-03-07
Computation and Language · Computer Science
Style Transfer for Texts: Retrain, Report Errors, Compare with Rewrites
Alexey Tikhonov, Viacheslav Shibaev, Aleksander Nagaev, Aigul Nugmanova +1
2022-11-15