English
Related papers

Related papers: Automated Evaluation of Out-of-Context Errors

200 papers

Natural language processing technology has rapidly improved automated grammatical error correction tasks, and the community begins to explore document-level revision as one of the next challenges. To go beyond sentence-level automated…

Computation and Language · Computer Science 2022-05-24 Masato Mita , Keisuke Sakaguchi , Masato Hagiwara , Tomoya Mizumoto , Jun Suzuki , Kentaro Inui

Neural machine translation systems require large amounts of training data and resources. Even with this, the quality of the translations may be insufficient for some users or domains. In such cases, the output of the system must be revised…

Computation and Language · Computer Science 2019-04-09 Álvaro Peris , Francisco Casacuberta

Automatic Post-Editing (APE) aims to correct systematic errors in a machine translated text. This is primarily useful when the machine translation (MT) system is not accessible for improvement, leaving APE as a viable option to improve…

Computation and Language · Computer Science 2019-10-22 Rajen Chatterjee

Spelling irregularities, known now as spelling mistakes, have been found for several centuries. As humans, we are able to understand most of the misspelled words based on their location in the sentence, perceived pronunciation, and context.…

Computation and Language · Computer Science 2021-01-12 Yifei Hu , Xiaonan Jing , Youlim Ko , Julia Taylor Rayz

The general public often encounters complex texts but does not have the time or expertise to fully understand them, leading to the spread of misinformation. Automatic Text Simplification (ATS) helps make information more accessible, but its…

Computation and Language · Computer Science 2025-05-23 Benjamin Vendeville , Liana Ermakova , Pierre De Loor

Abbreviations often have several distinct meanings, often making their use in text ambiguous. Expanding them to their intended meaning in context is important for Machine Reading tasks such as document search, recommendation and question…

Computation and Language · Computer Science 2019-05-23 Manuel Ciosici , Tobias Sommer , Ira Assent

Recent advances in open-vocabulary object detection models will enable Automatic Target Recognition systems to be sustainable and repurposed by non-technical end-users for a variety of applications or missions. New, and potentially nuanced,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Louis Y. Kim , Michelle Karker , Victoria Valledor , Seiyoung C. Lee , Karl F. Brzoska , Margaret Duff , Anthony Palladino

This study proposes a text classification algorithm based on large language models, aiming to address the limitations of traditional methods in capturing long-range dependencies, understanding contextual semantics, and handling class…

Computation and Language · Computer Science 2025-12-11 Ning Lyu , Yuxi Wang , Feng Chen , Qingyuan Zhang

Text alignment is crucial to the accuracy of Machine Translation (MT) systems, some NLP tools or any other text processing tasks requiring bilingual data. This research proposes a language independent sentence alignment approach based on…

Computation and Language · Computer Science 2015-10-01 Krzysztof Wołk , Krzysztof Marasek

When translating phrases (words or group of words), human translators, consciously or not, resort to different translation processes apart from the literal translation, such as Idiom Equivalence, Generalization, Particularization, Semantic…

Computation and Language · Computer Science 2019-04-30 Yuming Zhai , Pooyan Safari , Gabriel Illouz , Alexandre Allauzen , Anne Vilnat

This paper explores the use of Deep Learning methods for automatic estimation of quality of human translations. Automatic estimation can provide useful feedback for translation teaching, examination and quality control. Conventional methods…

Computation and Language · Computer Science 2020-03-16 Yu Yuan , Serge Sharoff

Driven by the remarkable progress in diffusion models, text-to-image generation has made significant strides, creating a pressing demand for automatic quality evaluation of generated images. Current state-of-the-art automatic evaluation…

Computation and Language · Computer Science 2024-11-26 Rong-Cheng Tu , Zi-Ao Ma , Tian Lan , Yuehao Zhao , Heyan Huang , Xian-Ling Mao

In high-stakes English Language Assessments, low-skill test takers may employ memorized materials called ``templates'' on essay questions to ``game'' or fool the automated scoring system. In this study, we introduce the automated detection…

Computation and Language · Computer Science 2025-09-11 Yashad Samant , Lee Becker , Scott Hellman , Bradley Behan , Sarah Hughes , Joshua Southerland

Recent Quality Estimation (QE) models based on multilingual pre-trained representations have achieved very competitive results when predicting the overall quality of translated sentences. Predicting translation errors, i.e. detecting…

Computation and Language · Computer Science 2021-08-30 Marina Fomicheva , Lucia Specia , Nikolaos Aletras

A major open problem in neural machine translation (NMT) is the translation of idiomatic expressions, such as "under the weather". The meaning of these expressions is not composed by the meaning of their constituent words, and NMT models…

Computation and Language · Computer Science 2022-10-11 Christos Baziotis , Prashant Mathur , Eva Hasler

In virtual assistant (VA) systems it is important to reject or redirect user queries that fall outside the scope of the system. One of the most accurate approaches for out-of-scope (OOS) rejection is to combine it with the task of intent…

Computation and Language · Computer Science 2024-10-22 Tianyi Zhang , Atta Norouzian , Aanchan Mohan , Frederick Ducatelle

Terminology correctness is important in the downstream application of machine translation, and a prevalent way to ensure this is to inject terminology constraints into a translation system. In our submission to the WMT 2023 terminology…

Computation and Language · Computer Science 2023-10-10 Nikolay Bogoychev , Pinzhen Chen

The lack of contextual information in text data can make the annotation process of text-based emotion classification datasets challenging. As a result, such datasets often contain labels that fail to consider all the relevant emotions in…

Computation and Language · Computer Science 2023-11-08 Daniel Yang , Aditya Kommineni , Mohammad Alshehri , Nilamadhab Mohanty , Vedant Modi , Jonathan Gratch , Shrikanth Narayanan

Automated simplification models aim to make input texts more readable. Such methods have the potential to make complex information accessible to a wider audience, e.g., providing access to recent medical literature which might otherwise be…

Computation and Language · Computer Science 2022-04-18 Ashwin Devaraj , William Sheffield , Byron C. Wallace , Junyi Jessy Li

Neural machine translation systems have become state-of-the-art approaches for Grammatical Error Correction (GEC) task. In this paper, we propose a copy-augmented architecture for the GEC task by copying the unchanged words from the source…

Computation and Language · Computer Science 2019-06-12 Wei Zhao , Liang Wang , Kewei Shen , Ruoyu Jia , Jingming Liu