English
Related papers

Related papers: Data Contamination in Neural Hieroglyphic Translat…

200 papers

Large language models (LLMs) trained on next-token prediction (NTP) paradigm have demonstrated powerful capabilities. However, the existing NTP paradigm contains several limitations, particularly related to planned task complications and…

Computation and Language · Computer Science 2024-09-02 Junhao Ruan , Abudukeyumu Abudula , Xinyu Liu , Bei Li , Yinqiao Li , Chenglong Wang , Yuchun Fan , Yuan Ge , Tong Xiao , Jingbo Zhu

Large-scale training datasets lie at the core of the recent success of neural machine translation (NMT) models. However, the complex patterns and potential noises in the large-scale data make training NMT models difficult. In this work, we…

Computation and Language · Computer Science 2020-10-07 Wenxiang Jiao , Xing Wang , Shilin He , Irwin King , Michael R. Lyu , Zhaopeng Tu

In recent years, neural machine translation (NMT) has been widely used in everyday life. However, the current NMT lacks a mechanism to adjust the difficulty level of translations to match the user's language level. Additionally, due to the…

Computation and Language · Computer Science 2024-08-09 Masashi Oshika , Makoto Morishita , Tsutomu Hirao , Ryohei Sasano , Koichi Takeda

Egyptian hieroglyphs are found on numerous ancient Egyptian artifacts, but it is common that they are blurry or even missing due to erosion. Existing efforts to restore blurry hieroglyphs adopt computer vision techniques such as CNNs and…

Computation and Language · Computer Science 2025-03-10 Xuheng Cai , Erica Zhang

Neural Machine Translation (NMT) has obtained state-of-the art performance for several language pairs, while only using parallel data for training. Target-side monolingual data plays an important role in boosting fluency for phrase-based…

Computation and Language · Computer Science 2016-06-06 Rico Sennrich , Barry Haddow , Alexandra Birch

Data contamination, i.e., the presence of test data from downstream tasks in the training data of large language models (LLMs), is a potential major issue in measuring LLMs' real effectiveness on other tasks. We propose a straightforward…

Computation and Language · Computer Science 2024-02-23 Shahriar Golchin , Mihai Surdeanu

Decoder-only LLMs have shown impressive performance in MT due to their ability to learn from extensive datasets and generate high-quality translations. However, LLMs often struggle with the nuances and style required for…

Computation and Language · Computer Science 2024-09-11 Inacio Vieira , Will Allred , Séamus Lankford , Sheila Castilho , Andy Way

If LLM training data is polluted with benchmark test data, then benchmark performance gives biased estimates of out-of-distribution (OOD) generalization. Typical decontamination filters use n-gram matching which fail to detect semantic…

Machine Learning · Computer Science 2026-02-16 Ari Spiesberger , Juan J. Vazquez , Nicky Pochinkov , Tomáš Gavenčiak , Peli Grietzer , Gavin Leech , Nandi Schoots

Neural Machine Translation has achieved state-of-the-art performance for several language pairs using a combination of parallel and synthetic data. Synthetic data is often generated by back-translating sentences randomly sampled from…

Computation and Language · Computer Science 2018-09-24 Marzieh Fadaee , Christof Monz

Decompilation aims to transform a low-level program language (LPL) (eg., binary file) into its functionally-equivalent high-level program language (HPL) (e.g., C/C++). It is a core technology in software security, especially in…

Machine Learning · Computer Science 2023-01-04 Ying Cao , Ruigang Liang , Kai Chen , Peiwei Hu

The problem of data contamination is now almost inevitable during the development of large language models (LLMs), with the training data commonly integrating those evaluation benchmarks even unintentionally. This problem subsequently makes…

Computation and Language · Computer Science 2025-09-19 Ruijie Hou , Yueyang Jiao , Hanxu Hu , Yingming Li , Wai Lam , Huajian Zhang , Hongyuan Lu

Large language models (LLMs) excel in many natural language tasks, yet they struggle with complex mathemat-ical problem-solving, particularly in symbolic reasoning and maintaining consistent output. This study evalu-ates 10 LLMs with 7 to 8…

Machine Learning · Computer Science 2025-01-29 Evgenii Evstafev

Preserving ancient languages is essential for understanding humanity's cultural and linguistic heritage, yet Old English remains critically under-resourced, limiting its accessibility to modern natural language processing (NLP) techniques.…

Computation and Language · Computer Science 2025-07-29 Rodrigo Gabriel Salazar Alva , Matías Nuñez , Cristian López , Javier Martín Arista

Analysing translation quality in regards to specific linguistic phenomena has historically been difficult and time-consuming. Neural machine translation has the attractive property that it can produce scores for arbitrary translations, and…

Computation and Language · Computer Science 2017-02-14 Rico Sennrich

While machine translation has traditionally relied on large amounts of parallel corpora, a recent research line has managed to train both Neural Machine Translation (NMT) and Statistical Machine Translation (SMT) systems using monolingual…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Gorka Labaka , Eneko Agirre

Recent observations have underscored a disparity between the inflated benchmark scores and the actual performance of LLMs, raising concerns about potential contamination of evaluation benchmarks. This issue is especially critical for…

Computation and Language · Computer Science 2024-04-05 Chunyuan Deng , Yilun Zhao , Xiangru Tang , Mark Gerstein , Arman Cohan

Adversaries may look to steal or attack black-box NLP systems, either for financial gain or to exploit model errors. One setting of particular interest is machine translation (MT), where models have high commercial value and errors can be…

Computation and Language · Computer Science 2021-01-05 Eric Wallace , Mitchell Stern , Dawn Song

Large Language Models (LLMs) possess a theoretical capability to model information density far beyond the limits of classical statistical methods (e.g., Lempel-Ziv). However, utilizing this capability for lossless compression involves…

Information Theory · Computer Science 2026-03-27 Marcus Armstrong , ZiWei Qiu , Huy Q. Vo , Arjun Mukherjee

Recent advances in large language models (LLMs) have led to their extensive global deployment, and ensuring their safety calls for comprehensive and multilingual toxicity evaluations. However, existing toxicity benchmarks are overwhelmingly…

Computation and Language · Computer Science 2024-08-13 Devansh Jain , Priyanshu Kumar , Samuel Gehman , Xuhui Zhou , Thomas Hartvigsen , Maarten Sap

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models…

Computation and Language · Computer Science 2024-10-04 Tianxiang Hu , Pei Zhang , Baosong Yang , Jun Xie , Derek F. Wong , Rui Wang