English
Related papers

Related papers: Investigating Data Contamination for Pre-training …

200 papers

Neural approaches to ranking based on pre-trained language models are highly effective in ad-hoc search. However, the computational expense of these models can limit their application. As such, a process known as knowledge distillation is…

Information Retrieval · Computer Science 2024-11-05 Vishakha Suresh Kalal , Andrew Parry , Sean MacAvaney

The lifecycle of large language models (LLMs) is far more complex than that of traditional machine learning models, involving multiple training stages, diverse data sources, and varied inference methods. While prior research on data…

Cryptography and Security · Computer Science 2025-02-21 Pengfei He , Yue Xing , Han Xu , Zhen Xiang , Jiliang Tang

Data availability and quality are major challenges in natural language processing for low-resourced languages. In particular, there is significantly less data available than for higher-resourced languages. This data is also often of low…

Computation and Language · Computer Science 2023-11-28 Manuel Fokam , Michael Beukman

The increasing size and complexity of pre-trained language models have demonstrated superior performance in many applications, but they usually require large training datasets to be adequately trained. Insufficient training sets could…

Computation and Language · Computer Science 2025-02-03 Yaping Chai , Haoran Xie , Joe S. Qin

Small Language Models (SLMs) are increasingly being deployed in resource-constrained environments, yet their behavioral robustness to data contamination during instruction tuning remains poorly understood. We systematically investigate the…

Computation and Language · Computer Science 2025-11-11 Nicy Scaria , Silvester John Joseph Kennedy , Deepak Subramani

Stable Diffusion revolutionised image creation from descriptive text. GPT-2, GPT-3(.5) and GPT-4 demonstrated astonishing performance across a variety of language tasks. ChatGPT introduced such language models to the general public. It is…

Machine Learning · Computer Science 2024-04-16 Ilia Shumailov , Zakhar Shumaylov , Yiren Zhao , Yarin Gal , Nicolas Papernot , Ross Anderson

Pretraining NLP models with variants of Masked Language Model (MLM) objectives has recently led to a significant improvements on many tasks. This paper examines the benefits of pretrained models as a function of the number of training…

Computation and Language · Computer Science 2020-06-17 Sinong Wang , Madian Khabsa , Hao Ma

Public leaderboards increasingly suggest that large language models (LLMs) surpass human experts on benchmarks spanning academic knowledge, law, and programming. Yet most benchmarks are fully public, their questions widely mirrored across…

Artificial Intelligence · Computer Science 2026-03-18 Eshwar Reddy M , Sourav Karmakar

Benchmark datasets are critical for reproducible, reliable, and discriminative evaluation of LLMs. However, recent studies reveal that many benchmark datasets are included in pretraining corpora, i.e., $\textit{contaminated}$, which…

Machine Learning · Computer Science 2026-05-20 Ali Al-Lawati , Jason Lucas , Dongwon Lee , Suhang Wang

Expressing natural language descriptions of structured facts or relations -- data-to-text generation (D2T) -- increases the accessibility of structured knowledge repositories. Previous work shows that pre-trained language models(PLMs)…

Computation and Language · Computer Science 2022-05-24 Moniba Keymanesh , Adrian Benton , Mark Dredze

Benchmark contamination refers to the presence of test datasets in Large Language Model (LLM) pre-training or post-training data. Contamination can lead to inflated scores on benchmarks, compromising evaluation results and making it…

Computation and Language · Computer Science 2024-10-22 Sanchit Ahuja , Varun Gumma , Sunayana Sitaram

It is generally thought that transformer-based large language models benefit from pre-training by learning generic linguistic knowledge that can be focused on a specific task during fine-tuning. However, we propose that much of the benefit…

Computation and Language · Computer Science 2024-06-19 Anna C. Marbut , John W. Chandler , Travis J. Wheeler

Large language models are increasingly trained on corpora containing both natural language and non-linguistic data like source code. Aside from aiding programming-related tasks, anecdotal evidence suggests that including code in pretraining…

Computation and Language · Computer Science 2025-02-26 Jackson Petty , Sjoerd van Steenkiste , Tal Linzen

Public benchmarks play an essential role in the evaluation of large language models. However, data contamination can lead to inflated performance, rendering them unreliable for model comparison. It is therefore crucial to detect…

Computation and Language · Computer Science 2024-05-28 Jasper Dekoninck , Mark Niklas Müller , Martin Vechev

Amidst the rapid advancements in generative language models, the investigation of how training data shapes the performance of GPT models is still emerging. This paper presents GPTfluence, a novel approach that leverages a featurized…

Computation and Language · Computer Science 2024-10-04 Yekun Chai , Qingyi Liu , Shuohuan Wang , Yu Sun , Qiwei Peng , Hua Wu

The performance of Large Language Models (LLMs) is substantially influenced by the pretraining corpus, which consists of vast quantities of unsupervised data processed by the models. Despite its critical role in model performance, ensuring…

Computation and Language · Computer Science 2024-10-11 Ranchi Zhao , Zhen Leng Thai , Yifan Zhang , Shengding Hu , Yunqi Ba , Jie Zhou , Jie Cai , Zhiyuan Liu , Maosong Sun

Large-scale pretraining datasets drive the success of large language models (LLMs). However, these web-scale corpora inevitably contain large amounts of noisy data due to unregulated web content or randomness inherent in data. Although LLM…

Machine Learning · Computer Science 2026-02-03 Qizhen Zhang , Ankush Garg , Jakob Foerster , Niladri Chatterji , Kshitiz Malik , Mike Lewis

Recent advances in the development of large language models have resulted in public access to state-of-the-art pre-trained language models (PLMs), including Generative Pre-trained Transformer 3 (GPT-3) and Bidirectional Encoder…

Common problems in playing online mobile and computer games were related to toxic behavior and abusive communication among players. Based on different reports and studies, the study also discusses the impact of online hate speech and…

Computation and Language · Computer Science 2024-03-28 Daniel Fesalbon , Arvin De La Cruz , Marvin Mallari , Nelson Rodelas

Large language models (LLMs) have demonstrated great performance across various benchmarks, showing potential as general-purpose task solvers. However, as LLMs are typically trained on vast amounts of data, a significant concern in their…

Computation and Language · Computer Science 2025-05-13 Yujuan Fu , Ozlem Uzuner , Meliha Yetisgen , Fei Xia