English
Related papers

Related papers: Overestimation in LLM Evaluation: A Controlled Lar…

200 papers

Confidence estimation is crucial for reflecting the reliability of large language models (LLMs), particularly in the widely used closed-source models. Utilizing data augmentation for confidence estimation is viable, but discussions focus on…

Machine Learning · Computer Science 2025-06-16 Rui Wang , Renyu Zhu , Minmin Lin , Runze Wu , Tangjie Lv , Changjie Fan , Haobo Wang

Evidence-enhanced detectors present remarkable abilities in identifying malicious social text. However, the rise of large language models (LLMs) brings potential risks of evidence pollution to confuse detectors. This paper explores…

Computation and Language · Computer Science 2025-05-30 Herun Wan , Minnan Luo , Zhixiong Su , Guang Dai , Xiang Zhao

In this paper, we show that knowledge distillation can be subverted to manipulate language model benchmark scores, revealing a critical vulnerability in current evaluation practices. We introduce "Data Laundering," a process that enables…

Computation and Language · Computer Science 2025-06-05 Jonibek Mansurov , Akhmed Sakip , Alham Fikri Aji

While many have shown how Large Language Models (LLMs) can be applied to a diverse set of tasks, the critical issues of data contamination and memorization are often glossed over. In this work, we address this concern for tabular data.…

Machine Learning · Computer Science 2024-03-12 Sebastian Bordt , Harsha Nori , Rich Caruana

Recent advances in Vision-Language Models (VLMs) have achieved state-of-the-art performance on numerous benchmark tasks. However, the use of internet-scale, often proprietary, pretraining corpora raises a critical concern for both…

Machine Learning · Computer Science 2026-02-03 Jaden Park , Mu Cai , Feng Yao , Jingbo Shang , Soochahn Lee , Yong Jae Lee

Large Language Model (LLM) leaderboards based on benchmark rankings are regularly used to guide practitioners in model selection. Often, the published leaderboard rankings are taken at face value - we show this is a (potentially costly)…

Data contamination hinders fair LLM evaluation by introducing test data into newer models' training sets. Existing studies solve this challenge by updating benchmarks with newly collected data. However, they fail to guarantee…

Computation and Language · Computer Science 2025-05-30 Xiaobao Wu , Liangming Pan , Yuxi Xie , Ruiwen Zhou , Shuai Zhao , Yubo Ma , Mingzhe Du , Rui Mao , Anh Tuan Luu , William Yang Wang

Benchmark Data Contamination (BDC)-the inclusion of benchmark testing samples in the training set-has raised increasing concerns in Large Language Model (LLM) evaluation, leading to falsely inflated performance estimates and undermining…

Artificial Intelligence · Computer Science 2025-03-21 Yifan Sun , Han Wang , Dongbai Li , Gang Wang , Huan Zhang

The rapid expansion of large language models (LLMs) has heightened concerns about their computational and environmental costs. This study investigates the trade-offs between translation quality and efficiency by comparing full-scale,…

Computation and Language · Computer Science 2025-10-03 Dhaathri Vijay , Anandaswarup Vadapalli

Reasoning in large language models has long been a central research focus, and recent studies employing reinforcement learning (RL) have introduced diverse methods that yield substantial performance gains with minimal or even no external…

A central question in natural language understanding (NLU) research is whether high performance demonstrates the models' strong reasoning capabilities. We present an extensive series of controlled experiments where pre-trained language…

Computation and Language · Computer Science 2022-05-17 Aarne Talman , Marianna Apidianaki , Stergios Chatzikyriakidis , Jörg Tiedemann

Data sanitization in the context of language modeling involves identifying sensitive content, such as personally identifiable information (PII), and redacting them from a dataset corpus. It is a common practice used in natural language…

Computation and Language · Computer Science 2024-11-12 Anwesan Pal , Radhika Bhargava , Kyle Hinsz , Jacques Esterhuizen , Sudipta Bhattacharya

Recent large language models have been trained on vast datasets, but also often on repeated data, either intentionally for the purpose of upweighting higher quality data, or unintentionally because data deduplication is not perfect and the…

Overestimation in evaluating large language models (LLMs) has become an increasing concern. Due to the contamination of public benchmarks or imbalanced model training, LLMs may achieve unreal evaluation results on public benchmarks, either…

Computation and Language · Computer Science 2026-05-26 Zi Liang , Liantong Yu , Shiyu Zhang , Qingqing Ye , Haibo Hu

The training process of large language models (LLMs) often involves varying degrees of test data contamination. Although current LLMs are achieving increasingly better performance on various benchmarks, their performance in practical…

Computation and Language · Computer Science 2024-06-25 Qin Zhu , Qingyuan Cheng , Runyu Peng , Xiaonan Li , Tengxiao Liu , Ru Peng , Xipeng Qiu , Xuanjing Huang

Automatic evaluation methods for large language models (LLMs) are hindered by data contamination, leading to inflated assessments of their effectiveness. Existing strategies, which aim to detect contaminated texts, focus on quantifying…

Computation and Language · Computer Science 2024-06-04 Zhuohao Yu , Chang Gao , Wenjin Yao , Yidong Wang , Wei Ye , Jindong Wang , Xing Xie , Yue Zhang , Shikun Zhang

We study the effect of one type of imbalance often present in real-life multilingual classification datasets: an uneven distribution of labels across languages. We show evidence that fine-tuning a transformer-based Large Language Model…

Computation and Language · Computer Science 2024-02-21 Vincent Jung , Lonneke van der Plas

A potential concern when simulating populations of large language models (LLMs) is data contamination, i.e. the possibility that training data may shape outcomes in unintended ways. While this concern is important and may hinder certain…

Computation and Language · Computer Science 2025-06-24 Ariel Flint Ashery , Luca Maria Aiello , Andrea Baronchelli

Multilingual large language models are designed, claimed, and expected to cater to speakers of varied languages. We hypothesise that the current practices of fine-tuning and evaluating these models may not perfectly align with this…

Computation and Language · Computer Science 2024-09-27 Pinzhen Chen , Simon Yu , Zhicheng Guo , Barry Haddow

Accurately evaluating machine-translated text remains a long-standing challenge, particularly for long documents. Recent work has shown that large language models (LLMs) can serve as reliable and interpretable sentence-level translation…

Computation and Language · Computer Science 2025-10-06 Tobias Domhan , Dawei Zhu