English
Related papers

Related papers: No Memorization, No Detection: Output Distribution…

200 papers

Discrete diffusion models are a class of generative models that construct sequences by progressively denoising samples from a categorical noise distribution. Beyond their rapidly growing ability to generate coherent natural language, these…

Computation and Language · Computer Science 2025-12-11 Michael Cardei , Jacob K Christopher , Thomas Hartvigsen , Bhavya Kailkhura , Ferdinando Fioretto

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

Data contamination in model evaluation has become increasingly prevalent with the growing popularity of large language models. It allows models to "cheat" via memorisation instead of displaying true capabilities. Therefore, contamination…

Computation and Language · Computer Science 2024-01-30 Yucheng Li , Frank Guerin , Chenghua Lin

Detoxification in large language models (LLMs) remains a significant research challenge. Existing decoding detoxification methods are all based on external constraints, which require additional resource overhead and lose generation fluency.…

Computation and Language · Computer Science 2025-10-16 Ming Dong , Jinkui Zhang , Bolong Zheng , Xinhui Tu , Po Hu , Tingting He

The contamination detection problem aims to determine whether a set of observations has been contaminated, i.e. whether it contains points drawn from a distribution different from the reference distribution. Here, we consider a supervised…

Methodology · Statistics 2024-04-10 Solenne Gaucher , Gilles Blanchard , Frédéric Chazal

The rapid advancement of large language models (LLMs) has heightened concerns about benchmark data contamination (BDC), where models inadvertently memorize evaluation data during the training process, inflating performance metrics, and…

Computation and Language · Computer Science 2025-09-23 Cheng Xu , Nan Yan , Shuhao Guan , Changhong Jin , Yuke Mei , Yibing Guo , M-Tahar Kechadi

Context: Code Clone Detection (CCD) is a software engineering task that is used for plagiarism detection, code search, and code comprehension. Recently, deep learning-based models have achieved an F1 score (a metric used to assess…

Software Engineering · Computer Science 2023-11-10 Mohamad Khajezade , Fatemeh Hendijani Fard , Mohamed S. Shehata

Reasoning distillation has emerged as a prevailing paradigm for transferring reasoning capabilities from large reasoning models to small language models. Yet, reasoning distillation risks data contamination: benchmark data may inadvertently…

Computation and Language · Computer Science 2026-05-11 Hengxiang Zhang , Hyeong Kyu Choi , Sharon Li , Hongxin Wei

Knowledge Distillation (KD) compresses computationally expensive pre-trained language models (PLMs) by transferring their knowledge to smaller models, allowing their use in resource-constrained or real-time settings. However, most smaller…

Computation and Language · Computer Science 2023-11-08 Hayeon Lee , Rui Hou , Jongpil Kim , Davis Liang , Hongbo Zhang , Sung Ju Hwang , Alexander Min

In many real-world settings, machine learning models need to identify user inputs that are out-of-domain (OOD) so as to avoid performing wrong actions. This work focuses on a challenging case of OOD detection, where no labels for in-domain…

Computation and Language · Computer Science 2022-03-23 Di Jin , Shuyang Gao , Seokhwan Kim , Yang Liu , Dilek Hakkani-Tur

How can models effectively detect out-of-distribution (OOD) samples in complex, multi-label settings without extensive retraining? Existing OOD detection methods struggle to capture the intricate semantic relationships and label…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zhendong Liu , Yi Nian , Yuehan Qin , Henry Peng Zou , Li Li , Xiyang Hu , Yue Zhao

Large language models (LLMs) have demonstrated great performance across various benchmarks, showing potential as general-purpose task solvers. However, as LLMs are typically trained on vast amounts of data, a significant concern in their…

Computation and Language · Computer Science 2025-05-13 Yujuan Fu , Ozlem Uzuner , Meliha Yetisgen , Fei Xia

In safety-critical applications of machine learning, it is often desirable for a model to be conservative, abstaining from making predictions on unknown inputs which are not well-represented in the training data. However, detecting unknown…

Machine Learning · Computer Science 2024-06-04 Caroline Choi , Fahim Tajwar , Yoonho Lee , Huaxiu Yao , Ananya Kumar , Chelsea Finn

Large language models are widespread, with their performance on benchmarks frequently guiding user preferences for one model over another. However, the vast amount of data these models are trained on can inadvertently lead to contamination…

Machine Learning · Computer Science 2024-02-13 Jasper Dekoninck , Mark Niklas Müller , Maximilian Baader , Marc Fischer , Martin Vechev

Adversarial poisoning attacks pose huge threats to various machine learning applications. Especially, the recent accumulative poisoning attacks show that it is possible to achieve irreparable harm on models via a sequence of imperceptible…

Machine Learning · Computer Science 2023-06-07 Jianing Zhu , Xiawei Guo , Jiangchao Yao , Chao Du , Li He , Shuo Yuan , Tongliang Liu , Liang Wang , Bo Han

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

Machine Learning · Computer Science 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

As the scale of training corpora for large language models (LLMs) grows, model developers become increasingly reluctant to disclose details on their data. This lack of transparency poses challenges to scientific evaluation and ethical…

Computation and Language · Computer Science 2025-05-22 Weichao Zhang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

For most intelligent assistant systems, it is essential to have a mechanism that detects out-of-domain (OOD) utterances automatically to handle noisy input properly. One typical approach would be introducing a separate class that contains…

Computation and Language · Computer Science 2020-03-30 Yueqi Feng , Jiali Lin

Large language models (LLMs) are known to be trained on vast amounts of data, which may unintentionally or intentionally include data from commonly used benchmarks. This inclusion can lead to cheatingly high scores on model leaderboards,…

Computation and Language · Computer Science 2025-03-19 Huixuan Zhang , Yun Lin , Xiaojun Wan

Neural approaches to ranking based on pre-trained language models are highly effective in ad-hoc search. However, the computational expense of these models can limit their application. As such, a process known as knowledge distillation is…

Information Retrieval · Computer Science 2024-11-05 Vishakha Suresh Kalal , Andrew Parry , Sean MacAvaney