English
Related papers

Related papers: Data Contamination Calibration for Black-box LLMs

200 papers

With the widespread application of large language models (LLM), concerns about the privacy leakage of model training data have increasingly become a focus. Membership Inference Attacks (MIAs) have emerged as a critical tool for evaluating…

Robotics · Computer Science 2024-12-24 Zichen Song , Sitan Huang , Zhongfeng Kang

Membership Inference Attacks (MIAs) aim to determine whether a specific data point was included in the training set of a target model. Although there are have been numerous methods developed for detecting data contamination in large…

Machine Learning · Computer Science 2025-12-03 Anton Emelyanov , Sergei Kudriashov , Alena Fenogenova

The memorization of training data in large language models (LLMs) poses significant privacy and copyright concerns. Existing data extraction methods, particularly heuristic-based divergence attacks, often exhibit limited success and offer…

Computation and Language · Computer Science 2025-11-11 Myeongseob Ko , Nikhil Reddy Billa , Adam Nguyen , Charles Fleming , Ming Jin , Ruoxi Jia

Data contamination in model evaluation has become increasingly prevalent with the growing popularity of large language models. It allows models to "cheat" via memorisation instead of displaying true capabilities. Therefore, contamination…

Computation and Language · Computer Science 2024-01-30 Yucheng Li , Frank Guerin , Chenghua Lin

Human feedback plays a pivotal role in aligning large language models (LLMs) with human preferences. However, such feedback is often noisy or inconsistent, which can degrade the quality of reward models and hinder alignment. While various…

Artificial Intelligence · Computer Science 2025-10-15 Samuel Yeh , Sharon Li

As search depth increases in autonomous reasoning and embodied planning, candidate action spaces expand exponentially, often exhausting computational budgets. While heuristic pruning is a critical countermeasure, existing approaches lack…

Machine Learning · Computer Science 2026-05-12 Tianhao Qian

Previous research on PAC-Bayes learning theory has focused extensively on establishing tight upper bounds for test errors. A recently proposed training procedure called PAC-Bayes training, updates the model toward minimizing these bounds.…

Machine Learning · Statistics 2024-10-22 Xitong Zhang , Avrajit Ghosh , Guangliang Liu , Rongrong Wang

Publishing a large language model (LLM) benchmark on the Internet risks contaminating future LLMs: the benchmark may be unintentionally (or intentionally) used to train or select a model. A common mitigation is to keep the benchmark private…

Machine Learning · Computer Science 2025-10-07 Takashi Ishida , Thanawat Lodkaew , Ikko Yamane

The advancement of large language models (LLMs) relies on evaluation using public benchmarks, but data contamination can lead to overestimated performance. Previous researches focus on detecting contamination by determining whether the…

Computation and Language · Computer Science 2024-09-24 Shangqing Tu , Kejian Zhu , Yushi Bai , Zijun Yao , Lei Hou , Juanzi Li

This paper studies the problem of learning with augmented classes (LAC), where augmented classes unobserved in the training data might emerge in the testing phase. Previous studies generally attempt to discover augmented classes by…

Machine Learning · Computer Science 2020-11-30 Yu-Jie Zhang , Peng Zhao , Zhi-Hua Zhou

Data contamination in model evaluation is getting increasingly prevalent as the massive training corpora of large language models often unintentionally include benchmark samples. Therefore, contamination analysis has became an inevitable…

Computation and Language · Computer Science 2023-09-28 Yucheng Li

While pre-trained language models (PLMs) have become a de-facto standard promoting the accuracy of text classification tasks, recent studies find that PLMs often predict over-confidently. Although various calibration methods have been…

Computation and Language · Computer Science 2023-02-15 Jaeyoung Kim , Dongbin Na , Sungchul Choi , Sungbin Lim

Large Language Models (LLMs) are increasingly used in a variety of applications, but concerns around membership inference have grown in parallel. Previous efforts focus on black-to-grey-box models, thus neglecting the potential benefit from…

Cryptography and Security · Computer Science 2025-01-13 Luis Ibanez-Lissen , Lorena Gonzalez-Manzano , Jose Maria de Fuentes , Nicolas Anciaux , Joaquin Garcia-Alfaro

In recent years, code intelligence has gained increasing importance in the field of automated software engineering. Meanwhile, the widespread adoption of Pretrained Language Models (PLMs) and Large Language Models (LLMs) has raised concerns…

Software Engineering · Computer Science 2026-02-09 Zhen Yang , Hongyi Lin , Yifan He , Junqi Wang , Zeyu Sun , Shuo Liu , Jie Xu , Pengpeng Wang , Zhongxing Yu , Qingyuan Liang

Black-box large language models (LLMs) are increasingly deployed in various environments, making it essential for these models to effectively convey their confidence and uncertainty, especially in high-stakes settings. However, these models…

Computation and Language · Computer Science 2024-09-06 Jeremy Qin , Bang Liu , Quoc Dinh Nguyen

The process of matching patients with suitable clinical trials is essential for advancing medical research and providing optimal care. However, current approaches face challenges such as data standardization, ethical considerations, and a…

Computation and Language · Computer Science 2023-08-08 Jiayi Yuan , Ruixiang Tang , Xiaoqian Jiang , Xia Hu

The use of large language models (LLMs) in peer review systems has attracted growing attention, making it essential to examine their potential vulnerabilities. Prior attacks rely on prompt injection, which alters manuscript content and…

Computation and Language · Computer Science 2026-01-13 Masahiro Kaneko

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by incorporating external knowledge, but its openness introduces vulnerabilities that can be exploited by poisoning attacks. Existing poisoning methods for RAG…

Cryptography and Security · Computer Science 2025-05-27 Chunyang Li , Junwei Zhang , Anda Cheng , Zhuo Ma , Xinghua Li , Jianfeng Ma

Various techniques have been proposed to leverage the capabilities of code language models (CLMs) for SE tasks. While these techniques typically evaluate their effectiveness using publicly available datasets, the evaluation can be subject…

Software Engineering · Computer Science 2024-03-29 Jialun Cao , Wuqi Zhang , Shing-Chi Cheung

We introduce Learning-Augmented Control (LAC), an approach that integrates untrusted machine learning predictions into the control of constrained, nonlinear dynamical systems. LAC is designed to achieve the "best-of-both-worlds" guarantees,…

Systems and Control · Electrical Eng. & Systems 2025-07-22 Tongxin Li