English
Related papers

Related papers: A Statistical Hypothesis Testing Framework for Dat…

200 papers

The opacity in developing large language models (LLMs) is raising growing concerns about the potential contamination of public benchmarks in the pre-training data. Existing contamination detection methods are typically based on the text…

Computation and Language · Computer Science 2024-10-31 Feng Yao , Yufan Zhuang , Zihao Sun , Sunan Xu , Animesh Kumar , Jingbo Shang

The remarkable language ability of Large Language Models (LLMs) stems from extensive training on vast datasets, often including copyrighted material, which raises serious concerns about unauthorized use. While Membership Inference Attacks…

Artificial Intelligence · Computer Science 2025-11-21 Haodong Li , Jingqi Zhang , Xiao Cheng , Peihua Mai , Haoyu Wang , Yan Pang

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

Cryptography and Security · Computer Science 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public.…

Computation and Language · Computer Science 2024-06-19 Victoria Smith , Ali Shahin Shamsabadi , Carolyn Ashurst , Adrian Weller

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

Cryptography and Security · Computer Science 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

Large Language Models (LLMs) have garnered significant attention for their powerful ability in natural language understanding and reasoning. In this paper, we present a comprehensive empirical study to explore the performance of LLMs on…

Computation and Language · Computer Science 2024-12-30 Mengyang Chen , Lingwei Wei , Han Cao , Wei Zhou , Songlin Hu

The impressive performances of Large Language Models (LLMs) and their immense potential for commercialization have given rise to serious concerns over the Intellectual Property (IP) of their training data. In particular, the synthetic texts…

Machine Learning · Computer Science 2024-09-26 Jingtan Wang , Xinyang Lu , Zitong Zhao , Zhongxiang Dai , Chuan-Sheng Foo , See-Kiong Ng , Bryan Kian Hsiang Low

Recent claims about the impressive abilities of large language models (LLMs) are often supported by evaluating publicly available benchmarks. Since LLMs train on wide swaths of the internet, this practice raises concerns of data…

Computation and Language · Computer Science 2023-10-17 Manley Roberts , Himanshu Thakur , Christine Herlihy , Colin White , Samuel Dooley

As Large Language Models (LLMs) increasingly appear in social science research (e.g., economics and marketing), it becomes crucial to assess how well these models replicate human behavior. In this work, using hypothesis testing, we present…

Computers and Society · Computer Science 2025-06-19 Harbin Hong , Sebastian Caldas , Liu Leqi

The success of Large Language Models (LLMs) relies heavily on the huge amount of pre-training data learned in the pre-training phase. The opacity of the pre-training process and the training data causes the results of many benchmark tests…

Computation and Language · Computer Science 2025-03-03 Shiwen Ni , Xiangtao Kong , Chengming Li , Xiping Hu , Ruifeng Xu , Jia Zhu , Min Yang

Large Language Models (LLMs) are increasingly integrated into diverse industries, posing substantial security risks due to unauthorized replication and misuse. To mitigate these concerns, robust identification mechanisms are widely…

Cryptography and Security · Computer Science 2024-07-25 Xuhong Wang , Haoyu Jiang , Yi Yu , Jingru Yu , Yilun Lin , Ping Yi , Yingchun Wang , Yu Qiao , Li Li , Fei-Yue Wang

Text watermarking plays a crucial role in ensuring the traceability and accountability of large language model (LLM) outputs and mitigating misuse. While promising, most existing methods assume perfect pseudorandomness. In practice,…

Statistics Theory · Mathematics 2026-01-21 T. Tony Cai , Xiang Li , Qi Long , Weijie J. Su , Garrett G. Wen

Large Language Models (LLMs) have transformed natural language processing, demonstrating impressive capabilities across diverse tasks. However, deploying these models introduces critical risks related to intellectual property violations and…

Cryptography and Security · Computer Science 2025-12-24 Kieu Dang , Phung Lai , NhatHai Phan , Yelong Shen , Ruoming Jin , Abdallah Khreishah , My T. Thai

With the rapid advancement and extensive application of artificial intelligence technology, large language models (LLMs) are extensively used to enhance production, creativity, learning, and work efficiency across various domains. However,…

Cryptography and Security · Computer Science 2024-09-04 Yuqing Liang , Jiancheng Xiao , Wensheng Gan , Philip S. Yu

The Large Language Model (LLM) watermark is a newly emerging technique that shows promise in addressing concerns surrounding LLM copyright, monitoring AI-generated text, and preventing its misuse. The LLM watermark scheme commonly includes…

Cryptography and Security · Computer Science 2024-05-31 Zhaoxi Zhang , Xiaomei Zhang , Yanjun Zhang , Leo Yu Zhang , Chao Chen , Shengshan Hu , Asif Gill , Shirui Pan

Large Language Models (LLMs) have shown their impressive capabilities, while also raising concerns about the data contamination problems due to privacy issues and leakage of benchmark datasets in the pre-training phase. Therefore, it is…

Computation and Language · Computer Science 2024-06-04 Zhenhua Liu , Tong Zhu , Chuanyuan Tan , Haonan Lu , Bing Liu , Wenliang Chen

Copyright protection for large language models is of critical importance, given their substantial development costs, proprietary value, and potential for misuse. Existing surveys have predominantly focused on techniques for tracing…

Cryptography and Security · Computer Science 2026-04-08 Zhenhua Xu , Xubin Yue , Zhebo Wang , Haobo Zhang , Qichen Liu , Xixiang Zhao , Jingxuan Zhang , Wenjun Zeng , Wengpeng Xing , Dezhang Kong , Changting Lin , Meng Han

Large language models are increasingly relied upon as sources of information, but their propensity for generating false or misleading statements with high confidence poses risks for users and society. In this paper, we confront the critical…

The rapid development of Large Language Models (LLMs) has intensified concerns about content traceability and potential misuse. Existing watermarking schemes for sampled text often face trade-offs between maintaining text quality and…

Computation and Language · Computer Science 2025-04-17 Shizhan Cai , Liang Ding , Dacheng Tao

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. However, research on LLM-based approaches to document inconsistency detection…

Computation and Language · Computer Science 2026-04-09 Nelvin Tan , Yaowen Zhang , James Asikin Cheung , Fusheng Liu , Yu-Ching Shih , Dong Yang