English
Related papers

Related papers: Proving membership in LLM pretraining data via dat…

200 papers

Text watermarks for large language models (LLMs) have been commonly used to identify the origins of machine-generated content, which is promising for assessing liability when combating deepfake or harmful content. While existing…

Cryptography and Security · Computer Science 2024-10-30 Tong Zhou , Xuandong Zhao , Xiaolin Xu , Shaolei Ren

Text watermarks in large language models (LLMs) are an increasingly important tool for detecting synthetic text and distinguishing human-written content from LLM-generated text. While most existing studies focus on determining whether…

Machine Learning · Statistics 2025-06-30 Xiang Li , Garrett Wen , Weiqing He , Jiayuan Wu , Qi Long , Weijie J. Su

Proprietary large language models (LLMs) face risks of intellectual property (IP) violation, as adversaries can replicate an LLM by collecting input-output pairs to train a surrogate model, causing financial setbacks. Watermarks offer a…

Cryptography and Security · Computer Science 2026-05-25 Kieu Dang , Phung Lai , NhatHai Phan , Yelong Shen , Ruoming Jin

Latent Diffusion Models (LDMs) have established themselves as powerful tools in the rapidly evolving field of image generation, capable of producing highly realistic images. However, their widespread adoption raises critical concerns about…

Cryptography and Security · Computer Science 2026-01-28 Zhonghao Yang , Linye Lyu , Xuanhang Chang , Daojing He , YU LI

Pre-training, which utilizes extensive and varied datasets, is a critical factor in the success of Large Language Models (LLMs) across numerous applications. However, the detailed makeup of these datasets is often not disclosed, leading to…

Cryptography and Security · Computer Science 2024-01-02 Haodong Li , Gelei Deng , Yi Liu , Kailong Wang , Yuekang Li , Tianwei Zhang , Yang Liu , Guoai Xu , Guosheng Xu , Haoyu Wang

The widespread use of Large Language Models (LLMs), celebrated for their ability to generate human-like text, has raised concerns about misinformation and ethical implications. Addressing these concerns necessitates the development of…

Computation and Language · Computer Science 2024-03-28 Wissam Antoun , Benoît Sagot , Djamé Seddah

Deep neural networks have had enormous impact on various domains of computer science, considerably outperforming previous state of the art machine learning techniques. To achieve this performance, neural networks need large quantities of…

Cryptography and Security · Computer Science 2018-09-05 Dorjan Hitaj , Luigi V. Mancini

The advancement in text-to-image models has led to astonishing artistic performances. However, several studios and websites illegally fine-tune these models using artists' artworks to mimic their styles for profit, which violates the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Ge Luo , Junqiang Huang , Manman Zhang , Zhenxing Qian , Sheng Li , Xinpeng Zhang

Watermarking approaches are proposed to identify if text being circulated is human or large language model (LLM) generated. The state-of-the-art watermarking strategy of Kirchenbauer et al. (2023a) biases the LLM to generate specific…

Cryptography and Security · Computer Science 2024-03-25 Qilong Wu , Varun Chandrasekaran

In response to the growing popularity of Machine Learning (ML) techniques to solve problems in various industries, various malicious groups have started to target such techniques in their attack plan. However, as ML models are constantly…

Cryptography and Security · Computer Science 2025-03-25 Shahinul Hoque , Farhin Farhad Riya , Yingyuan Yang , Jinyuan Sun

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

Computation and Language · Computer Science 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

Watermarking for large language models (LLMs) offers a promising approach to identifying AI-generated text. Existing approaches, however, either compromise the distribution of original generated text by LLMs or are limited to embedding…

Cryptography and Security · Computer Science 2025-06-09 Ya Jiang , Chuxiong Wu , Massieh Kordi Boroujeny , Brian Mark , Kai Zeng

Large language models (LLMs) have achieved remarkable success across a wide range of natural language processing tasks, demonstrating human-level performance in text generation, reasoning, and question answering. However, training such…

Cryptography and Security · Computer Science 2025-11-17 Yanbo Dai , Zongjie Li , Zhenlan Ji , Shuai Wang

The impressive performances of Large Language Models (LLMs) and their immense potential for commercialization have given rise to serious concerns over the Intellectual Property (IP) of their training data. In particular, the synthetic texts…

Machine Learning · Computer Science 2024-09-26 Jingtan Wang , Xinyang Lu , Zitong Zhao , Zhongxiang Dai , Chuan-Sheng Foo , See-Kiong Ng , Bryan Kian Hsiang Low

Watermarking is a tool for actively identifying and attributing the images generated by latent diffusion models. Existing methods face the dilemma of image quality and watermark robustness. Watermarks with superior image quality usually…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Zheling Meng , Bo Peng , Jing Dong

Detecting machine-generated text is essential for transparency and accountability when deploying large language models (LLMs). Among detection approaches, watermarking is a statistically reliable method by design -- it embeds detectable…

Computation and Language · Computer Science 2026-05-05 Koshiro Saito , Ryuto Koike , Masahiro Kaneko , Naoaki Okazaki

Visual Language Models (VLMs) have become foundational models for document understanding tasks, widely used in the processing of complex multimodal documents across domains such as finance, law, and academia. However, documents often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Chunxue Xu , Yiwei Wang , Bryan Hooi , Yujun Cai , Songze Li

Deep learning, especially deep neural networks (DNNs), has been widely and successfully adopted in many critical applications for its high effectiveness and efficiency. The rapid development of DNNs has benefited from the existence of some…

Cryptography and Security · Computer Science 2023-04-03 Yiming Li , Mingyan Zhu , Xue Yang , Yong Jiang , Tao Wei , Shu-Tao Xia

As large language models (LLMs) are trained on increasingly vast and opaque text corpora, determining which data contributed to training has become essential for copyright enforcement, compliance auditing, and user trust. While prior work…

Computation and Language · Computer Science 2026-03-30 Pranav Shetty , Mirazul Haque , Zhiqiang Ma , Xiaomo Liu

Watermarking generative-AI systems, such as LLMs, has gained considerable interest, driven by their enhanced capabilities across a wide range of tasks. Although current approaches have demonstrated that small, context-dependent shifts in…

Computation and Language · Computer Science 2024-03-29 Piotr Molenda , Adian Liusie , Mark J. F. Gales