English
Related papers

Related papers: Robust Distortion-free Watermarks for Language Mod…

200 papers

Given a text, can we determine whether it was generated by a large language model (LLM) or by a human? A widely studied approach to this problem is watermarking. We propose an undetectable and elementary watermarking scheme in the closed…

Cryptography and Security · Computer Science 2025-06-26 Pedro Abdalla , Roman Vershynin

Recent advancements in Large Language Models (LLMs) raised concerns over potential misuse, such as for spreading misinformation. In response two counter measures emerged: machine learning-based detectors that predict if text is synthetic,…

Machine Learning · Computer Science 2025-04-17 David Khachaturov , Robert Mullins , Ilia Shumailov , Sumanth Dathathri

Watermark text spotting in document images can offer access to an often unexplored source of information, providing crucial evidence about a record's scope, audience and sometimes even authenticity. Stemming from the problem of text…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Mateusz Krubiński , Stefan Matcovici , Diana Grigore , Daniel Voinea , Alin-Ionut Popa

Robust watermarking is critical for intellectual property protection, whereas existing methods face a severe vulnerability against regeneration-based AIGC attacks. We identify that existing methods fail because they entangle the watermark…

Machine Learning · Computer Science 2026-02-26 Haoyuan He , Yu Zheng , Jie Zhou , Jiwen Lu

Recent reasoning Large Language Models (LLMs) demonstrate remarkable problem-solving abilities but often generate long thinking traces whose utility is unclear. Our work aims to improve their efficiency, enabling them to reach high…

Computation and Language · Computer Science 2026-05-11 Xiang Liu , Xuming Hu , Xiaowen Chu , Eunsol Choi

Autoregressive language models accumulate errors due to their fixed, irrevocable left-to-right token generation. To address this, we propose a new sampling method called Resample-Previous-Tokens (RPT). RPT mitigates error accumulation by…

Machine Learning · Computer Science 2025-06-09 Itai Gat , Neta Shaul , Uriel Singer , Yaron Lipman

Recently, text watermarking algorithms for large language models (LLMs) have been proposed to mitigate the potential harms of text generated by LLMs, including fake news and copyright issues. However, current watermark detection algorithms…

Computation and Language · Computer Science 2024-05-28 Aiwei Liu , Leyi Pan , Xuming Hu , Shu'ang Li , Lijie Wen , Irwin King , Philip S. Yu

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

Multimedia · Computer Science 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

Computation and Language · Computer Science 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang

Large language models (LLMs) excellently generate human-like text, but also raise concerns about misuse in fake news and academic dishonesty. Decoding-based watermark, particularly the GumbelMax-trick-based watermark(GM watermark), is a…

Computation and Language · Computer Science 2024-05-29 Jiayi Fu , Xuandong Zhao , Ruihan Yang , Yuansen Zhang , Jiangjie Chen , Yanghua Xiao

This paper introduces RoSeMary, the first-of-its-kind ML/Crypto codesign watermarking framework that regulates LLM-generated code to avoid intellectual property rights violations and inappropriate misuse in software development.…

Cryptography and Security · Computer Science 2025-02-11 Ruisi Zhang , Neusha Javidnia , Nojan Sheybani , Farinaz Koushanfar

Watermarking for large language models (LLMs) has emerged as an effective tool for distinguishing AI-generated text from human-written content. Statistically, watermark schemes induce dependence between generated tokens and a pseudo-random…

Methodology · Statistics 2026-04-13 Weijie Su , Ruodu Wang , Zinan Zhao

Text watermarks in large language models (LLMs) are an increasingly important tool for detecting synthetic text and distinguishing human-written content from LLM-generated text. While most existing studies focus on determining whether…

Machine Learning · Statistics 2025-06-30 Xiang Li , Garrett Wen , Weiqing He , Jiayuan Wu , Qi Long , Weijie J. Su

The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token…

Computation and Language · Computer Science 2023-11-17 Yuhang Li , Yihan Wang , Zhouxing Shi , Cho-Jui Hsieh

In-generation watermarking for latent diffusion models has recently shown high robustness in marking generated images for easier detection and attribution. However, its application to autoregressive (AR) image models is underexplored.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Denis Lukovnikov , Andreas Müller , Erwin Quiring , Asja Fischer

Text-to-image diffusion models, such as Stable Diffusion, have shown exceptional potential in generating high-quality images. However, recent studies highlight concerns over the use of unauthorized data in training these models, which may…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Soumil Datta , Shih-Chieh Dai , Leo Yu , Guanhong Tao

Instruction-driven image editing allows users to quickly edit an image according to text instructions in a forward pass. Nevertheless, malicious users can easily exploit this technique to create fake images, which could cause a crisis of…

Cryptography and Security · Computer Science 2024-07-18 Runyi Hu , Jie Zhang , Ting Xu , Jiwei Li , Tianwei Zhang

Watermarking has become a key technique for proprietary language models, enabling the distinction between AI-generated and human-written text. However, in many real-world scenarios, LLM-generated content may undergo post-generation edits,…

Machine Learning · Computer Science 2025-10-03 Liyan Xie , Muhammad Siddeek , Mohamed Seif , Andrea J. Goldsmith , Mengdi Wang

Watermarking is a principled approach for tracing the provenance of large language model (LLM) outputs, but its deployment in practice is hindered by inference inefficiency. Speculative sampling accelerates inference, with efficiency…

Machine Learning · Computer Science 2026-02-24 Weiqing He , Xiang Li , Li Shen , Weijie Su , Qi Long

The recent advancements in large language models (LLMs) have sparked a growing apprehension regarding the potential misuse. One approach to mitigating this risk is to incorporate watermarking techniques into LLMs, allowing for the tracking…

Cryptography and Security · Computer Science 2023-10-19 Zhengmian Hu , Lichang Chen , Xidong Wu , Yihan Wu , Hongyang Zhang , Heng Huang