中文
相关论文

相关论文: Robust Distortion-free Watermarks for Language Mod…

200 篇论文

Given a text, can we determine whether it was generated by a large language model (LLM) or by a human? A widely studied approach to this problem is watermarking. We propose an undetectable and elementary watermarking scheme in the closed…

密码学与安全 · 计算机科学 2025-06-26 Pedro Abdalla , Roman Vershynin

Recent advancements in Large Language Models (LLMs) raised concerns over potential misuse, such as for spreading misinformation. In response two counter measures emerged: machine learning-based detectors that predict if text is synthetic,…

机器学习 · 计算机科学 2025-04-17 David Khachaturov , Robert Mullins , Ilia Shumailov , Sumanth Dathathri

Watermark text spotting in document images can offer access to an often unexplored source of information, providing crucial evidence about a record's scope, audience and sometimes even authenticity. Stemming from the problem of text…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Mateusz Krubiński , Stefan Matcovici , Diana Grigore , Daniel Voinea , Alin-Ionut Popa

Robust watermarking is critical for intellectual property protection, whereas existing methods face a severe vulnerability against regeneration-based AIGC attacks. We identify that existing methods fail because they entangle the watermark…

机器学习 · 计算机科学 2026-02-26 Haoyuan He , Yu Zheng , Jie Zhou , Jiwen Lu

Recent reasoning Large Language Models (LLMs) demonstrate remarkable problem-solving abilities but often generate long thinking traces whose utility is unclear. Our work aims to improve their efficiency, enabling them to reach high…

计算与语言 · 计算机科学 2026-05-11 Xiang Liu , Xuming Hu , Xiaowen Chu , Eunsol Choi

Autoregressive language models accumulate errors due to their fixed, irrevocable left-to-right token generation. To address this, we propose a new sampling method called Resample-Previous-Tokens (RPT). RPT mitigates error accumulation by…

机器学习 · 计算机科学 2025-06-09 Itai Gat , Neta Shaul , Uriel Singer , Yaron Lipman

Recently, text watermarking algorithms for large language models (LLMs) have been proposed to mitigate the potential harms of text generated by LLMs, including fake news and copyright issues. However, current watermark detection algorithms…

计算与语言 · 计算机科学 2024-05-28 Aiwei Liu , Leyi Pan , Xuming Hu , Shu'ang Li , Lijie Wen , Irwin King , Philip S. Yu

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

多媒体 · 计算机科学 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

计算与语言 · 计算机科学 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang

Large language models (LLMs) excellently generate human-like text, but also raise concerns about misuse in fake news and academic dishonesty. Decoding-based watermark, particularly the GumbelMax-trick-based watermark(GM watermark), is a…

计算与语言 · 计算机科学 2024-05-29 Jiayi Fu , Xuandong Zhao , Ruihan Yang , Yuansen Zhang , Jiangjie Chen , Yanghua Xiao

This paper introduces RoSeMary, the first-of-its-kind ML/Crypto codesign watermarking framework that regulates LLM-generated code to avoid intellectual property rights violations and inappropriate misuse in software development.…

密码学与安全 · 计算机科学 2025-02-11 Ruisi Zhang , Neusha Javidnia , Nojan Sheybani , Farinaz Koushanfar

Watermarking for large language models (LLMs) has emerged as an effective tool for distinguishing AI-generated text from human-written content. Statistically, watermark schemes induce dependence between generated tokens and a pseudo-random…

统计方法学 · 统计学 2026-04-13 Weijie Su , Ruodu Wang , Zinan Zhao

Text watermarks in large language models (LLMs) are an increasingly important tool for detecting synthetic text and distinguishing human-written content from LLM-generated text. While most existing studies focus on determining whether…

机器学习 · 统计学 2025-06-30 Xiang Li , Garrett Wen , Weiqing He , Jiayuan Wu , Qi Long , Weijie J. Su

The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token…

计算与语言 · 计算机科学 2023-11-17 Yuhang Li , Yihan Wang , Zhouxing Shi , Cho-Jui Hsieh

In-generation watermarking for latent diffusion models has recently shown high robustness in marking generated images for easier detection and attribution. However, its application to autoregressive (AR) image models is underexplored.…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Denis Lukovnikov , Andreas Müller , Erwin Quiring , Asja Fischer

Text-to-image diffusion models, such as Stable Diffusion, have shown exceptional potential in generating high-quality images. However, recent studies highlight concerns over the use of unauthorized data in training these models, which may…

计算机视觉与模式识别 · 计算机科学 2024-11-28 Soumil Datta , Shih-Chieh Dai , Leo Yu , Guanhong Tao

Instruction-driven image editing allows users to quickly edit an image according to text instructions in a forward pass. Nevertheless, malicious users can easily exploit this technique to create fake images, which could cause a crisis of…

密码学与安全 · 计算机科学 2024-07-18 Runyi Hu , Jie Zhang , Ting Xu , Jiwei Li , Tianwei Zhang

Watermarking has become a key technique for proprietary language models, enabling the distinction between AI-generated and human-written text. However, in many real-world scenarios, LLM-generated content may undergo post-generation edits,…

机器学习 · 计算机科学 2025-10-03 Liyan Xie , Muhammad Siddeek , Mohamed Seif , Andrea J. Goldsmith , Mengdi Wang

Watermarking is a principled approach for tracing the provenance of large language model (LLM) outputs, but its deployment in practice is hindered by inference inefficiency. Speculative sampling accelerates inference, with efficiency…

机器学习 · 计算机科学 2026-02-24 Weiqing He , Xiang Li , Li Shen , Weijie Su , Qi Long

The recent advancements in large language models (LLMs) have sparked a growing apprehension regarding the potential misuse. One approach to mitigating this risk is to incorporate watermarking techniques into LLMs, allowing for the tracking…

密码学与安全 · 计算机科学 2023-10-19 Zhengmian Hu , Lichang Chen , Xidong Wu , Yihan Wu , Hongyang Zhang , Heng Huang