中文
相关论文

相关论文: In-Context Watermarks for Large Language Models

200 篇论文

In-context Learning (ICL) empowers large language models (LLMs) to swiftly adapt to unseen tasks at inference-time by prefixing a few demonstration examples before queries. Despite its versatility, ICL incurs substantial computational and…

机器学习 · 计算机科学 2025-02-26 Zhuowei Li , Zihao Xu , Ligong Han , Yunhe Gao , Song Wen , Di Liu , Hao Wang , Dimitris N. Metaxas

In-context learning (ICL) has transformed the use of large language models (LLMs) for NLP tasks, enabling few-shot learning by conditioning on labeled examples without finetuning. Despite its effectiveness, ICL is prone to errors,…

计算与语言 · 计算机科学 2025-03-21 Mario Sanz-Guerrero , Katharina von der Wense

We present REMARK-LLM, a novel efficient, and robust watermarking framework designed for texts generated by large language models (LLMs). Synthesizing human-like content using LLMs necessitates vast computational resources and extensive…

密码学与安全 · 计算机科学 2024-04-09 Ruisi Zhang , Shehzeen Samarah Hussain , Paarth Neekhara , Farinaz Koushanfar

With the increasing use of large language models (LLMs) in daily life, concerns have emerged regarding their potential misuse and societal impact. Watermarking is proposed to trace the usage of specific models by injecting patterns into…

密码学与安全 · 计算机科学 2024-05-24 Baizhou Huang , Xiaojun Wan

Watermarking has emerged as a promising technique to track AI-generated content and differentiate it from authentic human creations. While prior work extensively studies watermarking for autoregressive large language models (LLMs) and image…

密码学与安全 · 计算机科学 2026-02-16 Avi Bagchi , Akhil Bhimaraju , Moulik Choraria , Daniel Alabi , Lav R. Varshney

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

计算与语言 · 计算机科学 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

The task of discerning between generated and natural texts is increasingly challenging. In this context, watermarking emerges as a promising technique for ascribing generated text to a specific model. It alters the sampling generation…

计算与语言 · 计算机科学 2023-11-09 Pierre Fernandez , Antoine Chaffin , Karim Tit , Vivien Chappelier , Teddy Furon

Watermarking has emerged as a pivotal solution for content traceability and intellectual property protection in Large Vision-Language Models (LVLMs). However, vision-agnostic watermarks may introduce visually irrelevant tokens and disrupt…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yue Li , Xin Yi , Dongsheng Shi , Yongyi Cui , Gerard de Melo , Linlin Wang

Large Language Models (LLMs) exhibit In-Context Learning (ICL), which enables the model to perform new tasks conditioning only on the examples provided in the context without updating the model's weights. While ICL offers fast adaptation…

As large language models (LLMs) generate increasingly human-like text, watermarking has emerged as a promising solution for reliable attribution beyond mere detection. While multi-bit watermarking enables richer provenance encoding,…

计算与语言 · 计算机科学 2026-05-11 Yidan Wang , Yubing Ren , Yanan Cao , Li Guo

The recent explosion of high-quality language models has necessitated new methods for identifying AI-generated text. Watermarking is a leading solution and could prove to be an essential tool in the age of generative AI. Existing approaches…

密码学与安全 · 计算机科学 2024-10-25 Miranda Christ , Sam Gunn , Tal Malkin , Mariana Raykova

We propose Easymark, a family of embarrassingly simple yet effective watermarks. Text watermarking is becoming increasingly important with the advent of Large Language Models (LLM). LLMs can generate texts that cannot be distinguished from…

机器学习 · 计算机科学 2023-10-16 Ryoma Sato , Yuki Takezawa , Han Bao , Kenta Niwa , Makoto Yamada

Text watermarking algorithms for large language models (LLMs) can effectively identify machine-generated texts by embedding and detecting hidden features in the text. Although the current text watermarking algorithms perform well in most…

计算与语言 · 计算机科学 2024-06-11 Yijian Lu , Aiwei Liu , Dianzhi Yu , Jingjing Li , Irwin King

Potential harms of large language models can be mitigated by watermarking model output, i.e., embedding signals into generated text that are invisible to humans but algorithmically detectable from a short span of tokens. We propose a…

机器学习 · 计算机科学 2024-05-03 John Kirchenbauer , Jonas Geiping , Yuxin Wen , Jonathan Katz , Ian Miers , Tom Goldstein

LLM watermarking has attracted attention as a promising way to detect AI-generated content, with some works suggesting that current schemes may already be fit for deployment. In this work we dispute this claim, identifying watermark…

机器学习 · 计算机科学 2024-06-25 Nikola Jovanović , Robin Staab , Martin Vechev

Recent advances in Large Language Models (LLMs) have raised urgent concerns about LLM-generated text authenticity, prompting regulatory demands for reliable identification mechanisms. Although watermarking offers a promising solution,…

计算与语言 · 计算机科学 2025-08-26 Xiaoyan Feng , He Zhang , Yanjun Zhang , Leo Yu Zhang , Shirui Pan

Large Language Models (LLMs) have demonstrated remarkable capabilities, but their training requires extensive data and computational resources, rendering them valuable digital assets. Therefore, it is essential to watermark LLMs to protect…

密码学与安全 · 计算机科学 2025-10-21 Shuai Li , Kejiang Chen , Jun Jiang , Jie Zhang , Qiyi Yao , Kai Zeng , Weiming Zhang , Nenghai Yu

Watermarking techniques for large language models (LLMs), which encode hidden information in the output so its source can be verified, have gained significant attention in recent days, thanks to their potential capability to detect…

计算机科学与博弈论 · 计算机科学 2026-05-15 Juho Kim , Fei Fang , Tuomas Sandholm

Efficient knowledge injection methods for Large Language Models (LLMs), such as In-Context Learning, knowledge editing, and efficient parameter fine-tuning, significantly enhance model utility on downstream tasks. However, they also pose…

密码学与安全 · 计算机科学 2026-01-23 Ziwei Zhang , Juan Wen , Wanli Peng , Zhengxian Wu , Yinghan Zhou , Yiming Xue