English
Related papers

Related papers: LLM Watermark Evasion via Bias Inversion

200 papers

Generation-time text watermarking embeds statistical signals into text for traceability of AI-generated content. We explore *post-hoc watermarking* where an LLM rewrites existing text while applying generation-time watermarking, to protect…

We investigate the radioactivity of text generated by large language models (LLM), i.e. whether it is possible to detect that such synthetic input was used to train a subsequent LLM. Current methods like membership inference or active IP…

Cryptography and Security · Computer Science 2024-10-29 Tom Sander , Pierre Fernandez , Alain Durmus , Matthijs Douze , Teddy Furon

Large Language Models (LLMs) are increasingly integrated into diverse industries, posing substantial security risks due to unauthorized replication and misuse. To mitigate these concerns, robust identification mechanisms are widely…

Cryptography and Security · Computer Science 2024-07-25 Xuhong Wang , Haoyu Jiang , Yi Yu , Jingru Yu , Yilun Lin , Ping Yi , Yingchun Wang , Yu Qiao , Li Li , Fei-Yue Wang

Adversarial attacks by malicious users that threaten the safety of large language models (LLMs) can be viewed as attempts to infer a target property $T$ that is unknown when an instruction is issued, and becomes knowable only after the…

Cryptography and Security · Computer Science 2025-10-21 Masahiro Kaneko , Timothy Baldwin

As large language models (LLMs) reach human-like fluency, reliably distinguishing AI-generated text from human authorship becomes increasingly difficult. While watermarks already exist for LLMs, they often lack flexibility and struggle with…

Computation and Language · Computer Science 2025-06-18 Georg Niess , Roman Kern

Lightweight cryptography is a novel diversion from conventional cryptography that targets internet-of-things (IoT) platform due to resource constraints. In comparison, it offers smaller cryptographic primitives such as shorter key sizes,…

Cryptography and Security · Computer Science 2021-12-24 Nilupulee A. Gunathilake , Ahmed Al-Dubai , William J. Buchanan , Owen Lo

In addition to signature-based and heuristics-based detection techniques, machine learning (ML) is widely used to generalize to new, never-before-seen malicious software (malware). However, it has been demonstrated that ML models can be…

Cryptography and Security · Computer Science 2022-03-31 Tony Quertier , Benjamin Marais , Stéphane Morucci , Bertrand Fournel

Watermarking techniques are vital for protecting intellectual property and preventing fraudulent use of media. Most previous watermarking schemes designed for diffusion models embed a secret key in the initial noise. The resulting pattern…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Anubhav Jain , Yuya Kobayashi , Naoki Murata , Yuhta Takida , Takashi Shibuya , Yuki Mitsufuji , Niv Cohen , Nasir Memon , Julian Togelius

We study the problem of watermarking large language models (LLMs) generated text -- one of the most promising approaches for addressing the safety challenges of LLM usage. In this paper, we propose a rigorous theoretical framework to…

Computation and Language · Computer Science 2023-10-16 Xuandong Zhao , Prabhanjan Ananth , Lei Li , Yu-Xiang Wang

In recent years, large language models (LLMs) have demonstrated notable success across various tasks, but the trustworthiness of LLMs is still an open problem. One specific threat is the potential to generate toxic or harmful responses.…

Cryptography and Security · Computer Science 2024-06-11 Tong Liu , Yingjie Zhang , Zhe Zhao , Yinpeng Dong , Guozhu Meng , Kai Chen

The rapid advancement of large language models (LLMs) has made it increasingly difficult to distinguish between text written by humans and machines. Addressing this, we propose a novel method for generating watermarks that strategically…

Computation and Language · Computer Science 2024-05-15 Georg Niess , Roman Kern

Although large language models (LLMs) have achieved remarkable advancements, their security remains a pressing concern. One major threat is jailbreak attacks, where adversarial prompts bypass model safeguards to generate harmful or…

Cryptography and Security · Computer Science 2025-05-21 Tiehan Cui , Yanxu Mao , Peipei Liu , Congying Liu , Datao You

A recent and exciting thread of work focuses on developing methods for watermarking the output of large language models (LLMs). We focus on provably undetectable watermarking-that is, schemes that do not alter the output distribution of the…

Cryptography and Security · Computer Science 2026-04-15 Noam Mazor , Andrew Morgan , Rafael Pass

Diffusion-based watermarking methods embed verifiable marks by manipulating the initial noise or the reverse diffusion trajectory. However, these methods share a critical assumption: verification can succeed only if the diffusion trajectory…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Rui Bao , Zheng Gao , Xiaoyu Li , Xiaoyan Feng , Yang Song , Jiaojiao Jiang

Retrieval-augmented agents are increasingly the interface to large organizational knowledge bases, yet most still treat retrieval as a black box: they issue exploratory queries, inspect returned snippets, and iteratively reformulate until…

Information Retrieval · Computer Science 2026-05-08 Zeyu Yang , Qi Ma , Jason Chen , Anshumali Shrivastava

The integration of large language models with external content has enabled applications such as Microsoft Copilot but also introduced vulnerabilities to indirect prompt injection attacks. In these attacks, malicious instructions embedded…

Computation and Language · Computer Science 2025-01-28 Jingwei Yi , Yueqi Xie , Bin Zhu , Emre Kiciman , Guangzhong Sun , Xing Xie , Fangzhao Wu

The widespread adoption of Large Language Model (LLM) in commercial and research settings has intensified the need for robust intellectual property protection. Backdoor-based LLM fingerprinting has emerged as a promising solution for this…

Cryptography and Security · Computer Science 2026-01-09 Hang Fu , Wanli Peng , Yinghan Zhou , Jiaxuan Wu , Juan Wen , Yiming Xue

With the development of deep learning, high-value and high-cost models have become valuable assets, and related intellectual property protection technologies have become a hot topic. However, existing model watermarking work in black-box…

Cryptography and Security · Computer Science 2024-04-16 Na Zhao , Kejiang Chen , Weiming Zhang , Nenghai Yu

The memorization of training data in large language models (LLMs) poses significant privacy and copyright concerns. Existing data extraction methods, particularly heuristic-based divergence attacks, often exhibit limited success and offer…

Computation and Language · Computer Science 2025-11-11 Myeongseob Ko , Nikhil Reddy Billa , Adam Nguyen , Charles Fleming , Ming Jin , Ruoxi Jia

Reinforcement learning (RL) agents often suffer from high sample complexity in sparse or delayed reward settings due to limited prior structure. Large language models (LLMs) can provide subgoal decompositions, plausible trajectories, and…

Machine Learning · Computer Science 2026-02-23 Narjes Nourzad , Carlee Joe-Wong