English
Related papers

Related papers: Watermarking Makes Language Models Radioactive

200 papers

To mitigate potential risks associated with language models, recent AI detection research proposes incorporating watermarks into machine-generated text through random vocabulary restrictions and utilizing this information for detection.…

Computation and Language · Computer Science 2024-02-14 Yu Fu , Deyi Xiong , Yue Dong

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

Misinformation regarding climate change is a key roadblock in addressing one of the most serious threats to humanity. This paper investigates factual accuracy in large language models (LLMs) regarding climate information. Using true/false…

Computation and Language · Computer Science 2024-05-31 Michael Fore , Simranjit Singh , Chaehong Lee , Amritanshu Pandey , Antonios Anastasopoulos , Dimitrios Stamoulis

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection…

Social and Information Networks · Computer Science 2023-11-15 Luca Luceri , Eric Boniardi , Emilio Ferrara

We propose a methodology for planting watermarks in text from an autoregressive language model that are robust to perturbations without changing the distribution over text up to a certain maximum generation budget. We generate watermarked…

Machine Learning · Computer Science 2024-06-07 Rohith Kuditipudi , John Thickstun , Tatsunori Hashimoto , Percy Liang

Watermark algorithms for large language models (LLMs) have achieved extremely high accuracy in detecting text generated by LLMs. Such algorithms typically involve adding extra watermark logits to the LLM's logits at each generation step.…

Cryptography and Security · Computer Science 2024-05-21 Aiwei Liu , Leyi Pan , Xuming Hu , Shiao Meng , Lijie Wen

The capabilities of recent large language models (LLMs) to generate high-quality content indistinguishable by humans from human-written texts raises many concerns regarding their misuse. Previous research has shown that LLMs can be…

Computation and Language · Computer Science 2025-07-28 Aneta Zugecova , Dominik Macko , Ivan Srba , Robert Moro , Jakub Kopal , Katarina Marcincinova , Matus Mesarcik

Reinforcement learning (RL) post-training has shown to improve reasoning in large language models (LLMs). However, there has been little exploration on the problem of data contamination in RL post-training, potentially undermining…

Machine Learning · Computer Science 2026-05-29 Minju Gwak , Minseo Kwak , Dongseok Lee , Guijin Son , Alan Ritter , Jaehyung Kim

Recent explorations with commercial Large Language Models (LLMs) have shown that non-expert users can jailbreak LLMs by simply manipulating their prompts; resulting in degenerate output behavior, privacy and security breaches, offensive…

Computation and Language · Computer Science 2024-03-28 Abhinav Rao , Sachin Vashistha , Atharva Naik , Somak Aditya , Monojit Choudhury

Text watermarks in large language models (LLMs) are increasingly used to detect synthetic text, mitigating misuse cases like fake news and academic dishonesty. While existing watermarking detection techniques primarily focus on classifying…

Computation and Language · Computer Science 2025-06-13 Xuandong Zhao , Chenwen Liao , Yu-Xiang Wang , Lei Li

Large Language Models (LLMs) have revolutionized Natural Language Processing (NLP) but pose risks of inadvertently exposing copyrighted or proprietary data, especially when such data is used for training but not intended for distribution.…

Computation and Language · Computer Science 2025-09-16 Guangwei Zhang , Qisheng Su , Jiateng Liu , Cheng Qian , Yanzhou Pan , Yanjie Fu , Denghui Zhang

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Text watermarking algorithms for large language models (LLMs) can effectively identify machine-generated texts by embedding and detecting hidden features in the text. Although the current text watermarking algorithms perform well in most…

Computation and Language · Computer Science 2024-06-11 Yijian Lu , Aiwei Liu , Dianzhi Yu , Jingjing Li , Irwin King

The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As…

Computation and Language · Computer Science 2024-04-22 Junchao Wu , Shu Yang , Runzhe Zhan , Yulin Yuan , Derek F. Wong , Lidia S. Chao

Detecting life-threatening language is essential for safeguarding individuals in distress, promoting mental health and well-being, and preventing potential harm and loss of life. This paper presents an effective approach to identifying…

Computation and Language · Computer Science 2025-06-13 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

The rapid spread of text generated by large language models (LLMs) makes it increasingly difficult to distinguish authentic human writing from machine output. Watermarking offers a promising solution: model owners can embed an imperceptible…

Cryptography and Security · Computer Science 2025-11-04 Shingo Kodama , Haya Diwan , Lucas Rosenblatt , R. Teal Witter , Niv Cohen

It has been shown that finetuned transformers and other supervised detectors effectively distinguish between human and machine-generated text in some situations arXiv:2305.13242, but we find that even simple classifiers on top of n-gram and…

Computation and Language · Computer Science 2024-05-24 Hope McGovern , Rickard Stureborg , Yoshi Suhara , Dimitris Alikaniotis

In a data-driven world, datasets constitute a significant economic value. Dataset owners who spend time and money to collect and curate the data are incentivized to ensure that their datasets are not used in ways that they did not…

Cryptography and Security · Computer Science 2022-02-28 Buse Gul Atli Tekgul , N. Asokan

Reliable evaluation is essential in machine learning research, yet methodological flaws-particularly data leakage-continue to undermine the validity of reported results. In this work, we investigate whether large language models (LLMs) can…

Computation and Language · Computer Science 2026-04-17 Domonkos Varga

The recent surge in jailbreaking attacks has revealed significant vulnerabilities in Large Language Models (LLMs) when exposed to malicious inputs. While various defense strategies have been proposed to mitigate these threats, there has…

Computation and Language · Computer Science 2025-02-24 Tianlong Li , Zhenghua Wang , Wenhao Liu , Muling Wu , Shihan Dou , Changze Lv , Xiaohua Wang , Xiaoqing Zheng , Xuanjing Huang