English
Related papers

Related papers: Detecting Benchmark Contamination Through Watermar…

200 papers

A new approach to linguistic watermarking of language models is presented in which information is imperceptibly inserted into the output text while preserving its readability and original meaning. A cross-attention mechanism is used to…

Computation and Language · Computer Science 2024-04-10 Folco Bertini Baldassini , Huy H. Nguyen , Ching-Chung Chang , Isao Echizen

Reasoning Large Language Models (RLLMs) excelling in complex tasks present unique challenges for digital watermarking, as existing methods often disrupt logical coherence or incur high computational costs. Token-based watermarking…

Artificial Intelligence · Computer Science 2026-04-02 Shuliang Liu , Xingyu Li , Hongyi Liu , Dong Fang , Yibo Yan , Bingchen Duan , Qi Zheng , Lingfeng Su , Xuming Hu

This paper introduces a novel problem, distributional information embedding, motivated by the practical demands of multi-bit watermarking for large language models (LLMs). Unlike traditional information embedding, which embeds information…

Cryptography and Security · Computer Science 2025-07-03 Haiyun He , Yepeng Liu , Ziqiao Wang , Yongyi Mao , Yuheng Bu

The rapid progress of text-to-image diffusion models raises significant concerns regarding the unauthorized reproduction of trademarked content. While prior work targets general concepts (e.g., styles, celebrities), it fails to address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Dawid Malarz , Filip Manjak , Maciej Zięba , Przemysław Spurek , Artur Kasymov

The integrity of peer review is fundamental to scientific progress, but the rise of large language models (LLMs) has introduced concerns that some reviewers may rely on these tools to generate reviews rather than writing them independently.…

Digital Libraries · Computer Science 2026-03-13 Vishisht Rao , Aounon Kumar , Himabindu Lakkaraju , Nihar B. Shah

The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty. To address these…

Computation and Language · Computer Science 2024-10-16 Zhenyu Xu , Kun Zhang , Victor S. Sheng

When deploying large language models (LLMs), it is important to ensure that these models are not only capable, but also reliable. Many benchmarks have been created to track LLMs' growing capabilities, however there has been no similar focus…

Machine Learning · Computer Science 2025-02-06 Joshua Vendrow , Edward Vendrow , Sara Beery , Aleksander Madry

The widespread adoption of large language models (LLMs) necessitates reliable methods to detect LLM-generated text. We introduce SimMark, a robust sentence-level watermarking algorithm that makes LLMs' outputs traceable without requiring…

Computation and Language · Computer Science 2025-09-12 Amirhossein Dabiriaghdam , Lele Wang

Text watermarking has emerged as a pivotal technique for identifying machine-generated text. However, existing methods often rely on arbitrary vocabulary partitioning during decoding to embed watermarks, which compromises the availability…

Computation and Language · Computer Science 2024-06-07 Liang Chen , Yatao Bian , Yang Deng , Deng Cai , Shuaiyi Li , Peilin Zhao , Kam-fai Wong

As open-source large language models (LLMs) like Llama3 become more capable, it is crucial to develop watermarking techniques to detect their potential misuse. Existing watermarking methods either add watermarks during LLM inference, which…

Computation and Language · Computer Science 2025-03-18 Yijie Xu , Aiwei Liu , Xuming Hu , Lijie Wen , Hui Xiong

Large language model (LLM) benchmarks inform LLM use decisions (e.g., "is this LLM safe to deploy for my use case and context?"). However, benchmarks may be rendered unreliable by various failure modes that impact benchmark bias, variance,…

The rapid advancement of Large Language Models (LLMs) has significantly enhanced the capabilities of text generators. With the potential for misuse escalating, the importance of discerning whether texts are human-authored or generated by…

Multimedia · Computer Science 2024-03-12 Travis Munyer , Abdullah Tanvir , Arjon Das , Xin Zhong

Text watermarking technology aims to tag and identify content produced by large language models (LLMs) to prevent misuse. In this study, we introduce the concept of cross-lingual consistency in text watermarking, which assesses the ability…

Computation and Language · Computer Science 2024-06-05 Zhiwei He , Binglin Zhou , Hongkun Hao , Aiwei Liu , Xing Wang , Zhaopeng Tu , Zhuosheng Zhang , Rui Wang

Recent claims about the impressive abilities of large language models (LLMs) are often supported by evaluating publicly available benchmarks. Since LLMs train on wide swaths of the internet, this practice raises concerns of data…

Computation and Language · Computer Science 2023-10-17 Manley Roberts , Himanshu Thakur , Christine Herlihy , Colin White , Samuel Dooley

The rise of LLMs has increased concerns over source tracing and copyright protection for AIGC, highlighting the need for advanced detection technologies. Passive detection methods usually face high false positives, while active watermarking…

Cryptography and Security · Computer Science 2026-04-03 Kahim Wong , Jicheng Zhou , Jiantao Zhou , Yain-Whar Si

In recent years, large language models (LLMs) have achieved remarkable performances in various NLP tasks. They can generate texts that are indistinguishable from those written by humans. Such remarkable performance of LLMs increases their…

Computation and Language · Computer Science 2025-02-18 Yuki Takezawa , Ryoma Sato , Han Bao , Kenta Niwa , Makoto Yamada

The performance of large language models (LLMs) continues to improve, as reflected in rising scores on standard benchmarks. However, the lack of transparency around training data raises concerns about potential overlap with evaluation sets…

Computation and Language · Computer Science 2025-06-02 Naila Shafirni Hidayat , Muhammad Dehan Al Kautsar , Alfan Farizki Wicaksono , Fajri Koto

As large language models (LLMs) reach human-like fluency, reliably distinguishing AI-generated text from human authorship becomes increasingly difficult. While watermarks already exist for LLMs, they often lack flexibility and struggle with…

Computation and Language · Computer Science 2025-06-18 Georg Niess , Roman Kern

With the advancement of intelligent healthcare, medical pre-trained language models (Med-PLMs) have emerged and demonstrated significant effectiveness in downstream medical tasks. While these models are valuable assets, they are vulnerable…

Machine Learning · Computer Science 2025-04-16 Cong Kong , Rui Xu , Weixi Chen , Jiawei Chen , Zhaoxia Yin

Text watermarking algorithms are crucial for protecting the copyright of textual content. Historically, their capabilities and application scenarios were limited. However, recent advancements in large language models (LLMs) have…

Computation and Language · Computer Science 2024-08-12 Aiwei Liu , Leyi Pan , Yijian Lu , Jingjing Li , Xuming Hu , Xi Zhang , Lijie Wen , Irwin King , Hui Xiong , Philip S. Yu