English
Related papers

Related papers: Factuality Beyond Coherence: Evaluating LLM Waterm…

200 papers

Text watermarking algorithms for large language models (LLMs) can effectively identify machine-generated texts by embedding and detecting hidden features in the text. Although the current text watermarking algorithms perform well in most…

Computation and Language · Computer Science 2024-06-11 Yijian Lu , Aiwei Liu , Dianzhi Yu , Jingjing Li , Irwin King

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

Cryptography and Security · Computer Science 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

Watermarking has emerged as a promising technique for detecting texts generated by LLMs. Current research has primarily focused on three design criteria: high quality of the watermarked text, high detectability, and robustness against…

Cryptography and Security · Computer Science 2025-04-11 Li An , Yujian Liu , Yepeng Liu , Yang Zhang , Yuheng Bu , Shiyu Chang

We present a study to benchmark representative watermarking methods in cross-lingual settings. The current literature mainly focuses on the evaluation of watermarking methods for the English language. However, the literature for evaluating…

Computation and Language · Computer Science 2025-09-09 Mansour Al Ghanim , Jiaqi Xue , Rochana Prih Hastuti , Mengxin Zheng , Yan Solihin , Qian Lou

Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising method for addressing potential harm and biases from LLMs,…

Cryptography and Security · Computer Science 2024-12-09 Lingjie Chen , Ruizhong Qiu , Siyu Yuan , Zhining Liu , Tianxin Wei , Hyunsik Yoo , Zhichen Zeng , Deqing Yang , Hanghang Tong

The development of large language models (LLMs) has raised concerns about potential misuse. One practical solution is to embed a watermark in the text, allowing ownership verification through watermark extraction. Existing methods primarily…

Cryptography and Security · Computer Science 2025-03-04 Yuhang Cai , Yaofei Wang , Donghui Hu , Chen Gu

Large Language Models (LLMs) excel in various applications, including text generation and complex tasks. However, the misuse of LLMs raises concerns about the authenticity and ethical implications of the content they produce, such as…

Cryptography and Security · Computer Science 2024-12-02 Zesen Liu , Tianshuo Cong , Xinlei He , Qi Li

Large language models (LLMs) have been widely adopted in various downstream task domains. However, their abilities to directly recall and apply factual medical knowledge remains under-explored. Most existing medical QA benchmarks assess…

Computation and Language · Computer Science 2025-08-20 Jiaxi Li , Yiwei Wang , Kai Zhang , Yujun Cai , Bryan Hooi , Nanyun Peng , Kai-Wei Chang , Jin Lu

Text watermarking has emerged as a pivotal technique for identifying machine-generated text. However, existing methods often rely on arbitrary vocabulary partitioning during decoding to embed watermarks, which compromises the availability…

Computation and Language · Computer Science 2024-06-07 Liang Chen , Yatao Bian , Yang Deng , Deng Cai , Shuaiyi Li , Peilin Zhao , Kam-fai Wong

Large language models (LLMs) have demonstrated outstanding performance, making them valuable digital assets with significant commercial potential. Unfortunately, the LLM and its API are susceptible to intellectual property theft.…

Cryptography and Security · Computer Science 2024-07-25 Shuai Li , Kejiang Chen , Kunsheng Tang , Jie Zhang , Weiming Zhang , Nenghai Yu , Kai Zeng

As LLMs become commonplace, machine-generated text has the potential to flood the internet with spam, social media bots, and valueless content. Watermarking is a simple and effective strategy for mitigating such harms by enabling the…

Text watermarks in large language models (LLMs) are increasingly used to detect synthetic text, mitigating misuse cases like fake news and academic dishonesty. While existing watermarking detection techniques primarily focus on classifying…

Computation and Language · Computer Science 2025-06-13 Xuandong Zhao , Chenwen Liao , Yu-Xiang Wang , Lei Li

The strong general capabilities of Large Language Models (LLMs) bring potential ethical risks if they are unrestrictedly accessible to malicious users. Token-level watermarking inserts watermarks in the generated texts by altering the token…

Computation and Language · Computer Science 2023-11-17 Yuhang Li , Yihan Wang , Zhouxing Shi , Cho-Jui Hsieh

With the increasing use of large language models (LLMs) in daily life, concerns have emerged regarding their potential misuse and societal impact. Watermarking is proposed to trace the usage of specific models by injecting patterns into…

Cryptography and Security · Computer Science 2024-05-24 Baizhou Huang , Xiaojun Wan

The rapid development of LLMs has raised concerns about their potential misuse, leading to various watermarking schemes that typically offer high detectability. However, existing watermarking techniques often face trade-off between…

Cryptography and Security · Computer Science 2025-10-21 Chenrui Wang , Junyi Shu , Billy Chiu , Yu Li , Saleh Alharbi , Min Zhang , Jing Li

As LLMs are increasingly integrated into clinical workflows, their tendency for sycophancy, prioritizing user agreement over factual accuracy, poses significant risks to patient safety. While existing evaluations often rely on subjective…

Computation and Language · Computer Science 2026-01-27 Clément Christophe , Wadood Mohammed Abdul , Prateek Munjal , Tathagata Raha , Ronnie Rajan , Praveenkumar Kanithi

Watermarking by altering token sampling probabilities based on red-green list is a promising method for tracing the origin of text generated by large language models (LLMs). However, existing watermark methods often struggle with a…

Cryptography and Security · Computer Science 2025-05-21 Zongqi Wang , Tianle Gu , Baoyuan Wu , Yujiu Yang

Hallucinated outputs from large language models (LLMs) pose risks in the medical domain, especially for lay audiences making health-related decisions. Existing automatic factual consistency evaluation methods, such as entailment- and…

Computation and Language · Computer Science 2026-03-20 Zhiwen You , Yue Guo

Summarizing consumer health questions (CHQs) can ease communication in healthcare, but unfaithful summaries that misrepresent medical details pose serious risks. We propose a framework that combines TextRank-based sentence extraction and…

Computation and Language · Computer Science 2025-11-17 Ajwad Abrar , Nafisa Tabassum Oeshy , Prianka Maheru , Farzana Tabassum , Tareque Mohmud Chowdhury

Amidst rising concerns about the internet being proliferated with content generated from language models (LMs), watermarking is seen as a principled way to certify whether text was generated from a model. Many recent watermarking techniques…

Cryptography and Security · Computer Science 2024-11-11 Saksham Rastogi , Danish Pruthi