English
Related papers

Related papers: Sequential Behavioral Watermarking for LLM Agents

200 papers

Iterative LLM systems(self-refinement, chain-of-thought, autonomous agents) are increasingly deployed, yet their temporal dynamics remain uncharacterized. Prior work evaluates task performance at convergence but ignores the trajectory: how…

Machine Learning · Computer Science 2026-02-02 Nicolas Tacheny

Recent advancements in Large Language Models (LLMs) raised concerns over potential misuse, such as for spreading misinformation. In response two counter measures emerged: machine learning-based detectors that predict if text is synthetic,…

Machine Learning · Computer Science 2025-04-17 David Khachaturov , Robert Mullins , Ilia Shumailov , Sumanth Dathathri

LLM watermarks stand out as a promising way to attribute ownership of LLM-generated text. One threat to watermark credibility comes from spoofing attacks, where an unauthorized third party forges the watermark, enabling it to falsely…

Cryptography and Security · Computer Science 2025-05-23 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Large language models (LLMs) and their applications, such as agents, are highly vulnerable to prompt injection attacks. State-of-the-art prompt injection detection methods have the following limitations: (1) their effectiveness degrades…

Cryptography and Security · Computer Science 2026-04-02 Yanting Wang , Wei Zou , Runpeng Geng , Jinyuan Jia

We introduce the first watermark tailored for diffusion language models (DLMs), an emergent LLM paradigm able to generate tokens in arbitrary order, in contrast to standard autoregressive language models (ARLMs) which generate tokens…

Machine Learning · Computer Science 2026-02-20 Thibaud Gloaguen , Robin Staab , Nikola Jovanović , Martin Vechev

LLMs now exhibit human-like skills in various fields, leading to worries about misuse. Thus, detecting generated text is crucial. However, passive detection methods are stuck in domain specificity and limited adversarial robustness. To…

Computation and Language · Computer Science 2023-05-17 Xi Yang , Kejiang Chen , Weiming Zhang , Chang Liu , Yuang Qi , Jie Zhang , Han Fang , Nenghai Yu

Large Language Models (LLMs) have experienced rapid advancements, with applications spanning a wide range of fields, including sentiment classification, review generation, and question answering. Due to their efficiency and versatility,…

Cryptography and Security · Computer Science 2025-06-17 Yugeng Liu , Tianshuo Cong , Michael Backes , Zheng Li , Yang Zhang

To mitigate the potential harms of Large Language Models (LLMs)generated text, researchers have proposed watermarking, a process of embedding detectable signals within text. With watermarking, we can always accurately detect LLM-generated…

Computation and Language · Computer Science 2025-11-19 William Guo , Adaku Uchendu , Ana Smith

Data watermarking in language models injects traceable signals, such as specific token sequences or stylistic patterns, into copyrighted text, allowing copyright holders to track and verify training data ownership. Previous data…

Cryptography and Security · Computer Science 2025-07-29 Xinyue Cui , Johnny Tian-Zheng Wei , Swabha Swayamdipta , Robin Jia

Watermarking has emerged as a promising way to detect LLM-generated text, by augmenting LLM generations with later detectable signals. Recent work has proposed multiple families of watermarking schemes, several of which focus on preserving…

Cryptography and Security · Computer Science 2025-02-25 Thibaud Gloaguen , Nikola Jovanović , Robin Staab , Martin Vechev

The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty. To address these…

Computation and Language · Computer Science 2024-10-16 Zhenyu Xu , Kun Zhang , Victor S. Sheng

LLM-based agents are emerging as a promising paradigm for simulating user behavior to enhance recommender systems. However, their effectiveness is often limited by existing studies that focus on modeling user ratings for individual items.…

Information Retrieval · Computer Science 2025-11-17 Jiahao Wang , Bokang Fu , Yu Zhu , Yuli Liu

The surge in popularity of large language models (LLMs) has opened doors for new approaches to the creation of interactive agents. However, managing and interpreting the temporal behavior of such agents over the course of a potentially…

Artificial Intelligence · Computer Science 2024-08-29 Raven Rothkopf , Hannah Tongxin Zeng , Mark Santolucito

Watermarking acts as a critical safeguard in text generated by Large Language Models (LLMs). By embedding identifiable signals into model outputs, watermarking enables reliable attribution and enhances the security of machine-generated…

Computation and Language · Computer Science 2026-05-29 Yukang Lin , Jiahao Shao , Shuoran Jiang , Wentao Zhu , Bingjie Lu , Xiangping Wu , Joanna Siebert , Qingcai Chen

Large language models (LLMs) have show great ability in various natural language tasks. However, there are concerns that LLMs are possible to be used improperly or even illegally. To prevent the malicious usage of LLMs, detecting…

Cryptography and Security · Computer Science 2024-04-02 Jie Ren , Han Xu , Yiding Liu , Yingqian Cui , Shuaiqiang Wang , Dawei Yin , Jiliang Tang

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Despite progress in watermarking algorithms for large language models (LLMs), real-world deployment remains limited. We argue that this gap stems from misaligned incentives among LLM providers, platforms, and end users, which manifest as…

Cryptography and Security · Computer Science 2026-04-22 Yepeng Liu , Xuandong Zhao , Dawn Song , Gregory W. Wornell , Yuheng Bu

To be successful, Vision-and-Language Navigation (VLN) agents must be able to ground instructions to actions based on their surroundings. In this work, we develop a methodology to study agent behavior on a skill-specific basis -- examining…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Zijiao Yang , Arjun Majumdar , Stefan Lee