English
Related papers

Related papers: Watermarking LLM Agent Trajectories

200 papers

The rapid advancement of large language model (LLM) agents has raised new concerns regarding their safety and security. In this paper, we propose GuardAgent, the first guardrail agent to protect target agents by dynamically checking whether…

Machine Learning · Computer Science 2025-05-30 Zhen Xiang , Linzhi Zheng , Yanjie Li , Junyuan Hong , Qinbin Li , Han Xie , Jiawei Zhang , Zidi Xiong , Chulin Xie , Carl Yang , Dawn Song , Bo Li

Drug discovery frequently loses momentum when data, expertise, and tools are scattered, slowing design cycles. To shorten this loop we built a hierarchical, tool using agent framework that automates molecular optimisation. A Principal…

Machine Learning · Computer Science 2025-08-06 Atabey Ünlü , Phil Rohr , Ahmet Celebi

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Software development agents powered by large language models (LLMs) have shown great promise in automating tasks like environment setup, issue solving, and program repair. Unfortunately, understanding and debugging such agents remain…

Software Engineering · Computer Science 2026-02-09 Robert Hutter , Michael Pradel

The rapid development of LLMs has raised concerns about their potential misuse, leading to various watermarking schemes that typically offer high detectability. However, existing watermarking techniques often face trade-off between…

Cryptography and Security · Computer Science 2025-10-21 Chenrui Wang , Junyi Shu , Billy Chiu , Yu Li , Saleh Alharbi , Min Zhang , Jing Li

This paper introduces a methodology based on agentic workflows for economic research that leverages Large Language Models (LLMs) and multimodal AI to enhance research efficiency and reproducibility. Our approach features autonomous and…

General Economics · Economics 2025-04-15 Herbert Dawid , Philipp Harting , Hankui Wang , Zhongli Wang , Jiachen Yi

Large Language Model (LLM) agents show considerable promise for automating complex tasks using contextual reasoning; however, interactions involving multiple agents and the system's susceptibility to prompt injection and other forms of…

Cryptography and Security · Computer Science 2025-06-02 Kaiyuan Zhang , Zian Su , Pin-Yu Chen , Elisa Bertino , Xiangyu Zhang , Ninghui Li

AI agents that leverage Large Language Models (LLMs) are increasingly becoming core building blocks of modern software systems. A wide range of frameworks is now available to support the specification of such applications. These frameworks…

Artificial Intelligence · Computer Science 2025-11-04 Fabiana Fournier , Lior Limonad , Yuval David

Large Language Models (LLMs) have revolutionized intelligent application development. While standalone LLMs cannot perform any actions, LLM agents address the limitation by integrating tools. However, debugging LLM agents is difficult and…

Software Engineering · Computer Science 2026-04-28 Niful Islam , Ragib Shahriar Ayon , Deepak George Thomas , Shibbir Ahmed , Mohammad Wardat

Federated Language Model (FedLM) allows a collaborative learning without sharing raw data, yet it introduces a critical vulnerability, as every untrustworthy client may leak the received functional model instance. Current watermarking…

Cryptography and Security · Computer Science 2026-03-13 Haodong Zhao , Jinming Hu , Yijie Bai , Tian Dong , Wei Du , Zhuosheng Zhang , Yanjiao Chen , Haojin Zhu , Gongshen Liu

Since ChatGPT was introduced in November 2022, embedding (nearly) unnoticeable statistical signals into text generated by large language models (LLMs), also known as watermarking, has been used as a principled approach to provable detection…

Statistics Theory · Mathematics 2025-08-28 Xiang Li , Feng Ruan , Huiyuan Wang , Qi Long , Weijie J. Su

The widespread adoption of large language models (LLMs) necessitates reliable methods to detect LLM-generated text. We introduce SimMark, a robust sentence-level watermarking algorithm that makes LLMs' outputs traceable without requiring…

Computation and Language · Computer Science 2025-09-12 Amirhossein Dabiriaghdam , Lele Wang

Agentic security systems increasingly combine LLM planners with tools that can discover, validate, and report vulnerabilities. This creates an asymmetric control problem: the system should retain strong offensive capability inside an…

Cryptography and Security · Computer Science 2026-05-04 Isaac David , Marco Guarnieri , Arthur Gervais

Watermarking generative-AI systems, such as LLMs, has gained considerable interest, driven by their enhanced capabilities across a wide range of tasks. Although current approaches have demonstrated that small, context-dependent shifts in…

Computation and Language · Computer Science 2024-03-29 Piotr Molenda , Adian Liusie , Mark J. F. Gales

AI agent development relies heavily on natural language prompting to define agents' tasks, knowledge, and goals. These prompts are interpreted by Large Language Models (LLMs), which govern agent behavior. Consequently, agentic performance…

Artificial Intelligence · Computer Science 2026-04-14 Roi Ben-Gigi , Yuval David , Fabiana Fournier , Lior Limonad , Dany Moshkovich , Hadar Mulian , Segev Shlomov

Large language model (LLM) agents have demonstrated strong capabilities across diverse domains, yet automated agent design remains a significant challenge. Current automated agent design approaches are often constrained by limited search…

Computation and Language · Computer Science 2025-11-21 Yu Li , Lehui Li , Zhihao Wu , Qingmin Liao , Jianye Hao , Kun Shao , Fengli Xu , Yong Li

With the increasing adoption of large language models (LLM), agentic workflows, which compose multiple LLM calls with tools, retrieval, and reasoning steps, are increasingly replacing traditional applications. However, such workflows are…

Multiagent Systems · Computer Science 2025-11-04 Yeonju Ro , Haoran Qiu , Íñigo Goiri , Rodrigo Fonseca , Ricardo Bianchini , Aditya Akella , Zhangyang Wang , Mattan Erez , Esha Choukse

LLM-based code assistants are becoming increasingly popular among developers. These tools help developers improve their coding efficiency and reduce errors by providing real-time suggestions based on the developer's codebase. While…

Cryptography and Security · Computer Science 2024-10-30 Amit Finkman Noah , Avishag Shapira , Eden Bar Kochva , Inbar Maimon , Dudu Mimran , Yuval Elovici , Asaf Shabtai

LLM agents increasingly perform end-to-end ML engineering tasks where success is judged by a single scalar test metric. This creates a structural vulnerability: an agent can increase the reported score by compromising the evaluation…

Artificial Intelligence · Computer Science 2026-03-13 Yonas Atinafu , Robin Cohen

Agent orchestration frameworks have proliferated, collectively exceeding 290,000 GitHub stars across LangGraph, CrewAI, Google ADK, OpenAI Agents SDK, Semantic Kernel, Strands, and LlamaIndex. All follow the same pattern: an external…

Artificial Intelligence · Computer Science 2026-05-22 Simon Dennis , Rivaan Patil , Kevin Shabahang , Hao Guo