English
Related papers

Related papers: ShieldNet: Network-Level Guardrails against Emergi…

200 papers

Large Language Models (LLMs) are powerful tools for answering user queries, yet they remain highly vulnerable to jailbreak attacks. Existing guardrail methods typically rely on internal features or textual responses to detect malicious…

Cryptography and Security · Computer Science 2026-05-29 Zikai Zhang , Rui Hu , Olivera Kotevska , Jiahao Xu

Safety risks arise as large language model-based agents solve complex tasks with tools, multi-step plans, and inter-agent messages. However, deployer-written policies in natural language are ambiguous and context dependent, so they map…

Artificial Intelligence · Computer Science 2025-12-19 Yiliu Yang , Yilei Jiang , Qunzhong Wang , Yingshui Tan , Xiaoyong Zhu , Sherman S. M. Chow , Bo Zheng , Xiangyu Yue

Large Language Models (LLMs) have become increasingly vulnerable to jailbreak attacks that circumvent their safety mechanisms. While existing defense methods either suffer from adaptive attacks or require computationally expensive auxiliary…

Computation and Language · Computer Science 2025-03-25 Xunguang Wang , Wenxuan Wang , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Daoyuan Wu , Shuai Wang

Model Context Protocol (MCP) is a rapidly adopted standard for defining and invoking external tools in LLM applications. The multi-layered architecture of MCP introduces new attack surfaces such as tool poisoning, in addition to traditional…

Cryptography and Security · Computer Science 2026-04-21 İpek Abasıkeleş Turgut , Edip Gümüş

As LLMs advance into autonomous agents with tool-use capabilities, they introduce security challenges that extend beyond traditional content-based LLM safety concerns. This paper introduces Sequential Tool Attack Chaining (STAC), a novel…

Cryptography and Security · Computer Science 2026-02-03 Jing-Jing Li , Jianfeng He , Chao Shang , Devang Kulshreshtha , Xun Xian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

Agent skills are increasingly used to extend LLM agents with task-specific instructions, executable scripts, and auxiliary resources. While improving reusability, this modular design also introduces a new supply-chain attack surface: a…

Cryptography and Security · Computer Science 2026-05-19 Xiaojun Jia , Jie Liao , Simeng Qin , Jindong Gu , Wenqi Ren , Xiaochun Cao , Yang Liu , Philip Torr

Large models (LMs) are powerful content generators, yet their open-ended nature can also introduce potential risks, such as generating harmful or biased content. Existing guardrails mostly perform post-hoc detection that may expose unsafe…

Machine Learning · Computer Science 2025-10-14 Xiaodan Li , Mengjie Wu , Yao Zhu , Yunna Lv , YueFeng Chen , Cen Chen , Jianmei Guo , Hui Xue

Cross-chain bridges play a vital role in enabling blockchain interoperability. However, due to the inherent design flaws and the enormous value they hold, they have become prime targets for hacker attacks. Existing detection methods show…

Cryptography and Security · Computer Science 2025-08-29 Dan Lin , Shunfeng Lu , Ziyan Liu , Jiajing Wu , Junyuan Fang , Kaixin Lin , Bowen Song , Zibin Zheng

Guardrail models (a.k.a. safety checkers) are widely deployed to screen user inputs before they reach large language models (LLMs), serving as a primary defense against prompt injection attacks. Due to strict context constraints, these…

Cryptography and Security · Computer Science 2026-05-25 Yuanbo Zhou , Changjia Zhu , Junyu Wang , Xu He , Yan Zhai , Kun Sun , Mingkui Wei , Junjie Xiong

The Model Context Protocol (MCP) standardizes tool use for LLM-based agents and enable third-party servers. This openness introduces a security misalignment: agents implicitly trust tools exposed by potentially untrusted MCP servers.…

Cryptography and Security · Computer Science 2026-02-25 Zhenhong Zhou , Yuanhe Zhang , Hongwei Cai , Moayad Aloqaily , Ouns Bouachir , Linsey Pang , Prakhar Mehrotra , Kun Wang , Qingsong Wen

Prompt attacks, including jailbreaks and prompt injections, pose a critical security risk to Large Language Model (LLM) systems. In production, guardrails must mitigate these attacks under strict low-latency constraints, resulting in a…

Computation and Language · Computer Science 2026-03-27 Hieu Xuan Le , Benjamin Goh , Quy Anh Tang

Retrieval-Augmented Generation (RAG) has significantly enhanced the factual accuracy and domain adaptability of Large Language Models (LLMs). This advancement has enabled their widespread deployment across sensitive domains such as…

Cryptography and Security · Computer Science 2025-04-18 Hongwei Yao , Haoran Shi , Yidou Chen , Yixin Jiang , Cong Wang , Zhan Qin

Agent skills introduce a new and more severe form of indirect injection for LLM agents: unlike traditional indirect prompt injection, attackers can hide malicious instructions inside a dense, action-oriented skill that already functions as…

Cryptography and Security · Computer Science 2026-04-28 Wenjie Xiao , Xuehai Tang , Biyu Zhou , Songlin Hu , Jizhong Han

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

Cryptography and Security · Computer Science 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Detecting prompt injection and jailbreak attacks is critical for deploying LLM-based agents safely. As agents increasingly process untrusted data from emails, documents, tool outputs, and external APIs, robust attack detection becomes…

Machine Learning · Computer Science 2026-02-17 Max Fomin

Evaluating the safety of LLM-based agents is increasingly important because risks in realistic deployments often emerge over multi-step interactions rather than isolated prompts or final responses. Existing trajectory-level benchmarks…

Artificial Intelligence · Computer Science 2026-05-14 Yu Li , Haoyu Luo , Yuejin Xie , Yuqian Fu , Zhonghao Yang , Shuai Shao , Qihan Ren , Wanying Qu , Yanwei Fu , Yujiu Yang , Jing Shao , Xia Hu , Dongrui Liu

Large Language Models (LLMs) have been increasingly integrated into computer-use agents, which can autonomously operate tools on a user's computer to accomplish complex tasks. However, due to the inherently unstable and unpredictable nature…

Cryptography and Security · Computer Science 2025-09-10 Haitao Hu , Peng Chen , Yanpeng Zhao , Yuqi Chen

The rapid advancement of large language model (LLM) agents has raised new concerns regarding their safety and security. In this paper, we propose GuardAgent, the first guardrail agent to protect target agents by dynamically checking whether…

Machine Learning · Computer Science 2025-05-30 Zhen Xiang , Linzhi Zheng , Yanjie Li , Junyuan Hong , Qinbin Li , Han Xie , Jiawei Zhang , Zidi Xiong , Chulin Xie , Carl Yang , Dawn Song , Bo Li

The electric vehicle (EV) battery supply chain's vulnerability to disruptions necessitates advanced predictive analytics. We present SHIELD (Schema-based Hierarchical Induction for EV supply chain Disruption), a system integrating Large…

Artificial Intelligence · Computer Science 2024-10-23 Zhi-Qi Cheng , Yifei Dong , Aike Shi , Wei Liu , Yuzhi Hu , Jason O'Connor , Alexander G. Hauptmann , Kate S. Whitefoot

The Model Context Protocol (MCP) has emerged as a standardized interface enabling seamless integration between Large Language Models (LLMs) and external data sources and tools. While MCP significantly reduces development complexity and…

Cryptography and Security · Computer Science 2025-10-29 Bin Wang , Zexin Liu , Hao Yu , Ao Yang , Yenan Huang , Jing Guo , Huangsheng Cheng , Hui Li , Huiyu Wu