中文
相关论文

相关论文: MAGE: Safeguarding LLM Agents against Long-Horizon…

200 篇论文

Large Language Model (LLM) agents have demonstrated remarkable proficiency in learned tasks, yet they often struggle to adapt to non-stationary environments with feedback. While In-Context Learning and external memory offer some…

人工智能 · 计算机科学 2026-03-05 Lu Yang , Zelai Xu , Minyang Xie , Jiaxuan Gao , Zhao Shok , Yu Wang , Yi Wu

Large Language Models (LLMs) have shown impressive capabilities across various tasks but remain vulnerable to meticulously crafted jailbreak attacks. In this paper, we identify a critical safety gap: while LLMs are adept at detecting…

计算与语言 · 计算机科学 2025-05-20 Peng Ding , Jun Kuang , Zongyu Wang , Xuezhi Cao , Xunliang Cai , Jiajun Chen , Shujian Huang

The rapid advancements in Large Language Models (LLMs) have enabled their deployment as autonomous agents for handling complex tasks in dynamic environments. These LLMs demonstrate strong problem-solving capabilities and adaptability to…

人工智能 · 计算机科学 2025-02-19 Weidi Luo , Shenghong Dai , Xiaogeng Liu , Suman Banerjee , Huan Sun , Muhao Chen , Chaowei Xiao

Large Language Model based multi-agent systems are revolutionizing autonomous communication and collaboration, yet they remain vulnerable to security threats like unauthorized access and data breaches. To address this, we introduce…

人工智能 · 计算机科学 2025-07-09 Junyuan Mao , Fanci Meng , Yifan Duan , Miao Yu , Xiaojun Jia , Junfeng Fang , Yuxuan Liang , Kun Wang , Qingsong Wen

The rapid advancement of large language model (LLM) agents has raised new concerns regarding their safety and security. In this paper, we propose GuardAgent, the first guardrail agent to protect target agents by dynamically checking whether…

机器学习 · 计算机科学 2025-05-30 Zhen Xiang , Linzhi Zheng , Yanjie Li , Junyuan Hong , Qinbin Li , Han Xie , Jiawei Zhang , Zidi Xiong , Chulin Xie , Carl Yang , Dawn Song , Bo Li

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

密码学与安全 · 计算机科学 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Recent advances in foundation models have transformed LLMs from passive conversational systems into autonomous agents capable of reasoning and tool execution. While these capabilities unlock substantial practical value, they also introduce…

密码学与安全 · 计算机科学 2026-05-25 Zhe Liu , Zonghao Ying , Wenxin Zhang , Quanchen Zou , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Hao Peng

Long-term memory has emerged as a foundational component of autonomous Large Language Model (LLM) agents, enabling continuous adaptation, lifelong multimodal learning, and sophisticated reasoning. However, as memory systems transition from…

人工智能 · 计算机科学 2026-05-20 Chingkwun Lam , Jiaxin Li , Lingfei Zhang , Kuo Zhao

Retrieval-augmented generation (RAG) has become the default strategy for providing large language model (LLM) agents with contextual knowledge. Yet RAG treats memory as a stateless lookup table: information persists indefinitely, retrieval…

人工智能 · 计算机科学 2026-01-16 Joe Logan

Memory retrieval in agentic large language model (LLM) systems is often treated as a static lookup problem, relying on flat vector search or fixed binary relational graphs. However, fixed graph structures cannot capture the varying…

人工智能 · 计算机科学 2026-05-12 Dongming Jiang , Yi Li , Guanpeng Li , Qiannan Li , Bingzhe Li

Large Language Models (LLMs) are increasingly used as autonomous agents in complex, long-horizon applications, where effective memory is critical for sustained performance. Yet existing memory benchmarks are largely dialogue-centric, while…

When combining Large Language Models (LLMs) with autonomous agents, used in network monitoring and decision-making systems, this will create serious security issues. In this research, the MAESTRO framework consisting of the seven layers…

密码学与安全 · 计算机科学 2025-08-15 Pallavi Zambare , Venkata Nikhil Thanikella , Ying Liu

The performance of large language model (LLM) agents depends critically on the execution harness, the system layer that orchestrates tool use, context management, and state persistence. Yet this same architectural centrality makes the…

密码学与安全 · 计算机科学 2026-05-12 Xixun Lin , Yang Liu , Yancheng Chen , Yongxuan Wu , Yucheng Ning , Yilong Liu , Nan Sun , Shun Zhang , Bin Chong , Chuan Zhou , Yanan Cao

Large Language Models (LLMs) serve as the backbone of modern AI systems, yet they remain susceptible to adversarial jailbreak attacks. Consequently, robust detection of such malicious inputs is paramount for ensuring model safety.…

密码学与安全 · 计算机科学 2026-01-13 Jun Leng , Yu Liu , Litian Zhang , Ruihan Hu , Zhuting Fang , Xi Zhang

LLM agents are increasingly deployed in long-horizon, complex environments to solve challenging problems, but this expansion exposes them to long-horizon attacks that exploit multi-turn user-agent-environment interactions to achieve…

人工智能 · 计算机科学 2026-02-20 Tanqiu Jiang , Yuhui Wang , Jiacheng Liang , Ting Wang

Research on large language model (LLM) security is shifting from "will the model leak training data" to a more consequential question: can an agent with persistent, long-term memory be continuously shaped, cross-session poisoned, accessed…

密码学与安全 · 计算机科学 2026-04-21 Zehao Lin , Chunyu Li , Kai Chen

Large Language Models (LLMs) guardrail systems are designed to protect against prompt injection and jailbreak attacks. However, they remain vulnerable to evasion techniques. We demonstrate two approaches for bypassing LLM prompt injection…

密码学与安全 · 计算机科学 2025-07-15 William Hackett , Lewis Birch , Stefan Trawicki , Neeraj Suri , Peter Garraghan

Large language models (LLMs) are rapidly evolving from single-modal systems to multimodal LLMs and intelligent agents, significantly expanding their capabilities while introducing increasingly severe security risks. This paper presents a…

密码学与安全 · 计算机科学 2025-08-04 Yanxu Mao , Tiehan Cui , Peipei Liu , Datao You , Hongsong Zhu

Agentic AI systems introduce a security surface that is qualitatively different from that of stateless LLMs. They persist memory, invoke external tools, coordinate with peer agents, and operate across sessions, allowing attacks to emerge…

密码学与安全 · 计算机科学 2026-05-07 Kexin Chu

Long-term memory is becoming a central bottleneck for language agents. Exsting RAG and GraphRAG systems largely treat memory graphs as static retrieval middleware, which limits their ability to recover complete evidence chains from partial…

人工智能 · 计算机科学 2026-05-13 Juntong Wang , Haoyue Zhao , guanghui Pan , Xiyuan Wang , Yanbo Wang , Qiyan Deng , Muhan Zhang
‹ 上一页 1 2 3 10 下一页 ›