中文
相关论文

相关论文: What Happens Inside Agent Memory? Circuit Analysis…

200 篇论文

Large Language Models (LLMs), despite their impressive capabilities, often fail to accurately repeat a single word when prompted to, and instead output unrelated text. This unexplained failure mode represents a vulnerability, allowing even…

机器学习 · 计算机科学 2025-03-13 Itay Yona , Ilia Shumailov , Jamie Hayes , Federico Barbero , Yossi Gandelsman

Multi-Agentic AI systems, powered by large language models (LLMs), are inherently non-deterministic and prone to silent failures such as drift, cycles, and missing details in outputs, which are difficult to detect. We introduce the task of…

人工智能 · 计算机科学 2025-11-07 Divya Pathak , Harshit Kumar , Anuska Roy , Felix George , Mudit Verma , Pratibha Moogi

LLMs can perform seemingly planning-intensive tasks, like writing coherent stories or functioning code, without explicitly verbalizing a plan; however, the extent to which they implicitly plan is unknown. In this paper, we define latent…

计算与语言 · 计算机科学 2026-04-15 Michael Hanna , Emmanuel Ameisen

Memory-augmented LLM agents maintain external memory banks to support long-horizon interaction, yet most existing systems treat construction, retrieval, and utilization as isolated subroutines. This creates two coupled challenges: strategic…

人工智能 · 计算机科学 2026-03-20 Minhua Lin , Zhiwei Zhang , Hanqing Lu , Hui Liu , Xianfeng Tang , Qi He , Xiang Zhang , Suhang Wang

Can LLM agents explore codebases and reason about code semantics without executing the code? We study this capability, which we call agentic code reasoning, and introduce semi-formal reasoning: a structured prompting methodology that…

软件工程 · 计算机科学 2026-03-05 Shubham Ugare , Satish Chandra

Large audio language models (LALMs) process both speech and environmental acoustic cues, yet struggle to retain non-speech information across multi-turn interactions. The performance gap between semantic (speech) and acoustic (non-speech)…

音频与语音处理 · 电气工程与系统科学 2026-05-27 Yang Xiao , Siyi Wang , Han Yin , Hong Jia , Vidhyasaharan Sethu , Eun-Jung Holden , Ting Dang

LLM-based agents increasingly operate in persistent environments where they must store, update, and reason over information across many sessions. While prior benchmarks evaluate only single-entity updates, MEME defines six tasks spanning…

机器学习 · 计算机科学 2026-05-13 Seokwon Jung , Alexander Rubinstein , Arnas Uselis , Sangdoo Yun , Seong Joon Oh

We introduce MemLineage, a defense for LLM agent memory that attaches both cryptographic provenance and LLM-mediated derivation lineage to every entry. Recent and concurrent work shows that untrusted content can be written into persistent…

密码学与安全 · 计算机科学 2026-05-15 Ciyan Ouyang , Rui Hou

Memory is a central capability for LLM agents operating across long-horizon tasks. Existing memory benchmarks predominantly evaluate retention of personalized information in multi-turn chat scenarios, overlooking the dynamic memory…

Modern agentic frameworks (e.g., CrewAI and AutoGen) have evolved into complex, autonomous multi-agent systems, introducing unique reliability challenges beyond earlier pipeline-based LLM libraries. However, existing empirical studies focus…

软件工程 · 计算机科学 2026-04-13 Xiaowen Zhang , Hannuo Zhang , Shin Hwei Tan

Autonomous LLM agents operate as long-running processes with persistent workspaces, memory files, scheduled task state, and messaging integrations. These features create a new propagation risk: attacker-influenced content can be written…

密码学与安全 · 计算机科学 2026-05-05 Mingming Zha , Xiaofeng Wang

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

软件工程 · 计算机科学 2025-10-09 Islem Bouzenia , Michael Pradel

Inspired by the cognitive science theory of the explicit human memory systems, we have modeled an agent with short-term, episodic, and semantic memory systems, each of which is modeled with a knowledge graph. To evaluate this system and…

人工智能 · 计算机科学 2026-05-19 Taewoon Kim , Michael Cochez , Vincent François-Lavet , Mark Neerincx , Piek Vossen

Memory plays a pivotal role in enabling large language model~(LLM)-based agents to engage in complex and long-term interactions, such as question answering (QA) and dialogue systems. While various memory modules have been proposed for these…

计算与语言 · 计算机科学 2024-12-23 Ruihong Zeng , Jinyuan Fang , Siwei Liu , Zaiqiao Meng

Modern LLM based agents are no longer passive text generators. They read repositories, call tools, browse the web, execute code, maintain memory, communicate with other agents, and act through long horizon workflows. This shift moves the…

多智能体系统 · 计算机科学 2026-05-12 Tianxiao Li , Yixing Ma , Haiquan Wen , Zhenglin Huang , Qianyu Zhou , Zeyu Fu , Guangliang Cheng

For LLM agents, memory management critically impacts efficiency, quality, and security. While much research focuses on retention, selective forgetting--inspired by human cognitive processes (hippocampal indexing/consolidation theory and…

人工智能 · 计算机科学 2026-04-24 Yingjie Gu , Wenjian Xiong , Liqiang Wang , Pengcheng Ren , Chao Li , Xiaojing Zhang , Yijuan Guo , Qi Sun , Jingyao Ma , Shidang Shi

We stress test monitoring systems for detecting covert misbehavior in autonomous LLM agents (e.g., secretly sharing private information). To this end, we systematize a monitor red teaming (MRT) workflow that incorporates: (1) varying levels…

Rapidly evolving cyberattacks demand incident response systems that can autonomously learn and adapt to changing threats. Prior work has extensively explored the reinforcement learning approach, which involves learning response strategies…

密码学与安全 · 计算机科学 2026-04-16 Yiran Gao , Kim Hammar , Tao Li

A common problem for agents operating in real-world environments is that the response of an environment to their actions may be non-deterministic and observed through noise. This renders environmental state and progress towards completing a…

人工智能 · 计算机科学 2024-05-21 William E Bishop , Alice Li , Christopher Rawles , Oriana Riva

Transformer-based language models excel at both recall (retrieving memorized facts) and reasoning (performing multi-step inference), but whether these abilities rely on distinct internal mechanisms remains unclear. Distinguishing recall…