English
Related papers

Related papers: Trojan Hippo: Weaponizing Agent Memory for Data Ex…

200 papers

AI-agent guardrails are memoryless: each message is judged in isolation, so an adversary who spreads a single attack across dozens of sessions slips past every session-bound detector because only the aggregate carries the payload. We make…

Cryptography and Security · Computer Science 2026-04-24 Ari Azarafrooz

Recent advances in Trajectory Optimization (TO) models have achieved remarkable success in offline reinforcement learning. However, their vulnerabilities against backdoor attacks are poorly understood. We find that existing backdoor attacks…

Machine Learning · Computer Science 2026-05-29 Yang Dai , Oubo Ma , Longfei Zhang , Xingxing Liang , Xiaochun Cao , Shouling Ji , Jiaheng Zhang , Jincai Huang , Li Shen

Advanced Persistent Threats (APTs) represent a growing menace to modern digital infrastructure. Unlike traditional cyberattacks, APTs are stealthy, adaptive, and long-lasting, often bypassing signature-based detection systems. This paper…

Cryptography and Security · Computer Science 2025-08-27 Sidahmed Benabderrahmane , Talal Rahwan

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment…

Cryptography and Security · Computer Science 2025-12-18 Jing Cui , Yufei Han , Jianbin Jiao , Junge Zhang

Large Language Model (LLM)-based agents with function-calling capabilities are increasingly deployed, but remain vulnerable to Indirect Prompt Injection (IPI) attacks that hijack their tool calls. In response, numerous IPI-centric defense…

Cryptography and Security · Computer Science 2025-11-20 Zimo Ji , Xunguang Wang , Zongjie Li , Pingchuan Ma , Yudong Gao , Daoyuan Wu , Xincheng Yan , Tian Tian , Shuai Wang

Large language models (LLMs) have raised concerns about potential security threats despite performing significantly in Natural Language Processing (NLP). Backdoor attacks initially verified that LLM is doing substantial harm at all stages,…

Cryptography and Security · Computer Science 2024-07-09 Pengzhou Cheng , Yidong Ding , Tianjie Ju , Zongru Wu , Wei Du , Ping Yi , Zhuosheng Zhang , Gongshen Liu

Existing AI agent safety benchmarks focus on generic criminal harm (cybercrime, harassment, weapon synthesis), leaving a systematic blind spot for a distinct and commercially consequential threat category: agents harming their own…

Cryptography and Security · Computer Science 2026-04-22 Dongcheng Zhang , Yiqing Jiang

Large language models (LLMs) are increasingly augmented with long-term memory systems to overcome finite context windows and enable persistent reasoning across interactions. However, recent research finds that LLMs become more vulnerable…

Machine Learning · Computer Science 2026-02-18 Mitchell Piehl , Zhaohan Xi , Zuobin Xiong , Pan He , Muchao Ye

Agentic memory enables LLMs to persist information beyond a single context window and reuse it in later decisions, but it also introduces a new vulnerability: spurious correlations, where retrieved memory carries miscorrelated evidence and…

Machine Learning · Computer Science 2026-05-12 Luoxi Tang , Rupali Rajendra Vaje , Yuqiao Meng , Sakshi Sunil Narkar , Weicheng Ma , Zeyu Ding , Dazheng Zhang , Zhaohan Xi

The evolution from static ranking models to Agentic Recommender Systems (Agentic RecSys) empowers AI agents to maintain long-term user profiles and autonomously plan service tasks. While this paradigm shift enhances personalization, it…

Cryptography and Security · Computer Science 2026-04-21 Jiachen Qian

As large language models (LLMs) become integrated into sensitive workflows, concerns grow over their potential to leak confidential information. We propose TrojanStego, a novel threat model in which an adversary fine-tunes an LLM to embed…

Computation and Language · Computer Science 2026-01-08 Dominik Meier , Jan Philip Wahle , Paul Röttger , Terry Ruas , Bela Gipp

As LLM-based agents are increasingly used in long-term interactions, cumulative memory is critical for enabling personalization and maintaining stylistic consistency. However, most existing systems adopt an ``all-or-nothing'' approach to…

Artificial Intelligence · Computer Science 2026-01-09 Muzhao Tian , Zisu Huang , Xiaohua Wang , Jingwen Xu , Zhengkang Guo , Qi Qian , Yuanzhe Shen , Kaitao Song , Jiakang Yuan , Changze Lv , Xiaoqing Zheng

The increasing integration of Large Language Model (LLM) based search engines has transformed the landscape of information retrieval. However, these systems are vulnerable to adversarial attacks, especially ranking manipulation attacks,…

Computation and Language · Computer Science 2025-05-19 Xiyang Hu

Securing AI agents powered by Large Language Models (LLMs) represents one of the most critical challenges in AI security today. Unlike traditional software, AI agents leverage LLMs as their "brain" to autonomously perform actions via…

Cryptography and Security · Computer Science 2025-11-25 Itay Hazan , Yael Mathov , Guy Shtar , Ron Bitton , Itsik Mantin

As large language model (LLM)-powered agents are increasingly deployed to perform complex, real-world tasks, they face a growing class of attacks that exploit extended user-agent-environment interactions to pursue malicious objectives…

Cryptography and Security · Computer Science 2026-05-06 Yuhui Wang , Tanqiu Jiang , Jiacheng Liang , Charles Fleming , Ting Wang

Large language model (LLM) agents achieve impressive single-task performance but commonly exhibit repeated failures, inefficient exploration, and limited cross-task adaptability. Existing reflective strategies (e.g., Reflexion, ReAct)…

Artificial Intelligence · Computer Science 2025-09-09 Chunlong Wu , Ye Luo , Zhibo Qu , Min Wang

Advanced persistent threats (APT) combine a variety of different attack forms ranging from social engineering to technical exploits. The diversity and usual stealthiness of APT turns them into a central problem of contemporary practical…

Cryptography and Security · Computer Science 2022-05-03 Stefan Rass , Sandra König , Stefan Schauer

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

Computation and Language · Computer Science 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo

Memory-augmented LLM agents tackle complex long-horizon tasks by recursively summarizing interaction trajectories into compact memory. However, existing approaches typically train these memory policies using outcome-based reinforcement…

Artificial Intelligence · Computer Science 2026-05-29 Ziyan Liu , Zhezheng Hao , Yeqiu Chen , Hong Wang , Jingren Hou , Ruiyi Ding , Yongkang Yang , Wence Ji , Wei Xia , Feng Liu

Machine learning is becoming increasingly popular as a go-to approach for many tasks due to its world-class results. As a result, antivirus developers are incorporating machine learning models into their products. While these models improve…

Cryptography and Security · Computer Science 2024-03-19 Matouš Kozák , Martin Jureček , Mark Stamp , Fabio Di Troia