中文
相关论文

相关论文: Plant, Persist, Trigger: Sleeper Attack on Large L…

200 篇论文

Large language model (LLM) agents execute tasks through multi-step workflows that combine planning, memory, and tool use. While this design enables autonomy, it also expands the attack surface for backdoor threats. Backdoor triggers…

人工智能 · 计算机科学 2026-01-13 Yunhao Feng , Yige Li , Yutao Wu , Yingshui Tan , Yanming Guo , Yifan Ding , Kun Zhai , Xingjun Ma , Yu-Gang Jiang

Attacks powered by Large Language Model (LLM) agents represent a growing threat to modern cybersecurity. To address this concern, we present LLM Honeypot, a system designed to monitor autonomous AI hacking agents. By augmenting a standard…

密码学与安全 · 计算机科学 2025-02-12 Reworr , Dmitrii Volkov

With the significant development of large models in recent years, Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across a wide range of multimodal understanding and reasoning tasks. Compared to traditional…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Daizong Liu , Mingyu Yang , Xiaoye Qu , Pan Zhou , Yu Cheng , Wei Hu

Self-evolving LLM agents update their internal state across sessions, often by writing and reusing long-term memory. This design improves performance on long-horizon tasks but creates a security risk: untrusted external content observed…

密码学与安全 · 计算机科学 2026-03-06 Xianglin Yang , Yufei He , Shuo Ji , Bryan Hooi , Jin Song Dong

Large language models (LLMs) are now routinely used to autonomously execute complex tasks, from natural language processing to dynamic workflows like web searches. The usage of tool-calling and Retrieval Augmented Generation (RAG) allows…

密码学与安全 · 计算机科学 2026-04-13 Dennis Rall , Bernhard Bauer , Mohit Mittal , Thomas Fraunholz

Large Language Models (LLMs) are increasingly used in education, yet their default helpfulness often conflicts with pedagogical principles. Prior work evaluates pedagogical quality via answer leakage-the disclosure of complete solutions…

密码学与安全 · 计算机科学 2026-04-22 Jin Zhao , Marta Knežević , Tanja Käser

It has recently been shown that adversarial attacks on large language models (LLMs) can "jailbreak" the model into making harmful statements. In this work, we argue that the spectrum of adversarial attacks on LLMs is much larger than merely…

机器学习 · 计算机科学 2024-02-22 Jonas Geiping , Alex Stein , Manli Shu , Khalid Saifullah , Yuxin Wen , Tom Goldstein

Large Language Models (LLMs), now a foundation in advancing natural language processing, power applications such as text generation, machine translation, and conversational systems. Despite their transformative potential, these models…

密码学与安全 · 计算机科学 2025-08-05 Kang Chen , Xiuze Zhou , Yuanguo Lin , Jinhe Su , Yuanhui Yu , Li Shen , Fan Lin

Large Language Models (LLMs) are valuable for text classification, but their vulnerabilities must not be disregarded. They lack robustness against adversarial examples, so it is pertinent to understand the impacts of different types of…

计算与语言 · 计算机科学 2024-06-13 João Vitorino , Eva Maia , Isabel Praça

As AI agents powered by Large Language Models (LLMs) become increasingly versatile and capable of addressing a broad spectrum of tasks, ensuring their security has become a critical challenge. Among the most pressing threats are prompt…

The development of large language models (LLMs) has entered in a experience-driven era, flagged by the emergence of environment feedback-driven learning via reinforcement learning and tool-using agents. This encourages the emergenece of…

机器学习 · 计算机科学 2025-06-17 Junfeng Fang , Zijun Yao , Ruipeng Wang , Haokai Ma , Xiang Wang , Tat-Seng Chua

Large Language Model (LLM) agents can leverage tools such as Google Search to complete complex tasks. However, this tool usage introduces the risk of indirect prompt injections, where malicious instructions hidden in tool outputs can…

Large language models (LLMs) have significantly transformed the landscape of Natural Language Processing (NLP). Their impact extends across a diverse spectrum of tasks, revolutionizing how we approach language understanding and generations.…

密码学与安全 · 计算机科学 2025-06-13 Sara Abdali , Richard Anarfi , CJ Barberan , Jia He , Erfan Shayegani

Recent studies demonstrate that Large Language Models (LLMs) are vulnerable to different prompt-based attacks, generating harmful content or sensitive information. Both closed-source and open-source LLMs are underinvestigated for these…

密码学与安全 · 计算机科学 2025-05-21 Jiawen Wang , Pritha Gupta , Ivan Habernal , Eyke Hüllermeier

LLM-based agents increasingly operate across repeated sessions, maintaining task states to ensure continuity. In many deployments, a single agent serves multiple users within a team or organization, reusing a shared knowledge layer across…

计算与语言 · 计算机科学 2026-04-03 Tiankai Yang , Jiate Li , Yi Nian , Shen Dong , Ruiyao Xu , Ryan Rossi , Kaize Ding , Yue Zhao

The Large Language Models (LLMs) are poised to offer efficient and intelligent services for future mobile communication networks, owing to their exceptional capabilities in language comprehension and generation. However, the extremely high…

密码学与安全 · 计算机科学 2023-09-07 Haomiao Yang , Kunlan Xiang , Mengyu Ge , Hongwei Li , Rongxing Lu , Shui Yu

Large language models (LLMs) have achieved record adoption in a short period of time across many different sectors including high importance areas such as education [4] and healthcare [23]. LLMs are open-ended models trained on diverse data…

密码学与安全 · 计算机科学 2024-12-24 Herve Debar , Sven Dietrich , Pavel Laskov , Emil C. Lupu , Eirini Ntoutsi

Large Language Models (LLMs) have shown exceptional results on current benchmarks when working individually. The advancement in their capabilities, along with a reduction in parameter size and inference times, has facilitated the use of…

计算与语言 · 计算机科学 2024-06-27 Alfonso Amayuelas , Xianjun Yang , Antonis Antoniades , Wenyue Hua , Liangming Pan , William Wang

Most discussions about Large Language Model (LLM) safety have focused on single-agent settings but multi-agent LLM systems now create novel adversarial risks because their behavior depends on communication between agents and decentralized…

多智能体系统 · 计算机科学 2025-10-10 Rana Muhammad Shahroz Khan , Zhen Tan , Sukwon Yun , Charles Fleming , Tianlong Chen

Autonomous agents based on large language models (LLMs) are rapidly emerging as a general-purpose technology, with recent systems such as OpenClaw extending their capabilities through broad tool use, third-party skills, and deeper…

密码学与安全 · 计算机科学 2026-05-15 Lukas Pirch , Micha Horlboge , Patrick Großmann , Syeda Mahnur Asif , Klim Kireev , Thorsten Holz , Konrad Rieck