中文
相关论文

相关论文: Plant, Persist, Trigger: Sleeper Attack on Large L…

200 篇论文

Large Language Models (LLMs) increasingly mediate our social, cultural, and political interactions. While they can simulate some aspects of human behavior and decision-making, it is still underexplored whether repeated interactions with…

社会与信息网络 · 计算机科学 2026-03-02 Farnoosh Hashemi , Michael W. Macy

Large language models (LLMs) remain vulnerable to jailbreaking attacks despite their impressive capabilities. Investigating these weaknesses is crucial for robust safety mechanisms. Existing attacks primarily distract LLMs by introducing…

计算与语言 · 计算机科学 2025-11-04 Peng Ding , Jun Kuang , Wen Sun , Zongyu Wang , Xuezhi Cao , Xunliang Cai , Jiajun Chen , Shujian Huang

Autonomous AI agents powered by large language models (LLMs) with structured function-calling interfaces enable real-time data retrieval, computation, and multi-step orchestration. However, the rapid growth of plugins, connectors, and…

Large Language Models (LLMs) have emerged as a transformative and disruptive technology, enabling a wide range of applications in natural language processing, machine translation, and beyond. However, this widespread integration of LLMs…

密码学与安全 · 计算机科学 2026-01-27 Mohammad Fasha , Faisal Abul Rub , Nasim Matar , Bilal Sowan , Mohammad Al Khaldy

Large Language Model (LLM)-based Multi-Agent Systems (MASs) are increasingly deployed for agentic tasks, such as web automation, itinerary planning, and collaborative problem solving. Yet, their interactive nature introduces new security…

多智能体系统 · 计算机科学 2026-03-18 Samira Abedini , Sina Mavali , Lea Schönherr , Martin Pawelczyk , Rebekka Burkholz

Large Language Models (LLMs) remain vulnerable to jailbreak attacks that bypass their safety mechanisms. Existing attack methods are fixed or specifically tailored for certain models and cannot flexibly adjust attack strength, which is…

密码学与安全 · 计算机科学 2024-10-08 Yiting Dong , Guobin Shen , Dongcheng Zhao , Xiang He , Yi Zeng

Large Language Models (LLMs) have revolutionized natural language processing, but their robustness against adversarial attacks remains a critical concern. We presents a novel white-box style attack approach that exposes vulnerabilities in…

计算与语言 · 计算机科学 2024-09-16 Zeyu Yang , Zhao Meng , Xiaochen Zheng , Roger Wattenhofer

The growing use of large language model (LLM)-based conversational agents to manage sensitive user data raises significant privacy concerns. While these agents excel at understanding and acting on context, this capability can be exploited…

密码学与安全 · 计算机科学 2024-09-20 Eugene Bagdasarian , Ren Yi , Sahra Ghalebikesabi , Peter Kairouz , Marco Gruteser , Sewoong Oh , Borja Balle , Daniel Ramage

Peer review is essential for maintaining academic quality, but the increasing volume of submissions places a significant burden on reviewers. Large language models (LLMs) offer potential assistance in this process, yet their susceptibility…

Most LLM safety work studies single-agent models, but many real applications rely on multiple interacting agents. In these systems, prompt segmentation and inter-agent routing create attack surfaces that single-agent evaluations miss. We…

多智能体系统 · 计算机科学 2026-04-21 Nokimul Hasan Arif , Qian Lou , Mengxin Zheng

Recent advancements in Web AI agents have demonstrated remarkable capabilities in addressing complex web navigation tasks. However, emerging research shows that these agents exhibit greater vulnerability compared to standalone Large…

机器学习 · 计算机科学 2025-09-23 Jeffrey Yang Fan Chiang , Seungjae Lee , Jia-Bin Huang , Furong Huang , Yizheng Chen

Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular…

计算与语言 · 计算机科学 2024-11-18 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

Large Language Models (LLMs) are deployed in interactive contexts with direct user engagement, such as chatbots and writing assistants. These deployments are vulnerable to prompt injection and jailbreaking (collectively, prompt hacking), in…

The proliferation of Large Language Models (LLMs) has introduced critical security challenges, where adversarial actors can manipulate input prompts to cause significant harm and circumvent safety alignments. These prompt-based attacks…

This survey investigates how classical software design patterns can enhance the reliability and scalability of communication in Large Language Model (LLM)-driven agentic AI systems, focusing particularly on the Model Context Protocol (MCP).…

软件工程 · 计算机科学 2026-05-25 Anjana Sarkar , Soumyendu Sarkar

The increasing deployment of Large Language Models (LLMs) in various applications necessitates a rigorous evaluation of their robustness against adversarial attacks. In this paper, we present a comprehensive study on the robustness of GPT…

计算与语言 · 计算机科学 2024-12-24 Yiyi Tao , Yixian Shen , Hang Zhang , Yanxin Shen , Lun Wang , Chuanqi Shi , Shaoshuai Du

Large language model (LLM) services have recently begun offering a plugin ecosystem to interact with third-party API services. This innovation enhances the capabilities of LLMs, but it also introduces risks, as these plugins developed by…

密码学与安全 · 计算机科学 2024-04-29 Wanru Zhao , Vidit Khazanchi , Haodi Xing , Xuanli He , Qiongkai Xu , Nicholas Donald Lane

Large language models (LLMs) are increasingly deployed in human-AI teams as support agents for complex tasks such as information retrieval, programming, and decision-making assistance. While these agents' autonomy and contextual knowledge…

机器学习 · 计算机科学 2026-03-24 Abed K. Musaffar , Ambuj Singh , Francesco Bullo

Large Language Models (LLMs) are central to a multitude of applications but struggle with significant risks, notably in generating harmful content and biases. Drawing an analogy to the human psyche's conflict between evolutionary survival…

计算与语言 · 计算机科学 2023-11-16 Zi Yin , Wei Ding , Jia Liu

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they remain vulnerable to adversarial manipulations such as jailbreaking via prompt injection attacks. These attacks bypass safety mechanisms…

机器学习 · 计算机科学 2025-07-08 Xin Wei Chia , Swee Liang Wong , Jonathan Pan