中文
相关论文

相关论文: Prompt Injection Mitigation with Agentic AI, Neste…

200 篇论文

The evolution from static ranking models to Agentic Recommender Systems (Agentic RecSys) empowers AI agents to maintain long-term user profiles and autonomously plan service tasks. While this paradigm shift enhances personalization, it…

密码学与安全 · 计算机科学 2026-04-21 Jiachen Qian

As large language models are integrated into society, robustness toward a suite of prompts is increasingly important to maintain reliability in a high-variance environment.Robustness evaluations must comprehensively encapsulate the various…

计算与语言 · 计算机科学 2023-11-14 Alex Mei , Sharon Levy , William Yang Wang

Network Intrusion Detection Systems (NIDS) face important limitations. Signature-based methods are effective for known attack patterns, but they struggle to detect zero-day attacks and often miss modified variants of previously known…

密码学与安全 · 计算机科学 2026-04-08 Md Shamimul Islam , Luis G. Jaimes , Ayesha S. Dina

The critical challenge of prompt injection attacks in Large Language Models (LLMs) integrated applications, a growing concern in the Artificial Intelligence (AI) field. Such attacks, which manipulate LLMs through natural language inputs,…

密码学与安全 · 计算机科学 2024-01-17 Xuchen Suo

The integration of Large Language Models (LLMs) like GPT-4o into robotic systems represents a significant advancement in embodied artificial intelligence. These models can process multi-modal prompts, enabling them to generate more…

机器人学 · 计算机科学 2024-09-10 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Braunl , Jin B. Hong

The rapid integration of Large Language Models (LLMs) into high-stakes domains necessitates reliable safety and compliance evaluation. However, existing static benchmarks are ill-equipped to address the dynamic nature of AI risks and…

人工智能 · 计算机科学 2026-05-15 Yixu Wang , Xin Wang , Yang Yao , Xinyuan Li , Xibang Yang , Yan Teng , Xingjun Ma , Yingchun Wang

Precision agriculture requires efficient autonomous systems for crop monitoring, where agents must explore large-scale environments while minimizing resource consumption. This work addresses the problem as an active exploration task in a…

机器学习 · 计算机科学 2025-06-02 Emanuele Masiero , Vito Trianni , Giuseppe Vizzari , Dimitri Ognibene

This paper presents a novel approach to evaluating the security of large language models (LLMs) against prompt leakage-the exposure of system-level prompts or proprietary configurations. We define prompt leakage as a critical threat to…

密码学与安全 · 计算机科学 2025-02-19 Tvrtko Sternak , Davor Runje , Dorian Granoša , Chi Wang

Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear in downstream outputs, even without explicit adversarial intent. We formalise this…

人工智能 · 计算机科学 2026-05-12 Riya Tapwal , Abhishek Kumar , Carsten Maple

Memory poisoning attacks for Agentic AI and multi-agent systems (MAS) have recently caught attention. It is partially due to the fact that Large Language Models (LLMs) facilitate the construction and deployment of agents. Different memory…

密码学与安全 · 计算机科学 2026-03-24 Vicenç Torra , Maria Bras-Amorós

Cyber threat intelligence (CTI) encoded in STIX and structured according to the MITRE ATT&CK framework has become a global reference for describing adversary behavior. However, ATT&CK was designed as a descriptive knowledge base rather than…

As AI agents transition from research prototypes to enterprise production systems, the tool interfaces they consume remain rooted in human-oriented CRUD paradigms. This paper identifies five fundamental architectural mismatches between…

人工智能 · 计算机科学 2026-05-12 Kai Pan

The growing adoption of prompt-based automation in software testing raises important issues regarding its computational and environmental sustainability. Existing sustainability studies in AI-driven testing primarily focus on large language…

软件工程 · 计算机科学 2026-04-06 Pragati Kumari , Novarun Deb

LLM-powered applications routinely embed secrets in system prompts, yet models can be tricked into revealing them. We built an adaptive attacker that evolves its strategies over hundreds of rounds and tested it against nine defense…

密码学与安全 · 计算机科学 2026-05-14 Priyal Deep , Shane Emmons , Amy Fox , Kyle Bacon , Kelley McAllister , Peter Ortiz , Krisztian Flautner

Recent advances have enabled LLM-powered AI agents to autonomously execute complex tasks by combining language model reasoning with tools, memory, and web access. But can these systems be trusted to follow deployment policies in realistic…

Recent advancements in Large Language Model (LLM) agents have enabled complex multi-turn agentic tasks requiring extensive tool calling, where conversations can span dozens of API calls with increasingly large context windows. However,…

计算与语言 · 计算机科学 2026-02-03 Elias Lumer , Faheem Nizar , Akshaya Jangiti , Kevin Frank , Anmol Gulati , Mandar Phadate , Vamse Kumar Subbiah

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

人工智能 · 计算机科学 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Recent advances in LLM-based Text-to-SQL have achieved remarkable gains on public benchmarks such as BIRD and Spider. Yet, these systems struggle to scale in realistic enterprise settings with large, complex schemas, diverse SQL dialects,…

人工智能 · 计算机科学 2026-01-23 Asim Biswal , Chuan Lei , Xiao Qin , Aodong Li , Balakrishnan Narayanaswamy , Tim Kraska

AI agents such as OpenClaw are increasingly deployed in local workflows with access to external tools. This creates indirect prompt-injection (IPI) risk: an agent may execute harmful instructions embedded in untrusted inputs such as email,…

密码学与安全 · 计算机科学 2026-05-26 Lei Zhao , Abhay Bhaskar , Edgar Dobriban

As the number of connected IoT devices continues to grow, securing these systems against cyber threats remains a major challenge, especially in environments with limited computational and energy resources. This paper presents an…

密码学与安全 · 计算机科学 2025-11-25 Saeid Jamshidi , Amin Nikanjam , Negar Shahabi , Kawser Wazed Nafi , Foutse Khomh , Samira Keivanpour , Rolando Herrero