English
Related papers

Related papers: The Mirror Design Pattern: Strict Data Geometry ov…

200 papers

Large language models (LLMs) deployed behind APIs and retrieval-augmented generation (RAG) stacks are vulnerable to prompt injection attacks that may override system policies, subvert intended behavior, and induce unsafe outputs. Existing…

Cryptography and Security · Computer Science 2026-03-20 Md Takrim Ul Alam , Akif Islam , Mohd Ruhul Ameen , Abu Saleh Musa Miah , Jungpil Shin

Prompt injection attacks pose a significant challenge to the safe deployment of Large Language Models (LLMs) in real-world applications. While prompt-based detection offers a lightweight and interpretable defense strategy, its effectiveness…

Cryptography and Security · Computer Science 2025-10-10 Ting-Chun Liu , Ching-Yu Hsu , Kuan-Yi Lee , Chi-An Fu , Hung-yi Lee

Multi-agent LLM systems are entering production -- processing documents, managing workflows, acting on behalf of users -- yet their resilience to prompt injection is still evaluated with a single binary: did the attack succeed? This leaves…

Cryptography and Security · Computer Science 2026-04-13 Haochuan Kevin Wang , Zechen Zhang

Large language models (LLMs) are increasingly deployed in real-world applications ranging from chatbots to agentic systems, where they are expected to process untrusted data and follow trusted instructions. Failure to distinguish between…

Cryptography and Security · Computer Science 2025-10-17 Xiaoxue Yang , Bozhidar Stevanoski , Matthieu Meeus , Yves-Alexandre de Montjoye

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

Cryptography and Security · Computer Science 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

Prompt injection remains a major security risk for large language models. However, the efficacy of existing guardrail models in context-aware settings remains underexplored, as they often rely on static attack benchmarks. Additionally, they…

Computation and Language · Computer Science 2025-06-18 Gauri Kholkar , Ratinder Ahuja

Software vulnerability detection is critical for ensuring software security and reliability. Despite recent advances in deep learning, real-world vulnerability datasets suffer from two severe challenges: frequency imbalance and difficulty…

Software Engineering · Computer Science 2026-05-12 Yuteng Zhang , Huifang Ma , Jiahui Wei , Qingqing Li , Yafei Yang

LLM agents with tool access can discover and exploit security vulnerabilities. This is known. What is not known is which features of a system prompt trigger this behaviour, and which do not. We present a systematic taxonomy based on…

Cryptography and Security · Computer Science 2026-04-07 Charafeddine Mouzouni

LiDAR SLAM provides high-accuracy localization but is fragile to point-cloud corruption because scan matching assumes geometric consistency. Prior physical attacks on LiDAR SLAM largely rely on LiDAR spoofing via external signal injection,…

Robotics · Computer Science 2026-03-13 Rokuto Nagata , Kenji Koide , Kazuma Ikeda , Ozora Sako , Shion Horie , Kentaro Yoshioka

Multi-agent LLM systems introduce a security risk in which sensitive information accessed by one agent can propagate through shared context and reappear in downstream outputs, even without explicit adversarial intent. We formalise this…

Artificial Intelligence · Computer Science 2026-05-12 Riya Tapwal , Abhishek Kumar , Carsten Maple

Deep regression models are used in a wide variety of safety-critical applications, but are vulnerable to backdoor attacks. Although many defenses have been proposed for classification models, they are ineffective as they do not consider the…

Machine Learning · Computer Science 2024-11-08 Lingyu Du , Yupei Liu , Jinyuan Jia , Guohao Lan

In this fast-evolving area of LLMs, our paper discusses the significant security risk presented by prompt injection attacks. It focuses on small open-sourced models, specifically the LLaMA family of models. We introduce novel defense…

Cryptography and Security · Computer Science 2025-12-19 Safwan Shaheer , G. M. Refatul Islam , Mohammad Rafid Hamid , Tahsin Zaman Jilan

In this paper, we present PRISM, a Promptable and Robust Interactive Segmentation Model, aiming for precise segmentation of 3D medical images. PRISM accepts various visual inputs, including points, boxes, and scribbles as sparse prompts, as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hao Li , Han Liu , Dewei Hu , Jiacheng Wang , Ipek Oguz

Large language models (LLMs) are becoming increasingly prevalent in modern software systems, interfacing between the user and the Internet to assist with tasks that require advanced language understanding. To accomplish these tasks, the LLM…

Cryptography and Security · Computer Science 2025-07-04 Sizhe Chen , Arman Zharmagambetov , Saeed Mahloujifar , Kamalika Chaudhuri , David Wagner , Chuan Guo

We describe a PubMed scale retrieval framework that separates semantic interpretation from metric geometry. A large language model expands a natural language query into concise biomedical phrases; retrieval then operates in a fixed, mean…

Information Retrieval · Computer Science 2026-01-12 Rob Koopman

Backdoor attacks are a significant threat to large language models (LLMs), often embedded via public checkpoints, yet existing defenses rely on impractical assumptions about trigger settings. To address this challenge, we propose…

Computation and Language · Computer Science 2026-05-14 Liang Lin , Miao Yu , Moayad Aloqaily , Zhenhong Zhou , Kun Wang , Linsey Pang , Prakhar Mehrotra , Qingsong Wen

The system prompt in Large Language Models (LLMs) plays a pivotal role in guiding model behavior and response generation. Often containing private configuration details, user roles, and operational instructions, the system prompt has become…

Cryptography and Security · Computer Science 2025-06-02 Badhan Chandra Das , M. Hadi Amini , Yanzhao Wu

An active defense against an incoming missile requires information of it, including a guidance law parameter and a first-order lateral time constant. To this end, assuming that a missile with a proportional navigation (PN) guidance law…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Yinhan Wang , Jiang Wang , Shipeng Fan

Educational LLM tutors face a core AI alignment challenge: they must follow user intent while preserving pedagogical constraints and safety policies. We present an evaluation methodology for prompt-injection defenses in this setting,…

Cryptography and Security · Computer Science 2026-05-22 Alexandre Cristovão Maiorano
‹ Prev 1 3 4 5 6 7 10 Next ›