中文
相关论文

相关论文: The Promptware Kill Chain: How Prompt Injections G…

200 篇论文

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

密码学与安全 · 计算机科学 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Large Language Models (LLMs) are gaining momentum in software development with prompt-driven programming enabling developers to create code from natural language (NL) instructions. However, studies have questioned their ability to produce…

软件工程 · 计算机科学 2025-02-27 Catherine Tony , Nicolás E. Díaz Ferreyra , Markus Mutas , Salem Dhiff , Riccardo Scandariato

Multimodal Large Language Models (MLLMs) are set to transform how machines process and generate human-like responses by integrating diverse modalities such as text, images, and code. Yet, effectively harnessing their capabilities hinges on…

人工智能 · 计算机科学 2025-04-15 Anwesha Mohanty , Venkatesh Balavadhani Parthasarathy , Arsalan Shahid

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

密码学与安全 · 计算机科学 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner

Malicious software, or malware, presents a continuously evolving challenge in computer security. These embedded snippets of code in the form of malicious files or hidden within legitimate files cause a major risk to systems with their…

人工智能 · 计算机科学 2018-06-29 Rakshit Agrawal , Jack W. Stokes , Mady Marinescu , Karthik Selvaraj

Large Language Models (LLMs) are attracting significant research attention due to their instruction-following abilities, allowing users and developers to leverage LLMs for a variety of tasks. However, LLMs are vulnerable to prompt-injection…

密码学与安全 · 计算机科学 2024-01-10 Julien Piet , Maha Alrashed , Chawin Sitawarin , Sizhe Chen , Zeming Wei , Elizabeth Sun , Basel Alomair , David Wagner

Large Language Models (LLMs) have emerged as powerful re-rankers. Recent research has however showed that simple prompt injections embedded within a candidate document (i.e., jailbreak prompt attacks) can significantly alter an LLM's…

密码学与安全 · 计算机科学 2026-02-20 Yu Yin , Shuai Wang , Bevan Koopman , Guido Zuccon

Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. Two strategies are designed to perform this…

计算与语言 · 计算机科学 2024-06-04 Shichao Sun , Ruifeng Yuan , Ziqiang Cao , Wenjie Li , Pengfei Liu

Large Language Models are transforming software engineering, yet prompt management in practice remains ad hoc, hindering reliability, reuse, and integration into industrial workflows. We present Prompt-with-Me, a practical solution for…

软件工程 · 计算机科学 2025-09-23 Ziyou Li , Agnia Sergeyuk , Maliheh Izadi

LLM as judge systems used to assess text quality code correctness and argument strength are vulnerable to prompt injection attacks. We introduce a framework that separates content author attacks from system prompt attacks and evaluate five…

密码学与安全 · 计算机科学 2025-04-28 Narek Maloyan , Dmitry Namiot

When large language model (LLM) agents are increasingly deployed to automate tasks and interact with untrusted external data, prompt injection emerges as a significant security threat. By injecting malicious instructions into the data that…

密码学与安全 · 计算机科学 2026-02-05 Yizhu Wang , Sizhe Chen , Raghad Alkhudair , Basel Alomair , David Wagner

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

计算与语言 · 计算机科学 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

In the rapidly evolving landscape of artificial intelligence, ChatGPT has been widely used in various applications. The new feature - customization of ChatGPT models by users to cater to specific needs has opened new frontiers in AI…

密码学与安全 · 计算机科学 2024-05-28 Jiahao Yu , Yuhang Wu , Dong Shu , Mingyu Jin , Sabrina Yang , Xinyu Xing

Vision-language artificial intelligence models (VLMs) possess medical knowledge and can be employed in healthcare in numerous ways, including as image interpreters, virtual scribes, and general decision support systems. However, here, we…

While Large Language Models (LLMs) are increasingly being used in real-world applications, they remain vulnerable to prompt injection attacks: malicious third party prompts that subvert the intent of the system designer. To help researchers…

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

软件工程 · 计算机科学 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

Prompt-based approaches offer a cutting-edge solution to data privacy issues in continual learning, particularly in scenarios involving multiple data suppliers where long-term storage of private user data is prohibited. Despite delivering…

机器学习 · 计算机科学 2024-12-18 Trang Nguyen , Anh Tran , Nhat Ho

The proliferation of agentic AI coding assistants, including Claude Code, GitHub Copilot, Cursor, and emerging skill-based architectures, has fundamentally transformed software development workflows. These systems leverage Large Language…

密码学与安全 · 计算机科学 2026-01-27 Narek Maloyan , Dmitry Namiot

In-context learning (ICL) has emerged as a powerful paradigm leveraging LLMs for specific downstream tasks by utilizing labeled examples as demonstrations (demos) in the preconditioned prompts. Despite its promising performance, crafted…

机器学习 · 计算机科学 2025-05-30 Xiangyu Zhou , Yao Qiang , Saleh Zare Zade , Prashant Khanduri , Dongxiao Zhu

This comprehensive review delves into the pivotal role of prompt engineering in unleashing the capabilities of Large Language Models (LLMs). The development of Artificial Intelligence (AI), from its inception in the 1950s to the emergence…

计算与语言 · 计算机科学 2025-06-18 Banghao Chen , Zhaofeng Zhang , Nicolas Langrené , Shengxin Zhu