English
Related papers

Related papers: WebSentinel: Detecting and Localizing Prompt Injec…

200 papers

Language models remain vulnerable to prompt injection attacks despite extensive safety training. We trace this failure to role confusion: models infer the source of text based on how it sounds, not where it actually comes from. A command…

Computation and Language · Computer Science 2026-04-17 Charles Ye , Jasmine Cui , Dylan Hadfield-Menell

The wireless sensor network has become a hot research area due its wide range of application in military and civilian domain, but as it uses wireless media for communication these are easily prone to security attacks. There are number of…

Cryptography and Security · Computer Science 2015-06-05 Preeti Sharma , Monika Saluja , Krishan Kumar Saluja

Agentic AI coding assistants can edit files, run commands, and access the internet on behalf of developers. However, their reliance on unvetted external artifacts introduces a new attack vector. Hidden instructions in external artifacts can…

Software Engineering · Computer Science 2026-05-26 Yue Liu , Yanjie Zhao , Yunbo Lyu , Ting Zhang , Haoyu Wang , David Lo

Long context LLMs are vulnerable to prompt injection, where an attacker can inject an instruction in a long context to induce an LLM to generate an attacker-desired output. Existing prompt injection defenses are designed for short contexts.…

Cryptography and Security · Computer Science 2025-11-17 Runpeng Geng , Yanting Wang , Chenlong Yin , Minhao Cheng , Ying Chen , Jinyuan Jia

As large language model (LLM) agents increasingly automate complex web tasks, they boost productivity while simultaneously introducing new security risks. However, relevant studies on web agent attacks remain limited. Existing red-teaming…

Artificial Intelligence · Computer Science 2026-04-02 Zheng Zhang , Jiarui He , Yuchen Cai , Deheng Ye , Peilin Zhao , Ruili Feng , Hao Wang

Web page saliency prediction is a challenge problem in image transformation and computer vision. In this paper, we propose a new model combined with web page outline information to prediction people's interest region in web page. For each…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Yu Li , Ya Zhang

Many machine learning adversarial attacks find adversarial samples of a victim model ${\mathcal M}$ by following the gradient of some attack objective functions, either explicitly or implicitly. To confuse and detect such attacks, we take…

Cryptography and Security · Computer Science 2021-03-09 Jiyi Zhang , Ee-Chien Chang , Hwee Kuan Lee

Web-browsing AI agents are increasingly deployed in enterprise settings under strict whitelists of approved domains, yet adversaries can still influence them by embedding hidden instructions in the HTML pages those domains serve. Existing…

Cryptography and Security · Computer Science 2026-05-13 Chia-Pei , Chen , Kentaroh Toyoda , Anita Lai , Alex Leung

Penetration Testing is a methodology for assessing network security, by generating and executing possible attacks. Doing so automatically allows for regular and systematic testing. A key question then is how to automatically generate the…

Artificial Intelligence · Computer Science 2013-07-31 Carlos Sarraute

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

Computation and Language · Computer Science 2025-09-26 Jonathan Rusert

Large Language Model (LLM) agents are increasingly used to automate complex workflows, but integrating untrusted external data with privileged execution exposes them to severe security risks, particularly direct and indirect prompt…

Cryptography and Security · Computer Science 2026-04-28 Zonghao Ying , Haozheng Wang , Jiangfan Liu , Quanchen Zou , Aishan Liu , Jian Yang , Yaodong Yang , Xianglong Liu

Deep neural networks (DNNs) offer significant promise for improving breast cancer diagnosis in medical imaging. However, these models are highly susceptible to adversarial attacks--small, imperceptible changes that can mislead…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yasamin Medghalchi , Moein Heidari , Clayton Allard , Leonid Sigal , Ilker Hacihaliloglu

Large Language Models (LLMs) excel in processing and generating human language, powered by their ability to interpret and follow instructions. However, their capabilities can be exploited through prompt injection attacks. These attacks…

Artificial Intelligence · Computer Science 2024-03-11 Xiaogeng Liu , Zhiyuan Yu , Yizhe Zhang , Ning Zhang , Chaowei Xiao

Recommender systems have become an integral part of online services to help users locate specific information in a sea of data. However, existing studies show that some recommender systems are vulnerable to poisoning attacks, particularly…

Cryptography and Security · Computer Science 2024-04-24 Thanh Toan Nguyen , Quoc Viet Hung Nguyen , Thanh Tam Nguyen , Thanh Trung Huynh , Thanh Thi Nguyen , Matthias Weidlich , Hongzhi Yin

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

Cryptography and Security · Computer Science 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner

We consider a sensor network focused on target localization, where sensors measure the signal strength emitted from the target. Each measurement is quantized to one bit and sent to the fusion center. A general attack is considered at some…

Information Theory · Computer Science 2018-04-04 Jiangfan Zhang , Xiaodong Wang , Rick S. Blum , Lance M. Kaplan

Prompt injection attacks aim to contaminate the input data of an LLM to mislead it into completing an attacker-chosen task instead of the intended task. In many applications and agents, the input data originates from multiple sources, with…

Cryptography and Security · Computer Science 2025-12-16 Reachal Wang , Yuqi Jia , Neil Zhenqiang Gong

Phishing is an increasingly sophisticated form of cyberattack that is inflicting huge financial damage to corporations throughout the globe while also jeopardizing individuals' privacy. Attackers are constantly devising new methods of…

Cryptography and Security · Computer Science 2024-03-18 Asif Newaz , Farhan Shahriyar Haq , Nadim Ahmed

The rapid proliferation of network applications has led to a significant increase in network attacks. According to the OWASP Top 10 Projects report released in 2021, injection attacks rank among the top three vulnerabilities in software…

Software Engineering · Computer Science 2025-09-16 Guan-Yan Yang , Farn Wang , You-Zong Gu , Ya-Wen Teng , Kuo-Hui Yeh , Ping-Hsueh Ho , Wei-Ling Wen

Fast Flux service networks (FFSNs) are used by adversaries to achieve a high resilient technique for their malicious servers while keeping them hidden from direct access. In this technique, a large number of botnet machines, that are known…

Cryptography and Security · Computer Science 2020-06-08 Basheer Al-Duwairi , Moath Jarrah , Ahmed Shatnawi