English
Related papers

Related papers: PIIGuard: Mitigating PII Harvesting under Adversar…

200 papers

Large language models for code (LLM4Code) have greatly improved developer productivity but also raise privacy concerns due to their reliance on open-source repositories containing abundant personally identifiable information (PII). Prior…

Software Engineering · Computer Science 2025-12-10 Hua Yang , Alejandro Velasco , Sen Fang , Bowen Xu , Denys Poshyvanyk

The services of internet place a key role in the daily life by enabling the in sequence from anywhere. To provide somewhere to stay the communication and management in applications the web services has stimulated to multitier design. In…

Cryptography and Security · Computer Science 2014-05-02 C. Venkatesh , D. Nagaraju , T. Sunil Kumar Reddy

This paper introduces MetaDefense, a novel framework for defending against finetuning-based jailbreak attacks in large language models (LLMs). We observe that existing defense mechanisms fail to generalize to harmful queries disguised by…

Machine Learning · Computer Science 2025-10-10 Weisen Jiang , Sinno Jialin Pan

Recently, the development and implementation of phishing attacks require little technical skills and costs. This uprising has led to an ever-growing number of phishing attacks on the World Wide Web. Consequently, proactive techniques to…

Cryptography and Security · Computer Science 2020-11-09 Chidimma Opara , Bo Wei , Yingke Chen

Large language models (LLMs) are popular for high-quality text generation but can produce harmful content, even when aligned with human values through reinforcement learning. Adversarial prompts can bypass their safety measures. We propose…

Computation and Language · Computer Science 2024-05-03 Mansi Phute , Alec Helbling , Matthew Hull , ShengYun Peng , Sebastian Szyller , Cory Cornelius , Duen Horng Chau

The improved semantic understanding of vision-language pretrained (VLP) models has made it increasingly difficult to protect publicly posted images from being exploited by search engines and other similar tools. In this context, this paper…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Xuelin Shen , Jiayin Xu , Kangsheng Yin , Wenhan Yang

The rapid adoption of open-source Large Language Models (LLMs) in offline and enterprise environments has introduced a largely unexamined security risk like susceptibility to adversarial phishing prompts under static safety configurations.…

Cryptography and Security · Computer Science 2026-04-21 Rina Mishra , Gaurav Varshney , Doddipatla Sesha Sahithi

Large Language Models (LLMs) have been reported to "leak" Personally Identifiable Information (PII), with successful PII reconstruction often interpreted as evidence of memorization. We propose a principled revision of memorization…

Computation and Language · Computer Science 2026-01-08 Xiaoyu Luo , Yiyi Chen , Qiongxiu Li , Johannes Bjerva

This work demonstrates that LLM-based web navigation agents offer powerful automation capabilities but are vulnerable to Indirect Prompt Injection (IPI) attacks. We show that adversaries can embed universal adversarial triggers in webpage…

Cryptography and Security · Computer Science 2025-07-22 Sam Johnson , Viet Pham , Thai Le

Agentic large language model systems increasingly automate tasks by retrieving URLs and calling external tools. We show that this workflow gives rise to implicit prompt injection: adversarial instructions embedded in automatically generated…

Cryptography and Security · Computer Science 2026-02-27 Qianlong Lan , Anuj Kaul , Shaun Jones , Stephanie Westrum

Privacy-sensitive users require deploying large language models (LLMs) within their own infrastructure (on-premises) to safeguard private data and enable customization. However, vulnerabilities in local environments can lead to unauthorized…

Machine Learning · Computer Science 2025-10-08 Hanbo Huang , Yihan Li , Bowen Jiang , Bo Jiang , Lin Liu , Ruoyu Sun , Zhuotao Liu , Shiyu Liang

While web agents gained popularity by automating web interactions, their requirement for interface access introduces significant privacy risks that are understudied, particularly from users' perspective. Through a formative study (N=15), we…

Human-Computer Interaction · Computer Science 2025-09-16 Shuning Zhang , Yutong Jiang , Rongjun Ma , Yuting Yang , Mingyao Xu , Zhixin Huang , Xin Yi , Hewu Li

Phishing attacks continue to evolve, with cloaking techniques posing a significant challenge to detection efforts. Cloaking allows attackers to display phishing sites only to specific users while presenting legitimate pages to security…

Cryptography and Security · Computer Science 2025-08-05 Hiroki Nakano , Takashi Koide , Daiki Chiba

Deploying large language models (LLMs) as autonomous browser agents exposes a significant attack surface in the form of Indirect Prompt Injection (IPI). Cloud-based defenses can provide strong semantic analysis, but they introduce latency…

Cryptography and Security · Computer Science 2026-03-26 Qianlong Lan , Anuj Kaul

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language processing but also pose significant privacy risks by memorizing and leaking Personally Identifiable Information (PII). Existing mitigation…

Machine Learning · Computer Science 2025-03-17 Ahmed Frikha , Muhammad Reza Ar Razi , Krishna Kanth Nakka , Ricardo Mendes , Xue Jiang , Xuebing Zhou

Large Language Models (LLMs) are increasingly integrated into web-based systems for content summarization, yet their susceptibility to prompt injection attacks remains a pressing concern. In this study, we explore how non-visible HTML…

Cryptography and Security · Computer Science 2025-11-12 Ishaan Verma , Arsheya Yadav

Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the unlabeled data so that when a victim trains an SSL model on…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ajinkya Tejankar , Maziar Sanjabi , Qifan Wang , Sinong Wang , Hamed Firooz , Hamed Pirsiavash , Liang Tan

Digital watermarks can be embedded into AI-generated content (AIGC) by initializing the generation process with starting points sampled from a secret distribution. When combined with pseudorandom error-correcting codes, such watermarked…

Cryptography and Security · Computer Science 2025-11-13 De Zhang Lee , Han Fang , Hanyi Wang , Ee-Chien Chang

Large language models (LLMs) rely on deterministic pseudorandom number generators (PRNGs) for autoregressive sampling, creating a critical supply-chain attack surface overlooked by existing defenses. We present SeedHijack, a backdoor attack…

Cryptography and Security · Computer Science 2026-05-12 Ziyang You , Xiaoke Yang , Zhanling Fan , Feng Guo , Xiaogen Zhou , Xuxing Lu

Modern language models exhibit rich internal structure, yet little is known about how privacy-sensitive behaviors, such as personally identifiable information (PII) leakage, are represented and modulated within their hidden states. We…

Machine Learning · Computer Science 2026-02-20 Leo Marchyok , Zachary Coalson , Sungho Keum , Sooel Son , Sanghyun Hong