English
Related papers

Related papers: Privacy-Preserving Prompt Injection Detection for …

200 papers

In this study, we introduce RePD, an innovative attack Retrieval-based Prompt Decomposition framework designed to mitigate the risk of jailbreak attacks on large language models (LLMs). Despite rigorous pretraining and finetuning focused on…

Cryptography and Security · Computer Science 2024-12-02 Peiran Wang , Xiaogeng Liu , Chaowei Xiao

Large language models (LLMs) are renowned for their exceptional capabilities, and applying to a wide range of applications. However, this widespread use brings significant vulnerabilities. Also, it is well observed that there are huge gap…

Computation and Language · Computer Science 2024-09-23 Md Abdur Rahman , Hossain Shahriar , Fan Wu , Alfredo Cuzzocrea

Federated learning (FL) that enables edge devices to collaboratively learn a shared model while keeping their training data locally has received great attention recently and can protect privacy in comparison with the traditional centralized…

Machine Learning · Computer Science 2022-11-17 Rui Hu , Yanmin Gong , Yuanxiong Guo

Federated Learning (FL) represents a significant advancement in distributed machine learning, enabling multiple participants to collaboratively train models without sharing raw data. This decentralized approach enhances privacy by keeping…

Cryptography and Security · Computer Science 2025-02-10 Jaydip Sen , Hetvi Waghela , Sneha Rakshit

The high cost of ownership of AI compute infrastructure and challenges of robust serving of large language models (LLMs) has led to a surge in managed Model-as-a-service deployments. Even when enterprises choose on-premises deployments, the…

Machine Learning · Computer Science 2025-06-12 Jay Roberts , Kyle Mylonakis , Sidhartha Roy , Kaan Kale

With the development of laws and regulations related to privacy preservation, it has become difficult to collect personal data to perform machine learning. In this context, federated learning, which is distributed learning without sharing…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yosuke Kaga , Yusei Suzuki , Kenta Takahashi

The community explored to build private inference frameworks for transformer-based large language models (LLMs) in a server-client setting, where the server holds the model parameters and the client inputs its private data (or prompt) for…

Machine Learning · Computer Science 2023-12-18 Xuanqi Liu , Zhuotao Liu

This paper presents a real-time modular defense system named Sentra-Guard. The system detects and mitigates jailbreak and prompt injection attacks targeting large language models (LLMs). The framework uses a hybrid architecture with…

Cryptography and Security · Computer Science 2026-05-04 Md. Mehedi Hasan , Sk Tanzir Mehedi , Ziaur Rahman , Rafid Mostafiz , Md. Abir Hossain

Federated learning is a promising distributed learning paradigm that enables collaborative model training without exposing local client data, thereby protecting data privacy. However, it also brings new threats and challenges. The…

Cryptography and Security · Computer Science 2026-04-14 Nina Cai , Jinguang Han , Weizhi Meng

In the text processing context, most ML models are built on word embeddings. These embeddings are themselves trained on some datasets, potentially containing sensitive data. In some cases this training is done independently, in other cases,…

Computation and Language · Computer Science 2021-06-23 Saeed Mahloujifar , Huseyin A. Inan , Melissa Chase , Esha Ghosh , Marcello Hasegawa

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL). However, such a collection manner poses a privacy threat, and one potential…

Machine Learning · Computer Science 2025-11-18 Huiwen Wu , Xiaogang Xu , Deyi Zhang , Xiaohan Li , Jiafei Wu , Zhe Liu

Federated Large Language Models (FedLLMs) enable multiple parties to collaboratively fine-tune LLMs without sharing raw data, addressing challenges of limited resources and privacy concerns. Despite data localization, shared gradients can…

Machine Learning · Computer Science 2026-04-24 Guilin Deng , Silong Chen , Yuchuan Luo , Yi Liu , Songlei Wang , Zhiping Cai , Lin Liu , Xiaohua Jia , Shaojing Fu

The widespread adoption of Artificial Intelligence (AI) has been driven by significant advances in intelligent system research. However, this progress has raised concerns about data privacy, leading to a growing awareness of the need for…

Machine Learning · Computer Science 2025-05-06 Md. Tanzib Hosain , Asif Zaman , Md. Shahriar Sajid , Shadman Sakeeb Khan , Shanjida Akter

The rapid development of the Internet and smart devices trigger surge in network traffic making its infrastructure more complex and heterogeneous. The predominated usage of mobile phones, wearable devices and autonomous vehicles are…

The advancement of large language models (LLMs) has significantly enhanced the ability to effectively tackle various downstream NLP tasks and unify these tasks into generative pipelines. On the one hand, powerful language models, trained on…

Computation and Language · Computer Science 2024-10-01 Haoran Li , Yulin Chen , Jinglong Luo , Jiecong Wang , Hao Peng , Yan Kang , Xiaojin Zhang , Qi Hu , Chunkit Chan , Zenglin Xu , Bryan Hooi , Yangqiu Song

A central tenet of Federated learning (FL), which trains models without centralizing user data, is privacy. However, previous work has shown that the gradient updates used in FL can leak user information. While the most industrial uses of…

Machine Learning · Computer Science 2023-06-01 Liam Fowl , Jonas Geiping , Steven Reich , Yuxin Wen , Wojtek Czaja , Micah Goldblum , Tom Goldstein

Pretrained large language models (LLMs) have revolutionized natural language processing (NLP) tasks such as summarization, question answering, and translation. However, LLMs pose significant security risks due to their tendency to memorize…

Computation and Language · Computer Science 2024-09-24 Zhepeng Wang , Runxue Bao , Yawen Wu , Jackson Taylor , Cao Xiao , Feng Zheng , Weiwen Jiang , Shangqian Gao , Yanfu Zhang

Federated Learning (FL) is a privacy-preserving approach that allows servers to aggregate distributed models transmitted from local clients rather than training on user data. More recently, FL has been applied to Speech Emotion Recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-18 Chao Tan , Sheng Li , Yang Cao , Zhao Ren , Tanja Schultz

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

Pre-trained language models (PLM) have revolutionized the NLP landscape, achieving stellar performances across diverse tasks. These models, while benefiting from vast training data, often require fine-tuning on specific data to cater to…

Computation and Language · Computer Science 2023-10-04 Jingwei Sun , Ziyue Xu , Hongxu Yin , Dong Yang , Daguang Xu , Yiran Chen , Holger R. Roth