English
Related papers

Related papers: Casper: Prompt Sanitization for Protecting User Pr…

200 papers

Service providers of large language model (LLM) applications collect user instructions in the wild and use them in further aligning LLMs with users' intentions. These instructions, which potentially contain sensitive information, are…

Cryptography and Security · Computer Science 2024-07-03 Da Yu , Peter Kairouz , Sewoong Oh , Zheng Xu

We present OnPrem$.$LLM, a Python-based toolkit for applying large language models (LLMs) to sensitive, non-public data in offline or restricted environments. The system is designed for privacy-preserving use cases and provides prebuilt…

Computation and Language · Computer Science 2025-09-30 Arun S. Maiya

The generative Artificial Intelligence (AI) tools based on Large Language Models (LLMs) use billions of parameters to extensively analyse large datasets and extract critical private information such as, context, specific details,…

Cryptography and Security · Computer Science 2023-10-20 Imdad Ullah , Najm Hassan , Sukhpal Singh Gill , Basem Suleiman , Tariq Ahamed Ahanger , Zawar Shah , Junaid Qadir , Salil S. Kanhere

Responsible use of AI demands that we protect sensitive information without undermining the usefulness of data, an imperative that has become acute in the age of large language models. We address this challenge with an on-premise,…

Computation and Language · Computer Science 2026-03-19 Federico Albanese , Pablo Ronco , Nicolás D'Ippolito

The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy…

Human-Computer Interaction · Computer Science 2024-02-06 Tianshi Li , Sauvik Das , Hao-Ping Lee , Dakuo Wang , Bingsheng Yao , Zhiping Zhang

Prompt engineering has emerged as a powerful technique for optimizing large language models (LLMs) for specific applications, enabling faster prototyping and improved performance, and giving rise to the interest of the community in…

Artificial Intelligence · Computer Science 2025-02-17 Roman Levin , Valeriia Cherepanova , Abhimanyu Hans , Avi Schwarzschild , Tom Goldstein

With the widespread application of large language models (LLMs), user privacy protection has become a significant research topic. Existing privacy preference modeling methods often rely on large-scale user data, making effective privacy…

Cryptography and Security · Computer Science 2025-05-13 Haowei Yang , Qingyi Lu , Yang Wang , Sibei Liu , Jiayun Zheng , Ao Xiang

System prompts are widely used to guide the outputs of large language models (LLMs). These prompts often contain business logic and sensitive information, making their protection essential. However, adversarial and even regular user queries…

Cryptography and Security · Computer Science 2025-08-28 Zhifeng Jiang , Zhihua Jin , Guoliang He

This paper presents a novel application of large language models (LLMs) to enhance user comprehension of privacy policies through an interactive dialogue agent. We demonstrate that LLMs significantly outperform traditional models in tasks…

Human-Computer Interaction · Computer Science 2024-10-17 Bolun Sun , Yifan Zhou , Haiyun Jiang

Web services are important in the processing of personal data in the World Wide Web. In light of recent data protection regulations, this processing raises a question about consent or other basis of legal processing. While a consent must be…

Software Engineering · Computer Science 2020-11-06 Kalle Hjerppe , Jukka Ruohonen , Ville Leppänen

Large Language Models (LLMs) have revolutionized how information are collected, aggregated, and reasoned. However, this enables a novel and accessible vector of privacy intrusion: the automated and in-depth personal profiling; this…

Cryptography and Security · Computer Science 2026-05-08 Jiahao Chen , Qi Zhang , Ruixiao Lin , Chunyi Zhou , Tianyu Du , Qingming Li , Tong Zhang , Junhao Li , Yuwen Pu , Shouling Ji

The recent growth in the use of Large Language Models has made them vulnerable to sophisticated adversarial assaults, manipulative prompts, and encoded malicious inputs. Existing countermeasures frequently necessitate retraining models,…

Computation and Language · Computer Science 2026-03-10 Sheikh Samit Muhaimin , Spyridon Mastorakis

With the widespread use of LLMs, preserving privacy in user prompts has become crucial, as prompts risk exposing privacy and sensitive data to the cloud LLMs. Traditional techniques like homomorphic encryption, secure multi-party…

Computation and Language · Computer Science 2025-11-19 Xuan Li , Zhe Yin , Xiaodong Gu , Beijun Shen

Model adaptation is crucial to handle the discrepancy between proxy training data and actual users data received. To effectively perform adaptation, textual data of users is typically stored on servers or their local devices, where…

Computation and Language · Computer Science 2023-12-15 Arpita Vats , Zhe Liu , Peng Su , Debjyoti Paul , Yingyi Ma , Yutong Pang , Zeeshan Ahmed , Ozlem Kalinli

Fine-tuning has emerged as a critical process in leveraging Large Language Models (LLMs) for specific downstream tasks, enabling these models to achieve state-of-the-art performance across various domains. However, the fine-tuning process…

Artificial Intelligence · Computer Science 2025-04-08 Hao Du , Shang Liu , Lele Zheng , Yang Cao , Atsuyoshi Nakamura , Lei Chen

Large language models (LLMs) are increasingly used in sensitive domains, where their ability to infer personal data from seemingly benign text introduces emerging privacy risks. While recent LLM-based anonymization methods help mitigate…

Computation and Language · Computer Science 2025-10-27 Kyuyoung Kim , Hyunjun Jeon , Jinwoo Shin

Multimodal Large Language Models (LLMs) are pivotal in revolutionizing customer support and operations by integrating multiple modalities such as text, images, and audio. Federated Prompt Learning (FPL) is a recently proposed approach that…

Machine Learning · Computer Science 2025-02-14 Linh Tran , Wei Sun , Stacy Patterson , Ana Milanova

Large language models (LLMs) are increasingly integrated into daily life through conversational interfaces, processing user data via natural language inputs and exhibiting advanced reasoning capabilities, which raises new concerns about…

Human-Computer Interaction · Computer Science 2026-02-12 Zhuoyang Li , Yanlai Wu , Yao Li , Xinning Gui , Yuhan Luo

Large Language Models (LLMs) have demonstrated advanced capabilities in both text generation and comprehension, and their application to data archives might facilitate the privatization of sensitive information about the data subjects. In…

Cryptography and Security · Computer Science 2025-04-08 Stefano Cirillo , Domenico Desiato , Giuseppe Polese , Monica Maria Lucia Sebillo , Giandomenico Solimando

Natural Language Processing (NLP) is integral to social media analytics but often processes content containing Personally Identifiable Information (PII), behavioral cues, and metadata raising privacy risks such as surveillance, profiling,…

Computation and Language · Computer Science 2026-02-19 Dhiman Goswami , Jai Kruthunz Naveen Kumar , Sanchari Das