English
Related papers

Related papers: PSY: Posterior Sampling Based Privacy Enhancer in …

200 papers

The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy…

Human-Computer Interaction · Computer Science 2024-02-06 Tianshi Li , Sauvik Das , Hao-Ping Lee , Dakuo Wang , Bingsheng Yao , Zhiping Zhang

Large language models (LLMs) are rapidly being adopted for tasks like drafting emails, summarizing meetings, and answering health questions. In these settings, users may need to share private information (e.g., contact details, health…

Computation and Language · Computer Science 2026-01-16 Xiaoyuan Wu , Roshni Kaushik , Wenkai Li , Lujo Bauer , Koichi Onoue

The emergence and evolution of Local Differential Privacy (LDP) and its various adaptations play a pivotal role in tackling privacy issues related to the vast amounts of data generated by intelligent devices, which are crucial for…

Cryptography and Security · Computer Science 2024-01-26 Likun Qin , Tianshuo Qiu

Positioned between pre-training and user deployment, aligning large language models (LLMs) through reinforcement learning (RL) has emerged as a prevailing strategy for training instruction following-models such as ChatGPT. In this work, we…

Machine Learning · Computer Science 2024-05-06 Fan Wu , Huseyin A. Inan , Arturs Backurs , Varun Chandrasekaran , Janardhan Kulkarni , Robert Sim

The rise of reinforcement learning (RL) in critical real-world applications demands a fundamental rethinking of privacy in AI systems. Traditional privacy frameworks, designed to protect isolated data points, fall short for sequential…

Machine Learning · Computer Science 2025-06-19 Flint Xiaofeng Fan , Cheston Tan , Roger Wattenhofer , Yew-Soon Ong

Local differential privacy (LDP) has recently gained prominence as a powerful paradigm for collecting and analyzing sensitive data from users' devices. However, the inherent perturbation added by LDP protocols reduces the utility of the…

Cryptography and Security · Computer Science 2025-07-09 Alireza Khodaie , Berkay Kemal Balioglu , Mehmet Emre Gursoy

Recently, large language models (LLMs) have garnered widespread attention for their exceptional capabilities. Prompts are central to the functionality and performance of LLMs, making them highly valuable assets. The increasing reliance on…

Cryptography and Security · Computer Science 2025-06-13 Yong Yang , Changjiang Li , Qingming Li , Oubo Ma , Haoyu Wang , Zonghui Wang , Yandong Gao , Wenzhi Chen , Shouling Ji

In this paper, the physical layer security (PLS) for a novel reconfigurable intelligent surface (RIS)-assisted non-orthogonal multiple access (NOMA) system in a multi-user scenario is investigated, where we consider the worst case that the…

Signal Processing · Electrical Eng. & Systems 2020-08-03 Liang Yang , Yongjie Yuan

Recent developments in Large Language Models (LLMs) have manifested significant advancements. To facilitate safeguards against malicious exploitation, a body of research has concentrated on aligning LLMs with human preferences and…

Cryptography and Security · Computer Science 2024-06-11 Yuanpu Cao , Bochuan Cao , Jinghui Chen

The privacy concerns associated with the use of Large Language Models (LLMs) have grown recently with the development of LLMs such as ChatGPT. Differential Privacy (DP) techniques are explored in existing work to mitigate their privacy…

Artificial Intelligence · Computer Science 2024-03-08 Tiejin Chen , Longchao Da , Huixue Zhou , Pingzhi Li , Kaixiong Zhou , Tianlong Chen , Hua Wei

We explore a knowledge sanitization approach to mitigate the privacy concerns associated with large language models (LLMs). LLMs trained on a large corpus of Web data can memorize and potentially reveal sensitive or confidential…

Computation and Language · Computer Science 2024-03-05 Yoichi Ishibashi , Hidetoshi Shimodaira

As language models (LMs) are widely utilized in personalized communication scenarios (e.g., sending emails, writing social media posts) and endowed with a certain level of agency, ensuring they act in accordance with the contextual privacy…

Computation and Language · Computer Science 2025-03-17 Yijia Shao , Tianshi Li , Weiyan Shi , Yanchen Liu , Diyi Yang

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable,…

Computation and Language · Computer Science 2024-05-24 Aldo Gael Carranza , Rezsa Farahani , Natalia Ponomareva , Alex Kurakin , Matthew Jagielski , Milad Nasr

Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step…

Machine Learning · Computer Science 2018-12-12 Vitaly Feldman , Ilya Mironov , Kunal Talwar , Abhradeep Thakurta

Enforcement of privacy regulation is essential for collaborative data analytics. In this work, we address a scenario in which two companies expect to securely join their datasets with respect to their common customers to maximize data…

Cryptography and Security · Computer Science 2024-10-08 Jiabo Wang , Elmo Xuyun Huang , Pu Duan , Huaxiong Wang , Kwok-Yan Lam

Reinforcement learning (RL) has emerged as a pivotal technique for fine-tuning large language models (LLMs) on specific tasks. However, prevailing RL fine-tuning methods predominantly rely on PPO and its variants. Though these algorithms…

Artificial Intelligence · Computer Science 2025-02-25 Hao Ma , Tianyi Hu , Zhiqiang Pu , Boyin Liu , Xiaolin Ai , Yanyan Liang , Min Chen

Large Language Models (LLMs) have showcased remarkable generalizability in language comprehension and hold significant potential to revolutionize human-computer interaction in smart homes. Existing LLM-based smart home assistants typically…

Cryptography and Security · Computer Science 2025-07-15 Xinyu Huang , Leming Shen , Zijing Ma , Yuanqing Zheng

As Large Language Models (LLMs) are increasingly deployed in sensitive domains, traditional data privacy measures prove inadequate for protecting information that is implicit, contextual, or inferable - what we define as semantic privacy.…

Cryptography and Security · Computer Science 2025-07-17 Baihe Ma , Yanna Jiang , Xu Wang , Guangsheng Yu , Qin Wang , Caijun Sun , Chen Li , Xuelei Qi , Ying He , Wei Ni , Ren Ping Liu

Cascades are a common type of machine learning systems in which a large, remote model can be queried if a local model is not able to accurately label a user's data by itself. Serving stacks for large language models (LLMs) increasingly use…

Machine Learning · Computer Science 2024-04-03 Florian Hartmann , Duc-Hieu Tran , Peter Kairouz , Victor Cărbune , Blaise Aguera y Arcas

Large language models (LLMs) are increasingly used in sensitive domains, where their ability to infer personal data from seemingly benign text introduces emerging privacy risks. While recent LLM-based anonymization methods help mitigate…

Computation and Language · Computer Science 2025-10-27 Kyuyoung Kim , Hyunjun Jeon , Jinwoo Shin