English
Related papers

Related papers: Differentially Private In-Context Learning with Ne…

200 papers

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

Computation and Language · Computer Science 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

In this work, we propose the first framework for integrating Differential Privacy (DP) and Contextual Integrity (CI). DP is a property of an algorithm that injects statistical noise to obscure information about individuals represented…

Cryptography and Security · Computer Science 2024-01-30 Sebastian Benthall , Rachel Cummings

Local differential privacy (LDP) has emerged as a promising paradigm for privacy-preserving data collection in distributed systems, where users contribute multi-dimensional records with potentially correlated attributes. Recent work has…

Cryptography and Security · Computer Science 2025-08-20 Sandaru Jayawardana , Sennur Ulukus , Ming Ding , Kanchana Thilakarathna

In-context learning (ICL) has shown impressive results in few-shot learning tasks, yet its underlying mechanism is still not fully understood. A recent line of work suggests that ICL performs gradient descent (GD)-based optimization…

Computation and Language · Computer Science 2024-04-02 Gilad Deutch , Nadav Magar , Tomer Bar Natan , Guy Dar

Decentralized learning (DL) is an emerging paradigm of collaborative machine learning that enables nodes in a network to train models collectively without sharing their raw data or relying on a central server. This paper introduces Zip-DL,…

In-Context Learning (ICL) combined with pre-trained large language models has achieved promising results on various NLP tasks. However, ICL requires high-quality annotated demonstrations which might not be available in real-world scenarios.…

Computation and Language · Computer Science 2023-11-07 Dawei Li , Yaxuan Li , Dheeraj Mekala , Shuyao Li , Yulin wang , Xueqi Wang , William Hogan , Jingbo Shang

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable,…

Computation and Language · Computer Science 2024-05-24 Aldo Gael Carranza , Rezsa Farahani , Natalia Ponomareva , Alex Kurakin , Matthew Jagielski , Milad Nasr

Differential privacy (DP) is a formal notion that restricts the privacy leakage of an algorithm when running on sensitive data, in which privacy-utility trade-off is one of the central problems in private data analysis. In this work, we…

Machine Learning · Computer Science 2025-03-18 Bo Li , Wei Wang , Peng Ye

Differential Privacy (DP) is commonly employed to safeguard graph analysis or publishing. Distance, a critical factor in graph analysis, is typically handled using curator DP, where a trusted curator holds the complete neighbor lists of all…

Cryptography and Security · Computer Science 2025-08-08 Weihong Sheng , Jiajun Chen , Bin Cai , Chunqiang Hu , Meng Han , Jiguo Yu

Despite the surprising few-shot performance of in-context learning (ICL), it is still a common practice to randomly sample examples to serve as context. This paper advocates a new principle for ICL: self-adaptive in-context learning. The…

Computation and Language · Computer Science 2023-05-04 Zhiyong Wu , Yaoxiang Wang , Jiacheng Ye , Lingpeng Kong

Local differential privacy (LDP) is a recently proposed privacy standard for collecting and analyzing data, which has been used, e.g., in the Chrome browser, iOS and macOS. In LDP, each user perturbs her information locally, and only sends…

Cryptography and Security · Computer Science 2019-07-02 Ning Wang , Xiaokui Xiao , Yin Yang , Jun Zhao , Siu Cheung Hui , Hyejin Shin , Junbum Shin , Ge Yu

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Graphs offer unique insights into relationships between entities, complementing data modalities like text and images and enabling AI models to extend their capabilities beyond traditional tasks. However, learning from graphs often involves…

Machine Learning · Computer Science 2025-09-18 Haoteng Yin , Rongzhe Wei , Eli Chien , Pan Li

Pre-trained Large Language Models (LLMs) are an integral part of modern AI that have led to breakthrough performances in complex AI tasks. Major AI companies with expensive infrastructures are able to develop and train these large models…

Cryptography and Security · Computer Science 2023-05-02 Rouzbeh Behnia , Mohamamdreza Ebrahimi , Jason Pacheco , Balaji Padmanabhan

Label differential privacy (DP) is designed for learning problems involving private labels and public features. While various methods have been proposed for learning under label DP, the theoretical limits remain largely unexplored. In this…

Machine Learning · Computer Science 2025-03-04 Puning Zhao , Chuan Ma , Li Shen , Shaowei Wang , Rongfei Fan

Label differential privacy (DP) is a framework that protects the privacy of labels in training datasets, while the feature vectors are public. Existing approaches protect the privacy of labels by flipping them randomly, and then train a…

Machine Learning · Computer Science 2024-05-27 Puning Zhao , Rongfei Fan , Huiwen Wu , Qingming Li , Jiafei Wu , Zhe Liu

Positioned between pre-training and user deployment, aligning large language models (LLMs) through reinforcement learning (RL) has emerged as a prevailing strategy for training instruction following-models such as ChatGPT. In this work, we…

Machine Learning · Computer Science 2024-05-06 Fan Wu , Huseyin A. Inan , Arturs Backurs , Varun Chandrasekaran , Janardhan Kulkarni , Robert Sim

There has been an explosion of research on differential privacy (DP) and its various applications in recent years, ranging from novel variants and accounting techniques in differential privacy to the thriving field of differentially private…

Cryptography and Security · Computer Science 2024-04-09 Saswat Das , Subhankar Mishra