English
Related papers

Related papers: dpUGC: Learn Differentially Private Representation…

200 papers

Differential Privacy (DP) provides a rigorous framework for releasing statistics while protecting individual information present in a dataset. Although substantial progress has been made on differentially private linear regression, existing…

Statistics Theory · Mathematics 2026-01-16 Getoar Sopa , Marco Avella Medina , Cynthia Rush

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by grounding them in external knowledge. However, its application in sensitive domains is limited by privacy risks. Existing private RAG methods typically rely on…

Cryptography and Security · Computer Science 2026-05-13 Junki Mori , Kazuya Kakizaki , Taiki Miyagawa , Jun Sakuma

Cooperative decentralized learning relies on direct information exchange between communicating agents, each with access to locally available datasets. The goal is to agree on model parameters that are optimal over all data. However, sharing…

Machine Learning · Computer Science 2024-10-28 Jasmine Bayrooti , Zhan Gao , Amanda Prorok

Generative AI offers transformative potential for high-stakes domains such as healthcare and finance, yet privacy and regulatory barriers hinder the use of real-world data. To address this, differentially private synthetic data generation…

Privacy is an important concern when building statistical models on data containing personal information. Differential privacy offers a strong definition of privacy and can be used to solve several privacy concerns (Dwork et al., 2014).…

Cryptography and Security · Computer Science 2021-02-03 Satyapriya Krishna , Rahul Gupta , Christophe Dupuy

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Ensuring the privacy of users whose data are used to train Natural Language Processing (NLP) models is necessary to build and maintain customer trust. Differential Privacy (DP) has emerged as the most successful method to protect the…

Cryptography and Security · Computer Science 2021-07-19 Ricardo Silva Carvalho , Theodore Vasiloudis , Oluwaseyi Feyisetan

Generative Adversarial Network (GAN) and its variants have recently attracted intensive research interests due to their elegant theoretical foundation and excellent empirical performance as generative models. These tools provide a promising…

Machine Learning · Computer Science 2018-02-20 Liyang Xie , Kaixiang Lin , Shu Wang , Fei Wang , Jiayu Zhou

Differential Privacy offers strong guarantees such as immutable privacy under post processing. Thus it is often looked to as a solution to learning on scattered and isolated data. This work focuses on supervised manifold learning, a…

Machine Learning · Computer Science 2021-10-06 Praneeth Vepakomma , Julia Balla , Ramesh Raskar

While the flexible capabilities of large language models (LLMs) allow them to answer a range of queries based on existing learned knowledge, information retrieval to augment generation is an important tool to allow LLMs to answer questions…

Information Retrieval · Computer Science 2023-11-23 Guy Zyskind , Tobin South , Alex Pentland

Many data mining and analytical tasks rely on the abstraction of networks (graphs) to summarize relational structures among individuals (nodes). Since relational data are often sensitive, we aim to seek effective approaches to generate…

Social and Information Networks · Computer Science 2021-05-04 Carl Yang , Haonan Wang , Ke Zhang , Liang Chen , Lichao Sun

High-dimensional data are widely used in the era of deep learning with numerous applications. However, certain data which has sensitive information are not allowed to be shared without privacy protection. In this paper, we propose a novel…

Machine Learning · Computer Science 2023-10-10 Dongjie Chen , Sen-ching S. Cheung , Chen-Nee Chuah

Contextual word representations generated by language models (LMs) learn spurious associations present in the training corpora. Recent findings reveal that adversaries can exploit these associations to reverse-engineer the private…

Computation and Language · Computer Science 2021-12-08 Geetanjali Bihani

Many existing privacy-enhanced speech emotion recognition (SER) frameworks focus on perturbing the original speech data through adversarial training within a centralized machine learning setup. However, this privacy protection scheme can…

Cryptography and Security · Computer Science 2023-04-18 Tiantian Feng , Raghuveer Peri , Shrikanth Narayanan

The meaning of a word often varies depending on its usage in different domains. The standard word embedding models struggle to represent this variation, as they learn a single global representation for a word. We propose a method to learn…

Computation and Language · Computer Science 2019-10-22 Lahari Poddar , Gyorgy Szarvas , Lea Frermann

In many practical natural language applications, user data are highly sensitive, requiring anonymous uploads of text data from mobile devices to the cloud without user identifiers. However, the absence of user identifiers restricts the…

Machine Learning · Computer Science 2025-01-13 Yucheng Ding , Yangwenjian Tan , Xiangyu Liu , Chaoyue Niu , Fandong Meng , Jie Zhou , Ning Liu , Fan Wu , Guihai Chen

What should a malicious user write next to fool a detection model? Identifying malicious users is critical to ensure the safety and integrity of internet platforms. Several deep learning-based detection models have been created. However,…

Machine Learning · Computer Science 2021-10-20 Bing He , Mustaque Ahamad , Srijan Kumar

Language models are widely deployed to provide automatic text completion services in user products. However, recent research has revealed that language models (especially large ones) bear considerable risk of memorizing private training…

Computation and Language · Computer Science 2022-12-19 C. M. Downey , Wei Dai , Huseyin A. Inan , Kim Laine , Saurabh Naik , Tomasz Religa