English
Related papers

Related papers: Personalized Privacy Auditing and Optimization at …

200 papers

Privacy and transparency are two key foundations of trustworthy machine learning. Model explanations offer insights into a model's decisions on input data, whereas privacy is primarily concerned with protecting information about the…

Machine Learning · Computer Science 2021-02-08 Reza Shokri , Martin Strobel , Yair Zick

Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearning, such that a learnt model will not expose user's privacy…

Machine Learning · Computer Science 2022-04-19 Tao Guo , Song Guo , Jiewei Zhang , Wenchao Xu , Junxiao Wang

Bias in data can have unintended consequences that propagate to the design, development, and deployment of machine learning models. In the financial services sector, this can result in discrimination from certain financial instruments and…

Cryptography and Security · Computer Science 2019-11-12 Reginald Bryant , Celia Cintas , Isaac Wambugu , Andrew Kinai , Komminist Weldemariam

Modern machine learning models are complex and frequently encode surprising amounts of information about individual inputs. In extreme cases, complex models appear to memorize entire input examples, including seemingly irrelevant…

Machine Learning · Computer Science 2021-07-23 Gavin Brown , Mark Bun , Vitaly Feldman , Adam Smith , Kunal Talwar

Algorithmic fairness and privacy are essential pillars of trustworthy machine learning. Fair machine learning aims at minimizing discrimination against protected groups by, for example, imposing a constraint on models to equalize their…

Machine Learning · Statistics 2021-04-08 Hongyan Chang , Reza Shokri

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

Cryptography and Security · Computer Science 2020-12-10 Liwei Song , Prateek Mittal

As predictive models are increasingly being employed to make consequential decisions, there is a growing emphasis on developing techniques that can provide algorithmic recourse to affected individuals. While such recourses can be immensely…

Machine Learning · Computer Science 2023-04-20 Martin Pawelczyk , Himabindu Lakkaraju , Seth Neel

AI agents powered by reasoning models require access to sensitive user data. However, their reasoning traces are difficult to control, which can result in the unintended leakage of private information to external parties. We propose…

Computation and Language · Computer Science 2026-03-02 Haritz Puerto , Haonan Li , Xudong Han , Timothy Baldwin , Iryna Gurevych

Neural networks pose a privacy risk to training data due to their propensity to memorise and leak information. Focusing on image classification, we show that neural networks also unintentionally memorise unique features even when they occur…

Machine Learning · Computer Science 2022-06-06 John Hartley , Sotirios A. Tsaftaris

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sensitive information.…

Machine Learning · Computer Science 2018-04-12 Yue Wang , Daniel Kifer , Jaewoo Lee

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

In this work we address the practical challenges of training machine learning models on privacy-sensitive datasets by introducing a modular approach that minimizes changes to training algorithms, provides a variety of configuration…

Machine Learning · Computer Science 2019-03-05 H. Brendan McMahan , Galen Andrew , Ulfar Erlingsson , Steve Chien , Ilya Mironov , Nicolas Papernot , Peter Kairouz

The daily activities performed by a disabled or elderly person can be monitored by a smart environment, and the acquired data can be used to learn a predictive model of user behavior. To speed up the learning, several researchers designed…

Machine Learning · Computer Science 2021-01-19 Sharare Zehtabian , Siavash Khodadadeh , Ladislau Bölöni , Damla Turgut

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

The concept of privacy is inherently intertwined with human attitudes and behaviours, as most computer systems are primarily designed for human use. Especially in the case of Recommender Systems, which feed on information provided by…

Computers and Society · Computer Science 2018-05-23 Sanchit Alekh

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Deployment of deep learning in different fields and industries is growing day by day due to its performance, which relies on the availability of data and compute. Data is often crowd-sourced and contains sensitive information about its…

Machine Learning · Computer Science 2020-10-06 Tom Farrand , Fatemehsadat Mireshghallah , Sahib Singh , Andrew Trask

Synthetic datasets are often presented as a silver-bullet solution to the problem of privacy-preserving data publishing. However, for many applications, synthetic data has been shown to have limited utility when used to train predictive…

Federated learning enables training a global machine learning model from data distributed across multiple sites, without having to move the data. This is particularly relevant in healthcare applications, where data is rife with personal,…

Cryptography and Security · Computer Science 2020-02-24 Olivia Choudhury , Aris Gkoulalas-Divanis , Theodoros Salonidis , Issa Sylla , Yoonyoung Park , Grace Hsu , Amar Das