English
Related papers

Related papers: Data Minimization at Inference Time

200 papers

Data are often accommodated on centralized storage servers. This is the case, for instance, in remote sensing and astronomy, where projects produce several petabytes of data every year. While machine learning models are often trained on…

Machine Learning · Computer Science 2022-01-20 Stefan Oehmcke , Fabian Gieseke

Differential privacy is a strong mathematical notion of privacy. Still, a prominent challenge when using differential privacy in real data collection is understanding and counteracting the accuracy loss that differential privacy imposes. As…

Cryptography and Security · Computer Science 2021-08-24 Boel Nelson

Study samples often differ from the target populations of inference and policy decisions in non-random ways. Researchers typically believe that such departures from random sampling -- due to changes in the population over time and space, or…

Methodology · Statistics 2023-07-20 Tamara Broderick , Ryan Giordano , Rachael Meager

Interpretable predictions, where it is clear why a machine learning model has made a particular decision, can compromise privacy by revealing the characteristics of individual data points. This raises the central question addressed in this…

Machine Learning · Computer Science 2020-04-07 Frederik Harder , Matthias Bauer , Mijung Park

Machine learning systems can produce personalized outputs that allow an adversary to infer sensitive input attributes at inference time. We introduce Robust Privacy (RP), an inference-time privacy notion inspired by certified robustness: if…

Machine Learning · Computer Science 2026-01-27 Jiankai Jin , Xiangzheng Zhang , Zhao Liu , Deyue Zhang , Quanchen Zou

Inferring reward functions from human behavior is at the center of value alignment - aligning AI objectives with what we, humans, actually want. But doing so relies on models of how humans behave given their objectives. After decades of…

Machine Learning · Computer Science 2023-10-31 Joey Hong , Kush Bhatia , Anca Dragan

We describe and analyze efficient algorithms for learning a linear predictor from examples when the learner can only view a few attributes of each training example. This is the case, for instance, in medical research, where each patient…

Machine Learning · Computer Science 2010-04-29 Nicolò Cesa-Bianchi , Shai Shalev-Shwartz , Ohad Shamir

User-level privacy is important in distributed systems. Previous research primarily focuses on the central model, while the local models have received much less attention. Under the central model, user-level DP is strictly stronger than the…

Machine Learning · Statistics 2024-05-28 Puning Zhao , Li Shen , Rongfei Fan , Qingming Li , Huiwen Wu , Jiafei Wu , Zhe Liu

We propose and analyze algorithms to solve a range of learning tasks under user-level differential privacy constraints. Rather than guaranteeing only the privacy of individual samples, user-level DP protects a user's entire contribution ($m…

Machine Learning · Computer Science 2021-12-06 Daniel Levy , Ziteng Sun , Kareem Amin , Satyen Kale , Alex Kulesza , Mehryar Mohri , Ananda Theertha Suresh

Differentially private federated learning is crucial for maintaining privacy in distributed environments. This paper investigates the challenges of high-dimensional estimation and inference under the constraints of differential privacy.…

Machine Learning · Statistics 2024-04-26 Zhe Zhang , Ryumei Nakada , Linjun Zhang

The principle of data minimization aims to reduce the amount of data collected, processed or retained to minimize the potential for misuse, unauthorized access, or data breaches. Rooted in privacy-by-design principles, data minimization has…

Machine Learning · Computer Science 2024-05-31 Prakhar Ganesh , Cuong Tran , Reza Shokri , Ferdinando Fioretto

When a machine-learning algorithm makes biased decisions, it can be helpful to understand the sources of disparity to explain why the bias exists. Towards this, we examine the problem of quantifying the contribution of each individual…

Machine Learning · Computer Science 2022-06-20 Sanghamitra Dutta , Praveen Venkatesh , Pulkit Grover

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

The Internet of Things (IoT) promises to improve user utility by tuning applications to user behavior, but revealing the characteristics of a user's behavior presents a significant privacy risk. Our previous work has established the…

Cryptography and Security · Computer Science 2020-07-14 Nazanin Takbiri , Minting Chen , Dennis L. Goeckel , Amir Houmansadr , Hossein Pishro-Nik

The purpose of anonymizing structured data is to protect the privacy of individuals in the data while retaining the statistical properties of the data. An important class of attack on anonymized data is attribute inference, where an…

Cryptography and Security · Computer Science 2025-07-03 Paul Francis , David Wagner

Current privacy research on large language models (LLMs) primarily focuses on the issue of extracting memorized training data. At the same time, models' inference capabilities have increased drastically. This raises the key question of…

Artificial Intelligence · Computer Science 2024-05-07 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Consider making a prediction over new test data without any opportunity to learn from a training set of labelled data - instead given access to a set of expert models and their predictions alongside some limited information about the…

Machine Learning · Computer Science 2022-10-12 Alex J. Chan , Mihaela van der Schaar

A membership-inference attack gets the output of a learning algorithm, and a target individual, and tries to determine whether this individual is a member of the training data or an independent sample from the same distribution. A…

Machine Learning · Computer Science 2025-08-28 Mahdi Haghifam , Adam Smith , Jonathan Ullman

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

In this paper we examine the problem of inference in Bayesian Networks with discrete random variables that have very large or even unbounded domains. For example, in a domain where we are trying to identify a person, we may have variables…

Artificial Intelligence · Computer Science 2012-12-12 Rita Sharma , David L Poole