English
Related papers

Related papers: Revisiting Hyperparameter Tuning with Differential…

200 papers

As increasing amounts of sensitive personal information is aggregated into data repositories, it has become important to develop mechanisms for processing the data without revealing information about individual data instances. The…

Machine Learning · Statistics 2015-03-17 Manas A. Pathak , Bhiksha Raj

Supervised learning models have been increasingly used for making decisions about individuals in applications such as hiring, lending, and college admission. These models may inherit pre-existing biases from training datasets and…

Machine Learning · Computer Science 2020-12-08 Mohammad Mahdi Khalili , Xueru Zhang , Mahed Abroshan , Somayeh Sojoudi

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

This position paper argues that setting the privacy budget in differential privacy should not be viewed as an important limitation of differential privacy compared to alternative methods for privacy-preserving machine learning. The…

Cryptography and Security · Computer Science 2026-01-21 Edwige Cyffers

Machine learning models in health care are often deployed in settings where it is important to protect patient privacy. In such settings, methods for differentially private (DP) learning provide a general-purpose approach to learn models…

Machine Learning · Computer Science 2020-10-15 Vinith M. Suriyakumar , Nicolas Papernot , Anna Goldenberg , Marzyeh Ghassemi

The performance of many machine learning algorithms depends on their hyperparameter settings. The goal of this study is to determine whether it is important to tune a hyperparameter or whether it can be safely set to a default value. We…

Machine Learning · Computer Science 2020-07-16 Hilde J. P. Weerts , Andreas C. Mueller , Joaquin Vanschoren

Differential privacy is a precise mathematical constraint meant to ensure privacy of individual pieces of information in a database even while queries are being answered about the aggregate. Intuitively, one must come to terms with what…

Information Theory · Computer Science 2016-08-15 Paul Cuff , Lanqing Yu

In this paper, we present a comprehensive framework for differential privacy over affine manifolds and validate its usefulness in the contexts of differentially private cloud-based control and average consensus. We consider differential…

Systems and Control · Electrical Eng. & Systems 2026-01-22 Zihao Ren , Lei Wang , Deming Yuan , Guodong Shi

This paper investigates the privacy funnel, a privacy-utility tradeoff problem in which mutual information quantifies both privacy and utility. The objective is to maximize utility while adhering to a specified privacy budget. However, the…

Information Theory · Computer Science 2024-08-20 Mohammad Amin Zarrabian , Parastoo Sadeghi

Densest subgraph detection is a fundamental graph mining problem, with a large number of applications. There has been a lot of work on efficient algorithms for finding the densest subgraph in massive networks. However, in many domains, the…

Data Structures and Algorithms · Computer Science 2024-06-05 Dung Nguyen , Anil Vullikanti

The increasing use of machine learning in sensitive applications demands algorithms that simultaneously preserve data privacy and ensure fairness across potentially sensitive sub-populations. While privacy and fairness have each been…

Machine Learning · Statistics 2025-11-25 Lilian Say , Christophe Denis , Rafael Pinot

The proliferation of deep learning applications in healthcare calls for data aggregation across various institutions, a practice often associated with significant privacy concerns. This concern intensifies in medical image analysis, where…

Machine Learning · Computer Science 2023-07-03 Kishore Babu Nampalle , Pradeep Singh , Uppala Vivek Narayan , Balasubramanian Raman

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Differential privacy is an information theoretic constraint on algorithms and code. It provides quantification of privacy leakage and formal privacy guarantees that are currently considered the gold standard in privacy protections. In this…

Cryptography and Security · Computer Science 2020-05-14 Daniel Kifer , Solomon Messing , Aaron Roth , Abhradeep Thakurta , Danfeng Zhang

Differential privacy (DP) is a compelling privacy definition that explains the privacy-utility tradeoff via formal, provable guarantees. Inspired by recent progress toward general-purpose data release algorithms, we propose a private…

Data Structures and Algorithms · Computer Science 2020-06-17 Benjamin Coleman , Anshumali Shrivastava

We study the problem of multi-task learning under user-level differential privacy, in which $n$ users contribute data to $m$ tasks, each involving a subset of users. One important aspect of the problem, that can significantly impact…

Machine Learning · Computer Science 2023-02-17 Walid Krichene , Prateek Jain , Shuang Song , Mukund Sundararajan , Abhradeep Thakurta , Li Zhang

Differential privacy is a notion of privacy that has become very popular in the database community. Roughly, the idea is that a randomized query mechanism provides sufficient privacy protection if the ratio between the probabilities that…

Cryptography and Security · Computer Science 2014-06-18 Mário S. Alvim , Miguel E. Andrés , Konstantinos Chatzikokolakis , Pierpaolo Degano , Catuscia Palamidessi

The ubiquity of distributed machine learning (ML) in sensitive public domain applications calls for algorithms that protect data privacy, while being robust to faults and adversarial behaviors. Although privacy and robustness have been…

Machine Learning · Computer Science 2023-05-30 Youssef Allouah , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot , John Stephan