English
Related papers

Related papers: Optimal Tree-Based Mechanisms for Differentially P…

200 papers

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

Differentially private (DP) mechanisms protect individual-level information by introducing randomness into the statistical analysis procedure. Despite the availability of numerous DP tools, there remains a lack of general techniques for…

Machine Learning · Statistics 2025-09-25 Zhanyu Wang , Guang Cheng , Jordan Awan

We study efficient mechanisms for the query release problem in differential privacy: given a workload of $m$ statistical queries, output approximate answers to the queries while satisfying the constraints of differential privacy. In…

Data Structures and Algorithms · Computer Science 2018-11-12 Jaroslaw Blasiok , Mark Bun , Aleksandar Nikolov , Thomas Steinke

Most existing Secure Multi-Party Computation (MPC) protocols for privacy-preserving training of decision trees over distributed data assume that the features are categorical. In real-life applications, features are often numerical. The…

We investigate the problem of best policy identification in discounted linear Markov Decision Processes in the fixed confidence setting under a generative model. We first derive an instance-specific lower bound on the expected number of…

Machine Learning · Computer Science 2022-08-12 Jerome Taupin , Yassir Jedra , Alexandre Proutiere

We study the problem of sampling from a distribution under local differential privacy (LDP). Given a private distribution $P \in \mathcal{P}$, the goal is to generate a single sample from a distribution that remains close to $P$ in…

Machine Learning · Computer Science 2025-10-13 Hrad Ghoukasian , Bonwoo Lee , Shahab Asoodeh

A common problem in private data analysis is the partition selection problem, where each user holds a set of partitions (e.g. keys in a GROUP BY operation) from a possibly unbounded set. The challenge here is in maximizing the set of…

Cryptography and Security · Computer Science 2026-03-12 Charlie Harrison , Pasin Manurangsi

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

Trust in counterfactual explanations depends critically on whether their recommended changes are truly minimal: suboptimal explanations may vastly overshoot the actual changes needed to alter a decision, and heuristic errors can affect…

Machine Learning · Computer Science 2026-05-08 Awa Khouna , Youssouf Emine , Julien Ferry , Thibaut Vidal

Differentially private (DP) transfer learning, i.e., fine-tuning a pretrained model on private data, is the current state-of-the-art approach for training large models under privacy constraints. We focus on two key hyperparameters in this…

Machine Learning · Computer Science 2026-04-20 Aki Rehn , Linzh Zhao , Mikko A. Heikkilä , Antti Honkela

Previous work on user-level differential privacy (DP) [Ghazi et al. NeurIPS 2021, Bun et al. STOC 2023] obtained generic algorithms that work for various learning tasks. However, their focus was on the example-rich regime, where the users…

Data Structures and Algorithms · Computer Science 2023-09-25 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Raghu Meka , Chiyuan Zhang

We study how to release summary statistics on a data stream subject to the constraint of differential privacy. In particular, we focus on releasing the family of symmetric norms, which are invariant under sign-flips and coordinate-wise…

Data Structures and Algorithms · Computer Science 2023-07-11 Vladimir Braverman , Joel Manning , Zhiwei Steven Wu , Samson Zhou

We propose a novel mechanism for answering sets of count- ing queries under differential privacy. Given a workload of counting queries, the mechanism automatically selects a different set of "strategy" queries to answer privately, using…

Databases · Computer Science 2012-02-20 Chao Li , Gerome Miklau

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

Much of the literature on differential privacy focuses on item-level privacy, where loosely speaking, the goal is to provide privacy per item or training example. However, recently many practical applications such as federated learning…

Machine Learning · Computer Science 2021-01-13 Yuhan Liu , Ananda Theertha Suresh , Felix Yu , Sanjiv Kumar , Michael Riley

Differential Privacy (DP) is being increasingly adopted for non-Euclidean data that lie on complex, high-dimensional manifolds. Existing DP mechanisms for manifold data consider geometric properties when calibrating privacy perturbations,…

Cryptography and Security · Computer Science 2026-05-12 Peilin He , Liou Tang , M. Amin Rahimian , James Joshi

Vertical Federated Learning (FL) is a new paradigm that enables users with non-overlapping attributes of the same data samples to jointly train a model without directly sharing the raw data. Nevertheless, recent works show that it's still…

Machine Learning · Computer Science 2022-10-05 Xiaochen Li , Yuke Hu , Weiran Liu , Hanwen Feng , Li Peng , Yuan Hong , Kui Ren , Zhan Qin

Differential privacy (DP) ensures that training a machine learning model does not leak private data. In practice, we may have access to auxiliary public data that is free of privacy concerns. In this work, we assume access to a given amount…

Machine Learning · Computer Science 2024-09-11 Andrew Lowy , Zeman Li , Tianjian Huang , Meisam Razaviyayn

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distribution that is close…

Machine Learning · Computer Science 2022-11-16 Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith , Marika Swanberg

Answering range queries in the context of Local Differential Privacy (LDP) is a widely studied problem in Online Analytical Processing (OLAP). Existing LDP solutions all assume a uniform data distribution within each domain partition, which…

Cryptography and Security · Computer Science 2024-08-27 Leixia Wang , Qingqing Ye , Haibo Hu , Xiaofeng Meng