English
Related papers

Related papers: Balance is key: Private median splits yield high-u…

200 papers

The potential lack of fairness in the outputs of machine learning algorithms has recently gained attention both within the research community as well as in society more broadly. Surprisingly, there is no prior work developing tree-induction…

Machine Learning · Statistics 2017-12-25 Edward Raff , Jared Sylvester , Steven Mills

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

In this paper, we present the first differentially private clustering method for arbitrary-shaped node clusters in a graph. This algorithm takes as input only an approximate Minimum Spanning Tree (MST) $\mathcal{T}$ released under weight…

Data Structures and Algorithms · Computer Science 2018-03-13 Rafael Pinot , Anne Morvan , Florian Yger , Cédric Gouy-Pailler , Jamal Atif

Without access to large compute clusters, building random forests on large datasets is still a challenging problem. This is, in particular, the case if fully-grown trees are desired. We propose a simple yet effective framework that allows…

Machine Learning · Computer Science 2018-02-20 Fabian Gieseke , Christian Igel

Decision trees and randomized forests are widely used in computer vision and machine learning. Standard algorithms for decision tree induction optimize the split functions one node at a time according to some splitting criteria. This greedy…

Machine Learning · Computer Science 2015-11-13 Mohammad Norouzi , Maxwell D. Collins , Matthew Johnson , David J. Fleet , Pushmeet Kohli

In recent years, machine learning techniques utilizing large-scale datasets have achieved remarkable performance. Differential privacy, by means of adding noise, provides strong privacy guarantees for such learning algorithms. The cost of…

Cryptography and Security · Computer Science 2021-07-16 Rakshit Naidu , Harshita Diddee , Ajinkya Mulay , Aleti Vardhan , Krithika Ramesh , Ahmed Zamzam

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

This paper is motivated by applications of a Census Bureau interested in releasing aggregate socio-economic data about a large population without revealing sensitive information about any individual. The released information can be the…

Databases · Computer Science 2021-05-11 Ferdinando Fioretto , Pascal Van Hentenryck , Keyu Zhu

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy provides a rigorous…

Machine Learning · Statistics 2025-08-08 Ziliang Shen , Caixing Wang , Shaoli Wang , Yibo Yan

Privacy and algorithmic fairness have become two central issues in modern machine learning. Although each has separately emerged as a rapidly growing research area, their joint effect remains comparatively under-explored. In this paper, we…

Machine Learning · Statistics 2026-03-26 Gengyu Xue , Yi Yu

Many commonly used learning algorithms work by iteratively updating an intermediate solution using one or a few data points in each iteration. Analysis of differential privacy for such algorithms often involves ensuring privacy of each step…

Machine Learning · Computer Science 2018-12-12 Vitaly Feldman , Ilya Mironov , Kunal Talwar , Abhradeep Thakurta

In the era of big data, leveraging information from multiple clients while preserving data privacy has emerged as a critical challenge in modern statistical modeling and forecasting. This paper introduces a privacy-preserving federated…

Methodology · Statistics 2026-04-09 Kejun Chen , Qianqian Zhu

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin

Random forests are popular methods for regression and classification analysis, and many different variants have been proposed in recent years. One interesting example is the Mondrian random forest, in which the underlying constituent trees…

Statistics Theory · Mathematics 2025-11-10 Matias D. Cattaneo , Jason M. Klusowski , William G. Underwood

Differential privacy is known to protect against threats to validity incurred due to adaptive, or exploratory, data analysis -- even when the analyst adversarially searches for a statistical estimate that diverges from the true value of the…

Cryptography and Security · Computer Science 2022-07-25 Elbert Du , Cynthia Dwork

Many modern statistical analysis and machine learning applications require training models on sensitive user data. Under a formal definition of privacy protection, differentially private algorithms inject calibrated noise into the…

Machine Learning · Statistics 2025-04-01 Yifei Xiong , Nianqiao Phyllis Ju , Sanguo Zhang

Differentially Private (DP) data release is a promising technique to disseminate data without compromising the privacy of data subjects. However the majority of prior work has focused on scenarios where a single party owns all the data. In…

Cryptography and Security · Computer Science 2022-06-22 Ruihan Wu , Xin Yang , Yuanshun Yao , Jiankai Sun , Tianyi Liu , Kilian Q. Weinberger , Chong Wang

We seek decision rules for prediction-time cost reduction, where complete data is available for training, but during prediction-time, each feature can only be acquired for an additional cost. We propose a novel random forest algorithm to…

Machine Learning · Statistics 2015-02-23 Feng Nan , Joseph Wang , Venkatesh Saligrama

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

We present new differentially private algorithms for learning a large-margin halfspace. In contrast to previous algorithms, which are based on either differentially private simulations of the statistical query model or on private convex…

Machine Learning · Computer Science 2020-02-25 Huy L. Nguyen , Jonathan Ullman , Lydia Zakynthinou