English
Related papers

Related papers: Balance is key: Private median splits yield high-u…

200 papers

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Decision trees are a powerful prediction model with many applications in statistics, data mining, and machine learning. In some settings, the model and the data to be classified may contain sensitive information belonging to different…

Cryptography and Security · Computer Science 2019-09-19 Anselme Tueno , Yordan Boev , Florian Kerschbaum

The protection of sensitive data becomes more vital, as data increases in value and potency. Furthermore, the pressure increases from regulators and society on model developers to make their Artificial Intelligence (AI) models…

Machine Learning · Computer Science 2026-05-12 Florian van der Steen , Fré Vink , Heysem Kaya

We survey distributed deep learning models for training or inference without accessing raw data from clients. These methods aim to protect confidential patterns in data while still allowing servers to train models. The distributed deep…

Machine Learning · Computer Science 2018-12-11 Praneeth Vepakomma , Tristan Swedish , Ramesh Raskar , Otkrist Gupta , Abhimanyu Dubey

We introduce the Poisson Binomial mechanism (PBM), a discrete differential privacy mechanism for distributed mean estimation (DME) with applications to federated learning and analytics. We provide a tight analysis of its privacy guarantees,…

Cryptography and Security · Computer Science 2022-07-21 Wei-Ning Chen , Ayfer Özgür , Peter Kairouz

Differentially-private mechanisms for text generation typically add carefully calibrated noise to input words and use the nearest neighbor to the noised input as the output word. When the noise is small in magnitude, these mechanisms are…

Computation and Language · Computer Science 2021-04-27 Zekun Xu , Abhinav Aggarwal , Oluwaseyi Feyisetan , Nathanael Teissier

There is great demand for scalable, secure, and efficient privacy-preserving machine learning models that can be trained over distributed data. While deep learning models typically achieve the best results in a centralized non-secure…

Cryptography and Security · Computer Science 2022-11-09 Samuel Maddock , Graham Cormode , Tianhao Wang , Carsten Maple , Somesh Jha

We study the private $k$-median and $k$-means clustering problem in $d$ dimensional Euclidean space. By leveraging tree embeddings, we give an efficient and easy to implement algorithm, that is empirically competitive with state of the art…

Popular approaches to differential privacy, such as the Laplace and exponential mechanisms, calibrate randomised smoothing through global sensitivity of the target non-private function. Bounding such sensitivity is often a prohibitively…

Machine Learning · Computer Science 2017-06-12 Benjamin I. P. Rubinstein , Francesco Aldà

We propose a novel algorithm for optimizing multivariate linear threshold functions as split functions of decision trees to create improved Random Forest classifiers. Standard tree induction methods resort to sampling and exhaustive search…

Machine Learning · Computer Science 2015-06-26 Mohammad Norouzi , Maxwell D. Collins , David J. Fleet , Pushmeet Kohli

While normalizing flows for continuous data have been extensively researched, flows for discrete data have only recently been explored. These prior models, however, suffer from limitations that are distinct from those of continuous flows.…

Machine Learning · Computer Science 2022-07-06 Mai Elkady , Jim Lim , David I. Inouye

In this work, we propose a differentially private algorithm for publishing matrices aggregated from sparse vectors. These matrices include social network adjacency matrices, user-item interaction matrices in recommendation systems, and…

Cryptography and Security · Computer Science 2025-06-26 Quentin Hillebrand , Vorapong Suppakitpaisarn , Tetsuo Shibuya

We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate…

Machine Learning · Statistics 2018-12-05 Mijung Park , James Foulds , Kamalika Chaudhuri , Max Welling

Statistical agencies rely on sampling techniques to collect socio-demographic data crucial for policy-making and resource allocation. This paper shows that surveys of important societal relevance introduce sampling errors that unevenly…

Cryptography and Security · Computer Science 2025-01-22 Joonhyuk Ko , Juba Ziani , Saswat Das , Matt Williams , Ferdinando Fioretto

Recent increase in online privacy concerns prompts the following question: can a recommender system be accurate if users do not entrust it with their private data? To answer this, we study the problem of learning item-clusters under local…

Machine Learning · Computer Science 2014-10-29 Siddhartha Banerjee , Nidhi Hegde , Laurent Massoulié

Differential privacy is a mathematical concept that provides an information-theoretic security guarantee. While differential privacy has emerged as a de facto standard for guaranteeing privacy in data sharing, the known mechanisms to…

Cryptography and Security · Computer Science 2024-03-26 March Boedihardjo , Thomas Strohmer , Roman Vershynin

Motivated by applications in clustering and synthetic data generation, we consider the problem of releasing a minimum spanning tree (MST) under edge-weight differential privacy constraints where a graph topology $G=(V,E)$ with $n$ vertices…

Data Structures and Algorithms · Computer Science 2024-08-14 Rasmus Pagh , Lukas Retschmeier

We develop differentially private methods for estimating various distributional properties. Given a sample from a discrete distribution $p$, some functional $f$, and accuracy and privacy parameters $\alpha$ and $\varepsilon$, the goal is to…

Data Structures and Algorithms · Computer Science 2018-03-02 Jayadev Acharya , Gautam Kamath , Ziteng Sun , Huanyu Zhang

We propose an algorithm named best-scored random forest for binary classification problems. The terminology "best-scored" means to select the one with the best empirical performance out of a certain number of purely random tree candidates…

Machine Learning · Statistics 2019-05-28 Hanyuan Hang , Xiaoyu Liu , Ingo Steinwart

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian