English
Related papers

Related papers: Majority Vote for Distributed Differentially Priva…

200 papers

Federated learning enables training machine learning models while preserving the privacy of participants. Surprisingly, there is no differentially private distributed method for smooth, non-convex optimization problems. The reason is that…

Machine Learning · Computer Science 2025-02-20 Egor Shulgin , Sarit Khirirat , Peter Richtárik

The objective of differential privacy (DP) is to protect privacy by producing an output distribution that is indistinguishable between any two neighboring databases. However, traditional differentially private mechanisms tend to produce…

Cryptography and Security · Computer Science 2023-11-07 Kai Zhang , Yanjun Zhang , Ruoxi Sun , Pei-Wei Tsai , Muneeb Ul Hassan , Xin Yuan , Minhui Xue , Jinjun Chen

The iterative nature of the expectation maximization (EM) algorithm presents a challenge for privacy-preserving estimation, as each iteration increases the amount of noise needed. We propose a practical private EM algorithm that overcomes…

Machine Learning · Computer Science 2016-11-01 Mijung Park , Jimmy Foulds , Kamalika Chaudhuri , Max Welling

In the identification of differential equations from data, significant progresses have been made with the weak/integral formulation. In this paper, we explore the direction of finding more efficient and robust test functions adaptively…

Numerical Analysis · Mathematics 2025-06-05 Jiahui Cheng , Sung Ha Kang , Haomin Zhou , Wenjing Liao

We consider the setting where a user with sensitive features wishes to obtain a recommendation from a server in a differentially private fashion. We propose a ``multi-selection'' architecture where the server can send back multiple…

Data Structures and Algorithms · Computer Science 2024-07-23 Ashish Goel , Zhihao Jiang , Aleksandra Korolova , Kamesh Munagala , Sahasrajit Sarmasarkar

We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate…

Machine Learning · Statistics 2018-12-05 Mijung Park , James Foulds , Kamalika Chaudhuri , Max Welling

Differential Privacy (DP) is a probabilistic framework that protects privacy while preserving data utility. To protect the privacy of the individuals in the dataset, DP requires adding a precise amount of noise to a statistic of interest;…

Computation · Statistics 2025-05-05 Yu-Wei Chen , Pranav Sanghi , Jordan Awan

Large Reasoning Models have demonstrated remarkable performance with the advancement of test-time scaling techniques, which enhances prediction accuracy by generating multiple candidate responses and selecting the most reliable answer.…

Machine Learning · Computer Science 2026-03-05 Xizhong Yang , Haotian Zhang , Huiming Wang , Mofei Song

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce…

Cryptography and Security · Computer Science 2024-02-02 Richeng Jin , Zhonggen Su , Caijun Zhong , Zhaoyang Zhang , Tony Quek , Huaiyu Dai

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Symbolic Regression is a powerful data-driven technique that searches for mathematical expressions that explain the relationship between input variables and a target of interest. Due to its efficiency and flexibility, Genetic Programming…

Cryptography and Security · Computer Science 2023-07-25 Du Nguyen Duy , Michael Affenzeller , Ramin-Nikzad Langerodi

In this paper, we present enhanced analysis for sign-based optimization algorithms with momentum updates. Traditional sign-based methods, under the separable smoothness assumption, guarantee a convergence rate of $\mathcal{O}(T^{-1/4})$,…

Optimization and Control · Mathematics 2025-07-17 Wei Jiang , Dingzhi Yu , Sifan Yang , Wenhao Yang , Lijun Zhang

This paper introduces the first provably accurate algorithms for differentially private, top-down decision tree learning in the distributed setting (Balcan et al., 2012). We propose DP-TopDown, a general privacy preserving decision tree…

Machine Learning · Computer Science 2021-02-24 Kaiwen Wang , Travis Dick , Maria-Florina Balcan

We propose a locally differentially private graph clustering algorithm. Previous works have explored this problem, including approaches that apply spectral clustering to graphs generated via the randomized response algorithm. However, these…

Data Structures and Algorithms · Computer Science 2025-05-19 Vorapong Suppakitpaisarn , Sayan Mukherjee

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One approach to study these concerns is through the lens of differential privacy. In this framework,…

Machine Learning · Computer Science 2020-03-03 Lichao Sun , Yingbo Zhou , Philip S. Yu , Caiming Xiong

Preserving differential privacy has been well studied under centralized setting. However, it's very challenging to preserve differential privacy under multiparty setting, especially for the vertically partitioned case. In this work, we…

Machine Learning · Computer Science 2019-11-13 Depeng Xu , Shuhan Yuan , Xintao Wu

We focus on the scenario in which an agent can exploit his information advantage to manipulate the outcome of an election. In particular, we study district-based elections with two candidates, in which the winner of the election is the…

Computer Science and Game Theory · Computer Science 2020-12-11 Matteo Castiglioni , Nicola Gatti

Many applications of machine learning, such as human health research, involve processing private or sensitive information. Privacy concerns may impose significant hurdles to collaboration in scenarios where there are multiple sites holding…

Machine Learning · Computer Science 2021-02-24 Hafiz Imtiaz , Jafar Mohammadi , Anand D. Sarwate

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

We study a setting of collecting and learning from private data distributed across end users. In the shuffled model of differential privacy, the end users partially protect their data locally before sharing it, and their data is also…

Machine Learning · Computer Science 2025-02-21 Tal Wagner