English
Related papers

Related papers: Differential Privacy for Sparse Classification Lea…

200 papers

In this paper we consider the problem of minimizing composite objective functions consisting of a convex differentiable loss function plus a non-smooth regularization term, such as $L_1$ norm or nuclear norm, under R\'enyi differential…

Machine Learning · Computer Science 2019-09-26 Chen Chen , Jaewoo Lee

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

Distributed machine learning has been widely studied in order to handle exploding amount of data. In this paper, we study an important yet less visited distributed learning problem where features are inherently distributed or vertically…

Machine Learning · Computer Science 2019-07-19 Yaochen Hu , Peng Liu , Linglong Kong , Di Niu

In recent years, privacy-preserving machine learning algorithms have attracted increasing attention because of their important applications in many scientific fields. However, in the literature, most privacy-preserving algorithms demand…

Machine Learning · Statistics 2024-01-03 Weidong Liu , Xiaojun Mao , Xiaofei Zhang , Xin Zhang

A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy which has been…

Machine Learning · Computer Science 2019-09-23 Michael Thomas Smith , Mauricio A. Alvarez , Neil D. Lawrence

Temporal difference (TD) learning is a widely used method to evaluate policies in reinforcement learning. While many TD learning methods have been developed in recent years, little attention has been paid to preserving privacy and most of…

Machine Learning · Computer Science 2022-01-26 Canzhe Zhao , Yanjie Ze , Jing Dong , Baoxiang Wang , Shuai Li

With the proliferation of training data, distributed machine learning (DML) is becoming more competent for large-scale learning tasks. However, privacy concerns have to be given priority in DML, since training data may contain sensitive…

Machine Learning · Computer Science 2020-08-26 Xin Wang , Hideaki Ishii , Linkang Du , Peng Cheng , Jiming Chen

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

With the advent of the era of big data, deep learning has become a prevalent building block in a variety of machine learning or data mining tasks, such as signal processing, network modeling and traffic analysis, to name a few. The massive…

Cryptography and Security · Computer Science 2019-12-20 Zhiying Xu , Shuyu Shi , Alex X. Liu , Jun Zhao , Lin Chen

As the modern world becomes increasingly digitized and interconnected, distributed signal processing has proven to be effective in processing its large volume of data. However, a main challenge limiting the broad use of distributed signal…

Signal Processing · Electrical Eng. & Systems 2020-10-23 Qiongxiu Li , Richard Heusdens , Mads Græsbøll Christensen

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

Differential privacy is a promising formal approach to data privacy, which provides a quantitative bound on the privacy cost of an algorithm that operates on sensitive information. Several tools have been developed for the formal…

Logic in Computer Science · Computer Science 2018-03-16 Gilles Barthe , Noémie Fong , Marco Gaboardi , Benjamin Grégoire , Justin Hsu , Pierre-Yves Strub

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

Machine Learning · Statistics 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang

Differential privacy is a promising privacy-preserving paradigm for statistical query processing over sensitive data. It works by injecting random noise into each query result, such that it is provably hard for the adversary to infer the…

Databases · Computer Science 2015-02-27 Ganzhao Yuan , Zhenjie Zhang , Marianne Winslett , Xiaokui Xiao , Yin Yang , Zhifeng Hao

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Privacy concerns with sensitive data are receiving increasing attention. In this paper, we study local differential privacy (LDP) in interactive decentralized optimization. By constructing random local aggregators, we propose a framework to…

Optimization and Control · Mathematics 2019-06-04 Hanshen Xiao , Yu Ye , Srinivas Devadas

Differential privacy is a recently proposed notion of privacy that provides strong privacy guarantees without any assumptions on the adversary. The paper studies the problem of computing a differentially private solution to convex…

Optimization and Control · Mathematics 2014-03-26 Shuo Han , Ufuk Topcu , George J. Pappas