English
Related papers

Related papers: Optimal Privacy-Aware Stochastic Sampling

200 papers

In this paper, we investigate the optimal real-time fusion of data collected by multiple sensors. In our set-up, the sensor measurements are considered to be private and are jointly correlated with an underlying process. A fusion center…

Systems and Control · Electrical Eng. & Systems 2026-03-06 Chuanghong Weng , Ehsan Nekouei

A central issue in machine learning is how to train models on sensitive user data. Industry has widely adopted a simple algorithm: Stochastic Gradient Descent with noise (a.k.a. Stochastic Gradient Langevin Dynamics). However, foundational…

Machine Learning · Computer Science 2023-03-01 Jason M. Altschuler , Kunal Talwar

Ensuring privacy of sensitive data is essential in many contexts, such as healthcare data, banks, e-commerce, wireless sensor networks, and social networks. It is common that different entities coordinate or want to rely on a third party to…

Cryptography and Security · Computer Science 2014-06-16 Pradeep Chathuranga Weeraddana , George Athanasiou , Martin Jakobsson , Carlo Fischione , John S. Baras

Privacy-preserving average consensus aims to guarantee the privacy of initial states and asymptotic consensus on the exact average of the initial value. In existing work, it is achieved by adding and subtracting variance decaying and…

Systems and Control · Computer Science 2017-02-10 Jianping He , Lin Cai , Chengcheng Zhao , Peng Cheng , Xinping Guan

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

We introduce a new mechanism for stochastic convex optimization (SCO) with user-level differential privacy guarantees. The convergence rates of this mechanism are similar to those in the prior work of Levy et al. (2021); Narayanan et al.…

Machine Learning · Computer Science 2023-05-09 Badih Ghazi , Pritish Kamath , Ravi Kumar , Raghu Meka , Pasin Manurangsi , Chiyuan Zhang

In this paper, we revisit the problem of private stochastic convex optimization. We propose an algorithm based on noisy mirror descent, which achieves optimal rates both in terms of statistical complexity and number of queries to a…

Machine Learning · Computer Science 2020-11-18 Raman Arora , Teodor V. Marinov , Enayat Ullah

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

We study the relationship between adversarial robustness and differential privacy in high-dimensional algorithmic statistics. We give the first black-box reduction from privacy to robustness which can produce private estimators with optimal…

Data Structures and Algorithms · Computer Science 2024-06-18 Samuel B. Hopkins , Gautam Kamath , Mahbod Majid , Shyam Narayanan

Privacy protection methods, such as differentially private mechanisms, introduce noise into resulting statistics which often produces complex and intractable sampling distributions. In this paper, we propose a simulation-based "repro…

Statistics Theory · Mathematics 2024-11-07 Jordan Awan , Zhanyu Wang

This study examines a resource-sharing problem involving multiple parties that agree to use a set of capacities together. We start with modeling the whole problem as a mathematical program, where all parties are required to exchange…

Optimization and Control · Mathematics 2024-01-08 Utku Karaca , Nursen Aydin , Sinan Yildirim , S. Ilker Birbil

In this paper we present the Sampling Privacy mechanism for privately releasing personal data. Sampling Privacy is a sampling based privacy mechanism that satisfies differential privacy.

Cryptography and Security · Computer Science 2017-08-08 Josh Joy , Mario Gerla

Average consensus underpins key functionalities of distributed systems ranging from distributed information fusion, decision-making, distributed optimization, to load balancing and decentralized control. Existing distributed average…

Optimization and Control · Mathematics 2019-03-05 Yongqiang Wang

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

It is often necessary to disclose training data to the public domain, while protecting privacy of certain sensitive labels. We use information theoretic measures to develop such privacy preserving data disclosure mechanisms. Our mechanism…

Information Theory · Computer Science 2019-04-08 Tianrui Xiao , Ashish Khisti

This paper furthers current research into the notion of guaranteed privacy, which provides a deterministic characterization of the privacy of output signals of a dynamical system or mechanism. Unlike stochastic differential privacy,…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Mohammad Khajenejad , Sonia Martinez

Differential privacy is the state-of-the-art definition for privacy, guaranteeing that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this thesis, we develop…

Machine Learning · Computer Science 2023-11-29 Vassilis Digalakis

Although distributed Gaussian process regression (GPR) enables multiple agents with separate datasets to jointly learn a model of the target function, its collaborative nature poses risks of private data leakage. To address this, we propose…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Yeongjun Jang , Kaoru Teranishi , Jihoon Suh , Takashi Tanaka

This paper presents a privacy-preserving event detection scheme based on measurements made by a network of sensors. A diameter-like decision statistic made up of the marginal types of the measurements observed by the sensors is employed.…

Information Theory · Computer Science 2025-05-06 Xiaoshan Wang , Tan F. Wong

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distribution that is close…

Machine Learning · Computer Science 2022-11-16 Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith , Marika Swanberg