English
Related papers

Related papers: Randomness Efficient Fast-Johnson-Lindenstrauss Tr…

200 papers

We present efficient and practical algorithms for a large, distributed system of processors to achieve reliable computations in a secure manner. Specifically, we address the problem of computing a general function of several private inputs…

Cryptography and Security · Computer Science 2021-01-29 Donald Rozinak Beaver

Differentially Private-SGD (DP-SGD) of Abadi et al. (2016) and its variations are the only known algorithms for private training of large scale neural networks. This algorithm requires computation of per-sample gradients norms which is…

Machine Learning · Computer Science 2021-02-08 Zhiqi Bu , Sivakanth Gopi , Janardhan Kulkarni , Yin Tat Lee , Judy Hanwen Shen , Uthaipon Tantipongpipat

In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and matrix factorizations…

Machine Learning · Statistics 2019-04-23 Hafiz Imtiaz , Anand D. Sarwate

In this work, we present a connection between Lipschitz property testing and a relaxed notion of differential privacy, where we assume that the datasets are being sampled from a domain according to some distribution defined on it.…

Cryptography and Security · Computer Science 2012-09-19 Kashyap Dixit , Madhav Jha , Abhradeep Thakurta

Integer data is typically made differentially private by adding noise from a Discrete Laplace (or Discrete Gaussian) distribution. We study the setting where differential privacy of a counting query is achieved using bit-wise randomized…

Information Theory · Computer Science 2023-11-17 David Rasmussen Lolck , Rasmus Pagh

In Compressive Sensing, the Restricted Isometry Property (RIP) ensures that robust recovery of sparse vectors is possible from noisy, undersampled measurements via computationally tractable algorithms. It is by now well-known that Gaussian…

Information Theory · Computer Science 2014-02-17 Armin Eftekhari , Han Lun Yap , Christopher J. Rozell , Michael B. Wakin

This paper is centred on the spectral study of a Random Fourier matrix, that is an $n\times n$ matrix $A$ whose $(j, k)$ entries are $\exp(2i\pi m X_jY_k)$, with $X_j$ and $Y_k$ two i.i.d sequences of random variables and $1\leq m\leq n$ is…

Classical Analysis and ODEs · Mathematics 2019-04-16 Aline Bonami , Abderrazek Karoui

We study gradient descent under linearly correlated noise. Our work is motivated by recent practical methods for optimization with differential privacy (DP), such as DP-FTRL, which achieve strong performance in settings where privacy…

Machine Learning · Computer Science 2024-01-17 Anastasia Koloskova , Ryan McKenna , Zachary Charles , Keith Rush , Brendan McMahan

In this work, fundamental limits and optimal mechanisms of privacy-preserving data release that aims to minimize the privacy leakage under utility constraints of a set of multiple tasks are investigated. While the private feature to be…

Information Theory · Computer Science 2024-09-04 Ta-Yuan Liu , I-Hsiang Wang

Data privacy is an important issue for organizations and enterprises to securely outsource data storage, sharing, and computation on clouds / fogs. However, data encryption is complicated in terms of the key management and distribution;…

Cryptography and Security · Computer Science 2021-01-13 Jenn-Bing Ong , Wee-Keong Ng , Ivan Tjuawinata , Chao Li , Jielin Yang , Sai None Myne , Huaxiong Wang , Kwok-Yan Lam , C. -C. Jay Kuo

Motivated by the wide adoption of reinforcement learning (RL) in real-world personalized services, where users' sensitive and private information needs to be protected, we study regret minimization in finite-horizon Markov decision…

Machine Learning · Computer Science 2022-03-22 Xingyu Zhou

When collecting information, local differential privacy (LDP) relieves the concern of privacy leakage from users' perspective, as user's private information is randomized before sent to the aggregator. We study the problem of recovering the…

Cryptography and Security · Computer Science 2019-12-04 Zitao Li , Tianhao Wang , Milan Lopuhaä-Zwakenberg , Boris Skoric , Ninghui Li

In recent years, randomized algorithms have established themselves as fundamental tools in computational linear algebra, with applications in scientific computing, machine learning, and quantum information science. Many randomized matrix…

Numerical Analysis · Mathematics 2025-12-19 Ethan N. Epperly

This paper considers privacy-concerned distributed constraint-coupled resource allocation problems over an undirected network, where each agent holds a private cost function and obtains the solution via only local communication. With…

Optimization and Control · Mathematics 2025-06-05 Wenwen Wu , Shanying Zhu , Shuai Liu , Xinping Guan

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

In prior work, Gupta et al. (SPAA 2022) presented a distributed algorithm for multiplying sparse $n \times n$ matrices, using $n$ computers. They assumed that the input matrices are uniformly sparse--there are at most $d$ non-zeros in each…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Chetan Gupta , Janne H. Korhonen , Jan Studený , Jukka Suomela , Hossein Vahidi

We present a theory for Euclidean dimensionality reduction with subgaussian matrices which unifies several restricted isometry property and Johnson-Lindenstrauss type results obtained earlier for specific data sets. In particular, we…

Information Theory · Computer Science 2014-02-18 Sjoerd Dirksen

We study the problem of sampling from a distribution under local differential privacy (LDP). Given a private distribution $P \in \mathcal{P}$, the goal is to generate a single sample from a distribution that remains close to $P$ in…

Machine Learning · Computer Science 2025-10-13 Hrad Ghoukasian , Bonwoo Lee , Shahab Asoodeh

Harnessing a block-sparse prior to recover signals through underdetermined linear measurements has been extensively shown to allow exact recovery in conditions where classical compressed sensing would provably fail. We exploit this result…

Information Theory · Computer Science 2021-10-12 Maxime Ferreira Da Costa , Urbashi Mitra

We propose a new computationally efficient privacy-preserving identification framework based on layered sparse coding. The key idea of the proposed framework is a sparsifying transform learning with ambiguization, which consists of a…

Information Theory · Computer Science 2018-06-25 Behrooz Razeghi , Slava Voloshynovskiy , Sohrab Ferdowsi , Dimche Kostadinov