English
Related papers

Related papers: Distributed Batch Matrix Multiplication: Trade-Off…

200 papers

Consider a pair of random variables $(X,Y)$ distributed according to a given joint distribution $p_{XY}$. A curator wishes to maximally disclose information about $Y$, while limiting the information leakage incurred on $X$. Adopting mutual…

Information Theory · Computer Science 2023-01-30 Borzoo Rassouli , Deniz Gündüz

Performing computations while maintaining privacy is an important problem in todays distributed machine learning solutions. Consider the following two set ups between a client and a server, where in setup i) the client has a public data…

Machine Learning · Computer Science 2022-01-27 Praneeth Vepakomma , Julia Balla , Ramesh Raskar

We consider a private distributed multiplication problem involving N computation nodes and T colluding nodes. Shamir's secret sharing algorithm provides perfect information-theoretic privacy, while requiring an honest majority, i.e., N \ge…

Information Theory · Computer Science 2025-12-10 Haoyang Hu , Viveck R. Cadambe

Existing approaches to distributed matrix computations involve allocating coded combinations of submatrices to worker nodes, to build resilience to stragglers and/or enhance privacy. In this study, we consider the challenge of preserving…

Information Theory · Computer Science 2023-08-09 Anindya Bijoy Das , Aditya Ramamoorthy , David J. Love , Christopher G. Brinton

We consider the problem of maintaining sparsity in private distributed storage of confidential machine learning data. In many applications, e.g., face recognition, the data used in machine learning algorithms is represented by sparse…

Information Theory · Computer Science 2022-06-15 Marvin Xhemrishi , Maximilian Egger , Rawad Bitar

Computation of Mutual Information (MI) helps understand the amount of information shared between a pair of random variables. Automated feature selection techniques based on MI ranking are regularly used to extract information from sensitive…

Cryptography and Security · Computer Science 2020-09-24 Ankit Srivastava , Samira Pouyanfar , Joshua Allen , Ken Johnston , Qida Ma

Hierarchical text classification consists in classifying text documents into a hierarchy of classes and sub-classes. Although artificial neural networks have proved useful to perform this task, unfortunately they can leak training data…

Cryptography and Security · Computer Science 2021-12-10 Dominik Wunderlich , Daniel Bernau , Francesco Aldà , Javier Parra-Arnau , Thorsten Strufe

Using a broadcast channel to transmit clients' data requests may impose privacy risks. In this paper, we address such privacy concerns in the index coding framework. We show how a malicious client can infer some information about the…

Information Theory · Computer Science 2018-10-16 Mohammed Karmoose , Linqi Song , Martina Cardone , Christina Fragouli

A Private Repetition algorithm takes as input a differentially private algorithm with constant success probability and boosts it to one that succeeds with high probability. These algorithms are closely related to private metaselection…

Cryptography and Security · Computer Science 2024-10-28 Kunal Talwar

Distributed optimization and learning has recently garnered great attention due to its wide applications in sensor networks, smart grids, machine learning, and so forth. Despite rapid development, existing distributed optimization and…

Machine Learning · Computer Science 2024-03-04 Ziqin Chen , Yongqiang Wang

Tensor operations, such as matrix multiplication, are central to large-scale machine learning applications. For user-driven tasks these operations can be carried out on a distributed computing platform with a master server at the user side…

Information Theory · Computer Science 2019-01-24 Malihe Aliasgari , Osvaldo Simeone , Joerg Kliewer

Data collecting agents in large networks, such as the electric power system, need to share information (measurements) for estimating the system state in a distributed manner. However, privacy concerns may limit or prevent this exchange…

Information Theory · Computer Science 2015-10-28 E. Veronica Belmega , Lalitha Sankar , H. Vincent Poor

We study privacy-utility trade-offs where users share privacy-correlated useful information with a service provider to obtain some utility. The service provider is adversarial in the sense that it can infer the users' private information…

Information Theory · Computer Science 2021-06-29 Xiaoming Duan , Zhe Xu , Rui Yan , Ufuk Topcu

Index coding employs coding across clients within the same broadcast domain. This typically assumes that all clients learn the coding matrix so that they can decode and retrieve their requested data. However, learning the coding matrix can…

Information Theory · Computer Science 2018-10-16 Mohammed Karmoose , Linqi Song , Martina Cardone , Christina Fragouli

Differential privacy (DP) is the standard for privacy-preserving analysis, and introduces a fundamental trade-off between privacy guarantees and model performance. Selecting the optimal balance is a critical challenge that can be framed as…

Machine Learning · Computer Science 2025-09-05 Yaohong Yang , Aki Rehn , Sammie Katt , Antti Honkela , Samuel Kaski

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Although robust learning and local differential privacy are both widely studied fields of research, combining the two settings is just starting to be explored. We consider the problem of estimating a discrete distribution in total variation…

Statistics Theory · Mathematics 2022-04-21 Julien Chhor , Flore Sentenac

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

We study the mean estimation problem under communication and local differential privacy constraints. While previous work has proposed \emph{order}-optimal algorithms for the same problem (i.e., asymptotically optimal as we spend more bits),…

Machine Learning · Computer Science 2023-10-31 Berivan Isik , Wei-Ning Chen , Ayfer Ozgur , Tsachy Weissman , Albert No

Differentially private (DP) machine learning algorithms incur many sources of randomness, such as random initialization, random batch subsampling, and shuffling. However, such randomness is difficult to take into account when proving…

Machine Learning · Statistics 2023-11-02 Chendi Wang , Buxin Su , Jiayuan Ye , Reza Shokri , Weijie J. Su