English
Related papers

Related papers: Probabilistic Group Testing in Distributed Computi…

200 papers

The introduction of the new multi-user linearly-separable distributed computing framework, has recently revealed how a parallel treatment of users can yield large parallelization gains with relatively low computation and communication…

Information Theory · Computer Science 2026-04-22 Amir Masoud Jafarpisheh , Ali Khalesi , Petros Elia

In one-stage or non-adaptive group testing, instead of testing every sample unit individually, they are split, bundled in pools, and simultaneously tested. The results are then decoded to infer the states of the individual items. This…

Applications · Statistics 2020-12-04 Christoph Schumacher , Matthias Täufer

The distributed linearly separable computation problem finds extensive applications across domains such as distributed gradient coding, distributed linear transform, real-time rendering, etc. In this paper, we investigate this problem in a…

Information Theory · Computer Science 2024-01-30 Haoning Chen , Minquan Cheng , Zhenhao Huang , Youlong Wu

We study the problem of group testing with non-identical, independent priors. So far, the pooling strategies that have been proposed in the literature take the following approach: a hand-crafted test design along with a decoding strategy is…

Information Theory · Computer Science 2022-01-31 Sundara Rajan Srinivasavaradhan , Pavlos Nikolopoulos , Christina Fragouli , Suhas Diggavi

Recent developments in cloud storage architectures have originated new models of online storage as cooperative storage systems and interconnected clouds. Such distributed environments involve many organizations, thus ensuring…

Cryptography and Security · Computer Science 2016-06-30 Marco Baldi , Alessandro Cucchiarelli , Linda Senigagliesi , Luca Spalazzi , Francesco Spegni

We consider some computationally efficient and provably correct algorithms with near-optimal sample-complexity for the problem of noisy non-adaptive group testing. Group testing involves grouping arbitrary subsets of items into pools. Each…

Information Theory · Computer Science 2016-11-18 Chun Lam Chan , Sidharth Jaggi , Venkatesh Saligrama , Samar Agnihotri

Coded distributed computing framework enables large-scale machine learning (ML) models to be trained efficiently in a distributed manner, while mitigating the straggler effect. In this work, we consider a multi-task assignment problem in a…

Information Theory · Computer Science 2019-05-21 Yuxuan Sun , Junlin Zhao , Sheng Zhou , Deniz Gündüz

We are interested in testing properties of distributions with systematically mislabeled samples. Our goal is to make decisions about unknown probability distributions, using a sample that has been collected by a confused collector, such as…

Data Structures and Algorithms · Computer Science 2023-11-27 Renato Ferreira Pinto , Nathaniel Harms

Distributed computing enables large-scale computation tasks to be processed over multiple workers in parallel. However, the randomness of communication and computation delays across workers causes the straggler effect, which may degrade the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-20 Yuxuan Sun , Fan Zhang , Junlin Zhao , Sheng Zhou , Zhisheng Niu , Deniz Gündüz

In this paper, we consider a secure multi-party computation problem (MPC), where the goal is to offload the computation of an arbitrary polynomial function of some massive private matrices (inputs) to a cluster of workers. The workers are…

Information Theory · Computer Science 2020-09-16 Hanzaleh Akbari Nodehi , Mohammad Ali Maddah-Ali

Group testing is the process of pooling arbitrary subsets from a set of $n$ items so as to identify, with a minimal number of tests, a "small" subset of $d$ defective items. In "classical" non-adaptive group testing, it is known that when…

Information Theory · Computer Science 2018-09-21 Venkata Gandikota , Elena Grigorescu , Sidharth Jaggi , Samson Zhou

We consider the problem of evaluating distinct multivariate polynomials over several massive datasets in a distributed computing system with a single master node and multiple worker nodes. We focus on the general case when each multivariate…

Information Theory · Computer Science 2023-08-23 Wilton Kim , Stanislav Kruglik , Han Mao Kiah

Internet supercomputing is an approach to solving partitionable, computation-intensive problems by harnessing the power of a vast number of interconnected computers. This paper presents a new algorithm for the problem of using network…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-03 Seda Davtyan , Kishori M. Konwar , Alexander Russell , Alexander A. Shvartsman

In this work, we explore the problem of multi-user linearly-separable distributed computation, where $N$ servers help compute the desired functions (jobs) of $K$ users, and where each desired function can be written as a linear combination…

Information Theory · Computer Science 2022-06-27 Ali Khalesi , Petros Elia

Coded computing has proved to be useful in distributed computing. We have observed that almost all coded computing systems studied so far consider a setup of one master and some workers. However, recently emerging technologies such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-13 Nastaran Abadi Khooshemehr , Mohammad Ali Maddah-Ali

Penetration Testing is a methodology for assessing network security, by generating and executing possible hacking attacks. Doing so automatically allows for regular and systematic testing. A key question is how to generate the attacks. This…

Artificial Intelligence · Computer Science 2017-07-06 Carlos Sarraute , Olivier Buffet , Joerg Hoffmann

In the group-testing literature, efficient algorithms have been developed to minimize the number of tests required to identify all minimal "defective" sub-groups embedded within a larger group, using deterministic group splitting with a…

Discrete Mathematics · Computer Science 2020-10-20 Laurence A. Clarfeld , Margaret J. Eppstein

An instance of a group testing problem is a set of objects $\cO$ and an unknown subset $P$ of $\cO$. The task is to determine $P$ by using queries of the type ``does $P$ intersect $Q$'', where $Q$ is a subset of $\cO$. This problem occurs…

Combinatorics · Mathematics 2016-09-06 Emanuel Knill

We consider a new group testing model wherein each item is a binary random variable defined by an a priori probability of being defective. We assume that each probability is small and that items are independent, but not necessarily…

Information Theory · Computer Science 2018-07-24 Tongxin Li , Chun Lam Chan , Wenhao Huang , Tarik Kaced , Sidharth Jaggi

Group-testing refers to the problem of identifying (with high probability) a (small) subset of $D$ defectives from a (large) set of $N$ items via a "small" number of "pooled" tests. For ease of presentation in this work we focus on the…

Information Theory · Computer Science 2013-07-11 Sheng Cai , Mohammad Jahangoshahi , Mayank Bakshi , Sidharth Jaggi