English
Related papers

Related papers: Detecting Correlations with Little Memory and Comm…

200 papers

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

In distributed statistical learning, $N$ samples are split across $m$ machines and a learner wishes to use minimal communication to learn as well as if the examples were on a single machine. This model has received substantial interest in…

Machine Learning · Computer Science 2019-03-19 Jayadev Acharya , Christopher De Sa , Dylan J. Foster , Karthik Sridharan

Recently, there has been an increasing interest in designing distributed convex optimization algorithms under the setting where the data matrix is partitioned on features. Algorithms under this setting sometimes have many advantages over…

Machine Learning · Computer Science 2016-12-05 Zihao Chen , Luo Luo , Zhihua Zhang

The problem of distributed representation learning is one in which multiple sources of information $X_1,\ldots,X_K$ are processed separately so as to learn as much information as possible about some ground truth $Y$. We investigate this…

Machine Learning · Statistics 2019-04-02 Inaki Estella Aguerri , Abdellatif Zaidi

Quantum nonlocality concerns correlations among spatially separated systems that cannot be classically explained without post-measurement communication among the parties. Thus, a natural measure of nonlocal correlations is provided by the…

Quantum Physics · Physics 2016-02-26 Alberto Montina , Stefan Wolf

We consider a generalization of an important class of high-dimensional inference problems, namely spiked symmetric matrix models, often used as probabilistic models for principal component analysis. Such paradigmatic models have recently…

Information Theory · Computer Science 2020-05-19 Jean Barbier , Galen Reeves

We continue the investigation of problems concerning correlation clustering or clustering with qualitative information, which is a clustering formulation that has been studied recently. The basic setup here is that we are given as input a…

Data Structures and Algorithms · Computer Science 2007-05-23 Ioannis Giotis , Venkatesan Guruswami

We consider a basic communication and sensing setup comprising a transmitter, a receiver and a sensor. The transmitter sends an encoded sequence to the receiver through a discrete memoryless channel, and the receiver is interested in…

Information Theory · Computer Science 2022-05-11 Han Wu , Hamdi Joudeh

Correlation matrices are widely used to analyze the interdependence of variables in various real-world scenarios. Often, a perturbation in a few variables leads to mild differences in many correlation coefficients associated with these…

Applications · Statistics 2023-03-07 Itamar Faran , Michael Peer , Shahar Arzy , Yuval Benjamini

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

One of the most fundamental questions one can ask about a pair of random variables X and Y is the value of their mutual information. Unfortunately, this task is often stymied by the extremely large dimension of the variables. We might hope…

Statistical Mechanics · Physics 2017-06-21 Ryan G. James , John R. Mahoney , James P. Crutchfield

Modern applied optimization problems become more and more complex every day. Due to this fact, distributed algorithms that can speed up the process of solving an optimization problem through parallelization are of great importance. The main…

Optimization and Control · Mathematics 2023-12-14 Svetlana Tkachenko , Artem Andreev , Aleksandr Beznosikov , Alexander Gasnikov

High-dimensional models often have a large memory footprint and must be quantized after training before being deployed on resource-constrained edge devices for inference tasks. In this work, we develop an information-theoretic framework for…

Information Theory · Computer Science 2022-09-01 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

Deep learning has achieved remarkable success in many machine learning tasks such as image classification, speech recognition, and game playing. However, these breakthroughs are often difficult to translate into real-world engineering…

Machine Learning · Computer Science 2022-10-07 Lisha Chen , Sharu Theresa Jose , Ivana Nikoloska , Sangwoo Park , Tianyi Chen , Osvaldo Simeone

This work examines a social learning problem, where dispersed agents connected through a network topology interact locally to form their opinions (beliefs) as regards certain hypotheses of interest. These opinions evolve over time, since…

Signal Processing · Electrical Eng. & Systems 2023-01-26 Michele Cirillo , Virginia Bordignon , Vincenzo Matta , Ali H. Sayed

We consider a toy model for non-local quantum correlations in which nature resorts to some form of hidden signaling (i.e., signaling between boxes but not available to the users) to generate correlations. We show that if such a model also…

In the context of distributed estimation, we consider the problem of sensor collaboration, which refers to the act of sharing measurements with neighboring sensors prior to transmission to a fusion center. While incorporating the cost of…

Methodology · Statistics 2015-06-22 Sijia Liu , Swarnendu Kar , Makan Fardad , Pramod K. Varshney

The ability to discriminate similar visual stimuli is an important index of memory function. This ability is widely thought to be supported by expanding the dimensionality of relevant neural codes, such that neural representations for…

Neurons and Cognition · Quantitative Biology 2025-10-14 Dale Zhou , Sharon Mina Noh , Nora C Harhen , Nidhi V Banavar , C. Brock Kirwan , Michael A Yassa , Aaron M Bornstein

We introduce the problem of communication with partial information, where there is an asymmetry between the transmitter and the receiver codebooks. Practical applications of the proposed setup include the robust signal hashing problem…

Information Theory · Computer Science 2009-10-29 Onur Ozyesil , M. Kivanc Mihcak , Yucel Altug

We consider multi-armed bandit problems in social groups wherein each individual has bounded memory and shares the common goal of learning the best arm/option. We say an individual learns the best option if eventually (as $t\to \infty$) it…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Lili Su , Martin Zubeldia , Nancy Lynch