English
Related papers

Related papers: On learning parametric distributions from quantize…

200 papers

We consider the problem of learning high-dimensional, nonparametric and structured (e.g. Gaussian) distributions in distributed networks, where each node in the network observes an independent sample from the underlying distribution and can…

Information Theory · Computer Science 2019-06-04 Leighton Pate Barnes , Yanjun Han , Ayfer Ozgur

The problem of distributed or decentralized detection and estimation in applications such as wireless sensor networks has often been considered in the framework of parametric models, in which strong assumptions are made about a statistical…

Information Theory · Computer Science 2015-06-25 Joel B. Predd , Sanjeev R. Kulkarni , H. Vincent Poor

We study the problem of learning from unlabeled samples very general statistical mixture models on large finite sets. Specifically, the model to be learned, $\vartheta$, is a probability distribution over probability distributions $p$,…

Machine Learning · Computer Science 2015-04-13 Jian Li , Yuval Rabani , Leonard J. Schulman , Chaitanya Swamy

We study the problem of estimating, in the sense of optimal transport metrics, a measure which is assumed supported on a manifold embedded in a Hilbert space. By establishing a precise connection between optimal transport metrics, optimal…

Machine Learning · Computer Science 2012-09-06 Guillermo D. Canas , Lorenzo Rosasco

We consider parameter estimation in distributed networks, where each sensor in the network observes an independent sample from an underlying distribution and has $k$ bits to communicate its sample to a centralized processor which computes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-23 Yanjun Han , Ayfer Özgür , Tsachy Weissman

The problem of estimating an unknown discrete distribution from its samples is a fundamental tenet of statistical learning. Over the past decade, it attracted significant research effort and has been solved for a variety of divergence…

Machine Learning · Computer Science 2018-10-30 Yi Hao , Alon Orlitsky , Venkatadheeraj Pichapati

We study the problem, introduced by Qiao and Valiant, of learning from untrusted batches. Here, we assume $m$ users, all of whom have samples from some underlying distribution $p$ over $1, \ldots, n$. Each user sends a batch of $k$ i.i.d.…

Data Structures and Algorithms · Computer Science 2019-11-07 Sitan Chen , Jerry Li , Ankur Moitra

This paper studies the problem of distributed classification with a network of heterogeneous agents. The agents seek to jointly identify the underlying target class that best describes a sequence of observations. The problem is first…

Artificial Intelligence · Computer Science 2020-11-24 James Z. Hare , Cesar A. Uribe , Lance Kaplan , Ali Jadbabaie

Particle filtering is used to compute good nonlinear estimates of complex systems. It samples trajectories from a chosen distribution and computes the estimate as a weighted average. Easy-to-sample distributions often lead to degenerate…

Machine Learning · Computer Science 2021-10-07 Fernando Gama , Nicolas Zilberstein , Richard G. Baraniuk , Santiago Segarra

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra

Many latent-variable applications, including community detection, collaborative filtering, genomic analysis, and NLP, model data as generated by low-rank matrices. Yet despite considerable research, except for very special cases, the number…

Machine Learning · Computer Science 2020-10-02 Ayush Jain , Alon Orlitsky

A $k$-modal probability distribution over the discrete domain $\{1,...,n\}$ is one whose histogram has at most $k$ "peaks" and "valleys." Such distributions are natural generalizations of monotone ($k=0$) and unimodal ($k=1$) probability…

Data Structures and Algorithms · Computer Science 2014-09-16 Constantinos Daskalakis , Ilias Diakonikolas , Rocco A. Servedio

Van Trees inequality, also known as the Bayesian Cram\'er-Rao lower bound, is a powerful tool for establishing lower bounds for minimax estimation through Fisher information. It easily adapts to different statistical models and often yields…

Information Theory · Computer Science 2024-04-30 Wei-Ning Chen , Ayfer Özgür

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

A protocol for distributed estimation of discrete distributions is proposed. Each agent begins with a single sample from the distribution, and the goal is to learn the empirical distribution of the samples. The protocol is based on a simple…

Optimization and Control · Mathematics 2014-06-06 Anand D. Sarwate , Tara Javidi

Shadow tomography for quantum states provides a sample efficient approach for predicting the properties of quantum systems when the properties are restricted to expectation values of $2$-outcome POVMs. However, these shadow tomography…

Quantum Physics · Physics 2022-09-08 Weiyuan Gong , Scott Aaronson

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

We study transfer learning for estimation in latent variable network models. In our setting, the conditional edge probability matrices given the latent variables are represented by $P$ for the source and $Q$ for the target. We wish to…

Machine Learning · Computer Science 2024-06-07 Akhil Jalan , Arya Mazumdar , Soumendu Sundar Mukherjee , Purnamrita Sarkar

Human learners have the natural ability to use knowledge gained in one setting for learning in a different but related setting. This ability to transfer knowledge from one task to another is essential for effective learning. In this paper,…

Statistics Theory · Mathematics 2019-06-10 T. Tony Cai , Hongji Wei

We study quantum neural networks made by parametric one-qubit gates and fixed two-qubit gates in the limit of infinite width, where the generated function is the expectation value of the sum of single-qubit observables over all the qubits.…

Quantum Physics · Physics 2026-05-26 Filippo Girardi , Giacomo De Palma
‹ Prev 1 2 3 10 Next ›