English
Related papers

Related papers: Binary and Multi-Bit Coding for Stable Random Proj…

200 papers

Modulo sampling has recently drawn a great deal of attention for cutting-edge applications, due to overcoming the barrier of information loss through sensor saturation and clipping. This is a significant problem, especially when the range…

Signal Processing · Electrical Eng. & Systems 2024-01-02 Qi Zhang , Jiang Zhu , Fengzhong Qu , De Wen Soh

Binary embeddings provide efficient and powerful ways to perform operations on large scale data. However binary embedding typically requires long codes in order to preserve the discriminative power of the input space. Thus binary coding…

Data Structures and Algorithms · Computer Science 2015-12-08 Felix X. Yu , Aditya Bhaskara , Sanjiv Kumar , Yunchao Gong , Shih-Fu Chang

The number of random bits required to approximate a target distribution in terms of un-normalized informational divergence is considered. It is shown that for a variable-to-variable length encoder, this number is lower bounded by the…

Information Theory · Computer Science 2013-08-02 Georg Böcherer , Rana Ali Amjad

A distributed sensing protocol uses a network of local sensing nodes to estimate a global feature of the network, such as a weighted average of locally detectable parameters. In the noiseless case, continuous-variable multipartite…

Quantum Physics · Physics 2020-02-28 Quntao Zhuang , John Preskill , Liang Jiang

One-bit quantization with time-varying sampling thresholds has recently found significant utilization potential in statistical signal processing applications due to its relatively low power consumption and low implementation cost. In…

Information Theory · Computer Science 2023-03-20 Arian Eamaz , Farhang Yeganegi , Deanna Needell , Mojtaba Soltanalian

A statistical estimation algorithm of the weight distribution of a linear code is shown, based on using its generator matrix as a compression function on random bit strings.

Information Theory · Computer Science 2018-06-07 Alessandro Tomasi , Alessio Meneghetti

We consider the fundamental problem of communicating an estimate of a real number $x\in[0,1]$ using a single bit. A sender that knows $x$ chooses a value $X\in\set{0,1}$ to transmit. In turn, a receiver estimates $x$ based on the value of…

Data Structures and Algorithms · Computer Science 2021-05-21 Ran Ben-Basat , Michael Mitzenmacher , Shay Vargaftik

The class of $\alpha$-stable distributions with a wide range of applications in economics, telecommunications, biology, applied, and theoretical physics. This is due to the fact that it possesses both the skewness and heavy tails. Since…

Statistics Theory · Mathematics 2018-11-13 Mahdi Teimouri

We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization…

Machine Learning · Computer Science 2022-08-17 Rajarshi Saha , Mert Pilanci , Andrea J. Goldsmith

In this paper, we study the problem of robust phase recovery. We investigate a novel approach based on extremely quantized (one-bit) phase-less measurements and a corresponding recovery scheme. The proposed approach has surprising…

Information Theory · Computer Science 2013-12-10 Youssef Mroueh , Lorenzo Rosasco

In this paper, we propose an oversampling based low-resolution aware least squares channel estimator for large-scale multiple-antenna systems with 1-bit analog-to-digital converters on each receive antenna. To mitigate the information loss…

Signal Processing · Electrical Eng. & Systems 2019-05-15 Z. Shao , L. Landau , R. de Lamare

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample…

Machine Learning · Statistics 2026-05-25 Ivan Lau , Jonathan Scarlett

The Compressive Sensing framework maintains relevance even when the available measurements are subject to extreme quantization, as is exemplified by the so-called one-bit compressed sensing framework which aims to recover a signal from…

Numerical Analysis · Mathematics 2015-06-03 Phillip North , Deanna Needell

We consider the problem of range-Doppler imaging using one-bit automotive LFMCW1 or PMCW radar that utilizes one-bit ADC sampling with time-varying thresholds at the receiver. The one-bit sampling technique can significantly reduce the cost…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Xiaolei Shang , Jian Li , Petre Stoica

The development of modern technology has enabled data collection of unprecedented size, which poses new challenges to many statistical estimation and inference problems. This paper studies the maximum score estimator of a semi-parametric…

Statistics Theory · Mathematics 2025-02-25 Xi Chen , Wenbo Jing , Weidong Liu , Yichen Zhang

The paper presents a binarization scheme that converts non-binary data into a set of binary strings. At present, there are many binarization algorithms, but they are optimal for only specific probability distributions of the data source.…

Information Theory · Computer Science 2014-08-14 Madhur Srivastava

We study the use of "sign $\alpha$-stable random projections" (where $0<\alpha\leq 2$) for building basic data processing tools in the context of large-scale machine learning applications (e.g., classification, regression, clustering, and…

Machine Learning · Statistics 2015-04-29 Ping Li

We consider the classical problem of estimating the covariance matrix of a subgaussian distribution from i.i.d. samples in the novel context of coarse quantization, i.e., instead of having full knowledge of the samples, they are quantized…

Information Theory · Computer Science 2022-04-25 Sjoerd Dirksen , Johannes Maly , Holger Rauhut

The paper investigates the distributed estimation problem under low bit rate communications. Based on the signal-comparison (SC) consensus protocol under binary-valued communications, a new consensus+innovations type distributed estimation…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Jieming Ke , Xiaodong Lu , Yanlong Zhao , Ji-Feng Zhang

Without imposing prior distributional knowledge underlying multivariate time series of interest, we propose a nonparametric change-point detection approach to estimate the number of change points and their locations along the temporal axis.…

Methodology · Statistics 2021-05-13 Xiaodong Wang , Fushing Hsieh