English
Related papers

Related papers: High Dimensional Statistical Estimation under Unif…

200 papers

Data subject to heavy-tailed errors are commonly encountered in various scientific fields, especially in the modern era with explosion of massive data. To address this problem, procedures based on quantile regression and Least Absolute…

Statistics Theory · Mathematics 2014-10-09 Jianqing Fan , Quefeng Li , Yuyan Wang

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

The goal of standard 1-bit compressive sensing is to accurately recover an unknown sparse vector from binary-valued measurements, each indicating the sign of a linear function of the vector. Motivated by recent advances in compressive…

Machine Learning · Statistics 2020-06-23 Zhaoqiang Liu , Selwyn Gomes , Avtansh Tiwari , Jonathan Scarlett

Low-rank matrix estimation under heavy-tailed noise is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs, especially since robust loss…

Statistics Theory · Mathematics 2023-05-12 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

A simple and efficient method for characterization of multidimensional Gaussian states is suggested and experimentally demonstrated. Our scheme shows analogies with tomography of finite dimensional quantum states, with the covariance matrix…

Detection for one-bit massive MIMO systems presents several challenges especially for higher order constellations. Recent advances in both model-based analysis and deep learning frameworks have resulted in several robust one-bit detector…

Signal Processing · Electrical Eng. & Systems 2023-05-30 Aditya Sant , Bhaskar D. Rao

We propose a new method, {\it binary fused compressive sensing} (BFCS), to recover sparse piece-wise smooth signals from 1-bit compressive measurements. The proposed algorithm is a modification of the previous {\it binary iterative hard…

Computer Vision and Pattern Recognition · Computer Science 2014-02-21 Xiangrong Zeng , Mário A. T. Figueiredo

Corrupted sensing concerns the problem of recovering a high-dimensional structured signal from a collection of measurements that are contaminated by unknown structured corruption and unstructured noise. In the case of linear measurements,…

Information Theory · Computer Science 2022-02-16 Zhongxing Sun , Wei Cui , Yulong Liu

Modern statistical analyses often encounter datasets with massive sizes and heavy-tailed distributions. For datasets with massive sizes, traditional estimation methods can hardly be used to estimate the extreme value index directly. To…

Methodology · Statistics 2022-07-26 Yongxin Li , Liujun Chen , Deyuan Li , Hansheng Wang

Diffusion models (DMs) have demonstrated to be powerful priors for signal recovery, but their application to 1-bit quantization tasks, such as 1-bit compressed sensing and logistic regression, remains a challenge. This difficulty stems from…

Machine Learning · Computer Science 2026-01-13 Youming Chen , Zhaoqiang Liu

Time series regression models are commonly used in time series analysis. However, in modern real-world applications, serially correlated data with an ultra-high dimension and fat tails are prevalent. This presents a challenge in developing…

Statistics Theory · Mathematics 2023-04-21 Linbo Liu , Danna Zhang

To leverage high-frequency bands in 6G wireless systems and beyond, employing massive multiple-input multipleoutput (MIMO) arrays at the transmitter and/or receiver side is crucial. To mitigate the power consumption and hardware complexity…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Amin Radbord , Italo Atzeni , Antti Tölli

We introduce Bayesian Bits, a practical method for joint mixed precision quantization and pruning through gradient based optimization. Bayesian Bits employs a novel decomposition of the quantization operation, which sequentially considers…

Machine Learning · Computer Science 2020-10-28 Mart van Baalen , Christos Louizos , Markus Nagel , Rana Ali Amjad , Ying Wang , Tijmen Blankevoort , Max Welling

Motivated by applications in high-dimensional data analysis where strong signals often stand out easily and weak ones may be indistinguishable from the noise, we develop a statistical framework to provide a novel categorization of the data…

Methodology · Statistics 2013-05-02 X. Jessie Jeng

The sampling, quantization, and estimation of a bounded dynamic-range bandlimited signal affected by additive independent Gaussian noise is studied in this work. For bandlimited signals, the distortion due to additive independent Gaussian…

Information Theory · Computer Science 2012-11-29 Animesh Kumar , Vinod M. Prabhakaran

Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Chaowei Fang , Dingwen Zhang , Wen Zheng , Xue Li , Le Yang , Lechao Cheng , Junwei Han

The one-bit quantization is implemented by one single comparator that operates at low power and a high rate. Hence one-bit compressive sensing (1bit-CS) becomes attractive in signal processing. When measurements are corrupted by noise…

Information Theory · Computer Science 2018-03-20 Xiaolin Huang , Lei Shi , Ming Yan , Johan A. K. Suykens

We study the task of high-dimensional entangled mean estimation in the subset-of-signals model. Specifically, given $N$ independent random points $x_1,\ldots,x_N$ in $\mathbb{R}^D$ and a parameter $\alpha \in (0, 1)$ such that each $x_i$ is…

Data Structures and Algorithms · Computer Science 2025-01-10 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Thanasis Pittas

Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity. This motivation is…

Machine Learning · Computer Science 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Antonio Ocello