English
Related papers

Related papers: Minimum mean-squared error estimation with bandit …

200 papers

We investigate the performance of a Bayesian statistician tasked with recovering a rank-\(k\) signal matrix \(\bS \bS^{\top} \in \mathbb{R}^{n \times n}\), corrupted by element-wise additive Gaussian noise. This problem lies at the core of…

Information Theory · Computer Science 2025-07-17 Panpan Niu , Yuhao Liu , Teng Fu , Jie Fan , Chaowen Deng , Zhongyi Huang

We examine codes, over the additive Gaussian noise channel, designed for reliable communication at some specific signal-to-noise ratio (SNR) and constrained by the permitted minimum mean-square error (MMSE) at lower SNRs. The maximum…

Information Theory · Computer Science 2012-08-10 Ronit Bustin , Shlomo Shamai

We study admissibility of a subclass of generalized Bayes estimators of a multivariate normal vector when the variance is unknown, under scaled quadratic loss. Minimaxity is also established for certain of these estimators.

Statistics Theory · Mathematics 2020-03-20 Yuzo Maruyama , William E. Strawderman

Statistical agencies are often asked to produce small area estimates (SAEs) for positively skewed variables. When domain sample sizes are too small to support direct estimators, effects of skewness of the response variable can be large. As…

Methodology · Statistics 2021-03-09 Sepideh Mosaferi , Malay Ghosh , Rebecca C. Steorts

We consider the problem of learning a dictionary matrix from a number of observed signals, which are assumed to be generated via a linear model with a common underlying dictionary. In particular, we derive lower bounds on the minimum…

Machine Learning · Statistics 2015-07-21 Alexander Jung , Yonina C. Eldar , Norbert Görtz

This two-part work considers the minimum means square error (MMSE) estimation problem for a high dimensional multi-layer generalized linear model (ML-GLM), which resembles a feed-forward fully connected deep learning network in that each of…

Information Theory · Computer Science 2020-07-21 Haochuan Zhang , Qiuyun Zou , Hongwen Yang

This paper addresses the challenge of integrating sequentially arriving data within the quantile regression framework, where the number of features is allowed to grow with the number of observations, the horizon is unknown, and memory is…

Statistics Theory · Mathematics 2025-10-21 Yinan Shen , Dong Xia , Wen-Xin Zhou

Integrated sensing and communication is regarded as a key enabler for next-generation wireless networks. To optimize the transmitted waveform for both sensing and communication, various performance metrics must be considered. This work…

The two-level normal hierarchical model (NHM) has played a critical role in the theory of small area estimation (SAE), one of the growing areas in statistics with numerous applications in different disciplines. In this paper, we address…

Statistics Theory · Mathematics 2017-01-17 Masayo Yoshimori Hirose , Partha Lahiri

We consider Bayesian inference of signals with vector-valued entries. Extending concentration techniques from the mathematical physics of spin glasses, we show that the matrix-valued minimum mean-square error concentrates when the size of…

Information Theory · Computer Science 2019-07-17 Jean Barbier

Bandit algorithms are increasingly used in real-world sequential decision-making problems. Associated with this is an increased desire to be able to use the resulting datasets to answer scientific questions like: Did one type of ad lead to…

Machine Learning · Computer Science 2021-11-23 Kelly W. Zhang , Lucas Janson , Susan A. Murphy

Robust estimation is an important and timely research subject. In this paper, we investigate performance lower bounds on the mean-square-error (MSE) of any estimator for the Bayesian linear model, corrupted by a noise distributed according…

Methodology · Statistics 2017-07-12 Virginie Ollier , Rémy Boyer , Mohammed Nabil El Korso , Pascal Larzabal

We study the adversarial bandit problem against arbitrary strategies, where the difficulty is captured by an unknown parameter $S$, which is the number of switches in the best arm in hindsight. To handle this problem, we adopt the…

Machine Learning · Computer Science 2025-11-26 Jung-hun Kim , Se-Young Yun

It is known that the estimating equations for quantile regression (QR) can be solved using an EM algorithm in which the M-step is computed via weighted least squares, with weights computed at the E-step as the expectation of independent…

Methodology · Statistics 2021-08-26 Haim Bar , James Booth , Martin T. Wells

This paper gives a replica analysis for the minimum mean square error (MSE) of a massive multiple-input multiple-output (MIMO) system by using Bayesian inference. The Bayes-optimal estimator is adopted to estimate the data symbols and the…

Information Theory · Computer Science 2016-11-15 Chao-Kai Wen , Yongpeng Wu , Kai-Kit Wong , Robert Schober , Pangan Ting

Building on the framework introduced by Xu and Raginksy [1] for supervised learning problems, we study the best achievable performance for model-based Bayesian reinforcement learning problems. With this purpose, we define minimum Bayesian…

Machine Learning · Computer Science 2022-07-19 Amaury Gouverneur , Borja Rodríguez-Gálvez , Tobias J. Oechtering , Mikael Skoglund

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen

Linear regression model (LRM) based on mean square error (MSE) criterion is widely used in Granger causality analysis (GCA), which is the most commonly used method to detect the causality between a pair of time series. However, when signals…

Methodology · Statistics 2019-02-20 Badong Chen , Rongjin Ma , Siyu Yu , Shaoyi Du , Jing Qin

Despite the great interest in the bandit problem, designing efficient algorithms for complex models remains challenging, as there is typically no analytical way to quantify uncertainty. In this paper, we propose Multiplier Bootstrap-based…

Machine Learning · Computer Science 2023-02-06 Runzhe Wan , Haoyu Wei , Branislav Kveton , Rui Song

We propose an iterative channel estimation algorithm based on the Least Square Estimation (LSE) and Sparse Message Passing (SMP) algorithm for the Millimeter Wave (mmWave) MIMO systems. The channel coefficients of the mmWave MIMO are…

Information Theory · Computer Science 2022-06-23 Chongwen Huang , Lei Liu , Chau Yuen , Sumei Sun