English
Related papers

Related papers: Replica Analysis for Generalized Linear Regression…

200 papers

In this paper, we consider the problem of joint transmit precoding (TPC) matrix and receive filter matrix design subject to both secrecy and per-transmitter power constraints in the MIMO interference channel, where $K$ legitimate…

Information Theory · Computer Science 2016-01-20 Zhengmin Kong , Shaoshi Yang , Feilong Wu , Shixin Peng , Liang Zhong , Lajos Hanzo

There has been definite progress recently in proving the variational single-letter formula given by the heuristic replica method for various estimation problems. In particular, the replica formula for the mutual information in the case of…

Information Theory · Computer Science 2018-11-16 Jean Barbier , Nicolas Macris , Antoine Maillard , Florent Krzakala

We propose an iterative channel estimation algorithm based on the Least Square Estimation (LSE) and Sparse Message Passing (SMP) algorithm for the Millimeter Wave (mmWave) MIMO systems. The channel coefficients of the mmWave MIMO are…

Information Theory · Computer Science 2022-06-23 Chongwen Huang , Lei Liu , Chau Yuen , Sumei Sun

We develop a Bayesian methodology aimed at simultaneously estimating low-rank and row-sparse matrices in a high-dimensional multiple-response linear regression model. We consider a carefully devised shrinkage prior on the matrix of…

Methodology · Statistics 2019-04-10 Antik Chakraborty , Anirban Bhattacharya , Bani K. Mallick

In this paper, we propose a generalized expectation consistent signal recovery algorithm to estimate the signal $\mathbf{x}$ from the nonlinear measurements of a linear transform output $\mathbf{z}=\mathbf{A}\mathbf{x}$. This estimation…

Information Theory · Computer Science 2017-05-15 Hengtao He , Chao-Kai Wen , Shi Jin

A key objective in engineering problems is to predict an unknown experimental surface over an input domain. In complex physical experiments, this may be hampered by response censoring, which results in a significant loss of information. For…

Methodology · Statistics 2021-06-29 Jialei Chen , Simon Mak , V. Roshan Joseph , Chuck Zhang

This paper is concerned with the modeling errors appeared in the numerical methods of inverse medium scattering problems (IMSP). Optimization based iterative methods are wildly employed to solve IMSP, which are computationally intensive due…

Numerical Analysis · Mathematics 2021-02-23 Junxiong Jia , Bangyu Wu , Jigen Peng , Jinghuai Gao

A popular approach to sample a diffusion-based generative model is to solve an ordinary differential equation (ODE). In existing samplers, the coefficients of the ODE solvers are pre-determined by the ODE formulation, the reverse discrete…

Machine Learning · Computer Science 2023-10-04 Guoqiang Zhang , Niwa Kenta , W. Bastiaan Kleijn

Compressed sensing is a signal processing technique in which data is acquired directly in a compressed form. There are two modeling approaches that can be considered: the worst-case (Hamming) approach and a statistical mechanism, in which…

Information Theory · Computer Science 2016-01-20 Wasim Huleihel , Neri Merhav

Broadband frequency-selective fading channels usually have the inherent sparse nature. By exploiting the sparsity, adaptive sparse channel estimation (ASCE) methods, e.g., reweighted L1-norm least mean square (RL1-LMS), could bring a…

Information Theory · Computer Science 2015-03-04 Tingping Zhang , Jingpei Dan , Guan Gui

We revisit the replica method for analyzing inference and learning in parametric models, considering situations where the data-generating distribution is unknown or analytically intractable. Instead of assuming idealized distributions to…

Disordered Systems and Neural Networks · Physics 2025-11-17 Takashi Takahashi

Subsampling is a computationally efficient and scalable method to draw inference in large data settings based on a subset of the data rather than needing to consider the whole dataset. When employing subsampling techniques, a crucial…

Methodology · Statistics 2025-10-08 Amalan Mahendran , Helen Thompson , James M. McGree

Understanding when and why interpolating methods generalize well has recently been a topic of interest in statistical learning theory. However, systematically connecting interpolating methods to achievable notions of optimality has only…

Machine Learning · Statistics 2021-10-22 Eduard Oravkin , Patrick Rebeschini

We present herein a scheme by which to accurately evaluate the error exponents of a lossy data compression problem, which characterize average probabilities over a code ensemble of compression failure and success above or below a critical…

Statistical Mechanics · Physics 2007-05-23 Tadaaki Hosaka , Yoshiyuki Kabashima

Generalized linear models (GLMs) arise in high-dimensional machine learning, statistics, communications and signal processing. In this paper we analyze GLMs when the data matrix is random, as relevant in problems such as compressed sensing,…

Information Theory · Computer Science 2019-04-01 Jean Barbier , Florent Krzakala , Nicolas Macris , Léo Miolane , Lenka Zdeborová

We present a novel sparse signal reconstruction method "ISD", aiming to achieve fast reconstruction and a reduced requirement on the number of measurements compared to the classical l_1 minimization approach. ISD addresses failed…

Information Theory · Computer Science 2015-11-23 Yilun Wang , Wotao Yin

Factorizing low-rank matrices has many applications in machine learning and statistics. For probabilistic models in the Bayes optimal setting, a general expression for the mutual information has been proposed using heuristic statistical…

Information Theory · Computer Science 2017-03-24 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala , Thibault Lesieur , Lenka Zdeborova

This paper determines to within a single measurement the minimum number of measurements required to successfully reconstruct a signal drawn from a Gaussian mixture model in the low-noise regime. The method is to develop upper and lower…

Information Theory · Computer Science 2015-06-16 Francesco Renna , Robert Calderbank , Lawrence Carin , Miguel R. D. Rodrigues

In this study, we propose a projection estimation method for large-dimensional matrix factor models with cross-sectionally spiked eigenvalues. By projecting the observation matrix onto the row or column factor space, we simplify factor…

Methodology · Statistics 2020-12-04 Long Yu , Yong He , Xin-bing Kong , Xinsheng Zhang

A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual…

Information Theory · Computer Science 2019-08-23 Wenyi Zhang , Yizhu Wang , Cong Shen , Ning Liang