English
Related papers

Related papers: Estimation for High-Dimensional Multi-Layer Genera…

200 papers

This paper investigates a channel estimator based on Gaussian mixture models (GMMs) in the context of linear inverse problems with additive Gaussian noise. We fit a GMM to given channel samples to obtain an analytic probability density…

Signal Processing · Electrical Eng. & Systems 2022-09-14 Michael Koller , Benedikt Fesl , Nurettin Turan , Wolfgang Utschick

For uplink large-scale MIMO systems, minimum mean square error (MMSE) algorithm is near-optimal but involves matrix inversion with high complexity. In this paper, we propose to exploit the Gauss-Seidel (GS) method to iteratively realize the…

Information Theory · Computer Science 2014-11-12 Linglong Dai , Xinyu Gao , Xin Su , Shuangfeng Han , Chih-Lin I , Zhaocheng Wang

We propose a new sparse estimation method, termed MIC (Minimum approximated Information Criterion), for generalized linear models (GLM) in fixed dimensions. What is essentially involved in MIC is the approximation of the $\ell_0$-norm with…

Methodology · Statistics 2018-07-23 Xiaogang Su , Juanjuan Fan , Richard A. Levine , Martha E. Nunn , Chih-Ling Tsai

The linear regression model with a random variable (RV) measurement matrix, where the mean of the random measurement matrix has full column rank, has been extensively studied. In particular, the quasiconvexity of the maximum likelihood…

Signal Processing · Electrical Eng. & Systems 2025-07-16 Ruohai Guo , Jiang Zhu , Xing Jiang , Fengzhong Qu

The minimum weight matching (MWM) and maximum likelihood decoding (MLD) are two widely used and distinct decoding strategies for quantum error correction. For a given syndrome, the MWM decoder finds the most probable physical error…

Quantum Physics · Physics 2025-10-29 Mao Lin

Symbol detection for Massive Multiple-Input Multiple-Output (MIMO) is a challenging problem for which traditional algorithms are either impractical or suffer from performance limitations. Several recently proposed learning-based approaches…

Signal Processing · Electrical Eng. & Systems 2019-06-12 Mehrdad Khani , Mohammad Alizadeh , Jakob Hoydis , Phil Fleming

This paper considers the problem of networks reconstruction from heterogeneous data using a Gaussian Graphical Mixture Model (GGMM). It is well known that parameter estimation in this context is challenging due to large numbers of variables…

Machine Learning · Statistics 2013-10-08 Anani Lotsi , Ernst Wit

An estimation problem of fundamental interest is that of phase synchronization, in which the goal is to recover a collection of phases using noisy measurements of relative phases. It is known that in the Gaussian noise setting, the maximum…

Optimization and Control · Mathematics 2016-11-02 Huikang Liu , Man-Chung Yue , Anthony Man-Cho So

We present doubly stochastic gradient MCMC, a simple and generic method for (approximate) Bayesian inference of deep generative models (DGMs) in a collapsed continuous parameter space. At each MCMC sampling step, the algorithm randomly…

Machine Learning · Computer Science 2016-03-08 Chao Du , Jun Zhu , Bo Zhang

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

Distributed statistical inference has recently attracted immense attention. The asymptotic efficiency of the maximum likelihood estimator (MLE), the one-step MLE, and the aggregated estimating equation estimator are established for…

Methodology · Statistics 2020-08-14 Ping Zhou , Zhen Yu , Jingyi Ma , Maozai Tian , Ye Fan

Suppose a linear model y = Hx + n, where inputs x, n are independent Gaussian mixtures. The problem is to design the transfer matrix H so as to minimize the mean square error (MSE) when estimating x from y. This problem has important…

Optimization and Control · Mathematics 2015-06-11 John T. Flåm , Dave Zachariah , Mikko Vehkaperä , Saikat Chatterjee

We present new fundamental results for the mean square error (MSE)-optimal conditional mean estimator (CME) in one-bit quantized systems for a Gaussian mixture model (GMM) distributed signal of interest, possibly corrupted by additive white…

Signal Processing · Electrical Eng. & Systems 2024-07-02 Benedikt Fesl , Wolfgang Utschick

By far the most common way to estimate an expected loss in machine learning is to draw samples, compute the loss on each one, and take the empirical average. However, sampling is not necessarily optimal. Given an MLP at initialization, we…

Machine Learning · Computer Science 2026-05-18 Wilson Wu , Victor Lecomte , Michael Winer , George Robinson , Jacob Hilton , Paul Christiano

Error syndromes for heavy hexagonal code and other topological codes such as surface code have typically been decoded by using Minimum Weight Perfect Matching (MWPM) based methods. Recent advances have shown that topological codes can be…

In real data analysis with structural equation modeling, data are unlikely to be exactly normally distributed. If we ignore the non-normality reality, the parameter estimates, standard error estimates, and model fit statistics from normal…

Methodology · Statistics 2021-06-21 Han Du , Peter M. Bentler

Linear mixed models (LMM) are widely adopted in genome-wide association studies (GWAS) to account for population stratification and cryptic relatedness. However, the parameter estimation of LMMs imposes substantial computational burdens due…

Computation · Statistics 2025-08-08 Zhibin Pu , Shufei Ge , Shijia Wang

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

Machine Learning · Statistics 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

Generalized Method of Moments (GMM) estimators in their various forms, including the popular Maximum Likelihood (ML) estimator, are frequently applied for the evaluation of complex econometric models with not analytically computable moment…

Methodology · Statistics 2021-09-27 Alexandros Gilch , Michael Griebel , Jens Oettershagen

This paper investigates semi-blind channel estimation for massive multiple-input multiple-output (MIMO) systems. To this end, we first estimate a subspace based on all received symbols (pilot and payload) to provide additional information…

Signal Processing · Electrical Eng. & Systems 2025-10-22 Franz Weißer , Nurettin Turan , Dominik Semmler , Fares Ben Jazia , Wolfgang Utschick