English
Related papers

Related papers: Expectation Propagation based Line Spectral Estima…

200 papers

Mixed-effects regression models represent a useful subclass of regression models for grouped data; the introduction of random effects allows for the correlation between observations within each group to be conveniently captured when…

Methodology · Statistics 2024-09-25 Jackson Zhou , John T. Ormerod , Clara Grazian

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

In this paper, we extend the bilinear generalized approximate message passing (BiG-AMP) approach, originally proposed for high-dimensional generalized bilinear regression, to the multi-layer case for the handling of cascaded problem such as…

Information Theory · Computer Science 2021-09-08 Qiuyun Zou , Haochuan Zhang , Hongwen Yang

Large-scale multiple-input-multiple-output (MIMO) systems typically operate in dense array deployments with limited scattering environments, leading to highly correlated and ill-conditioned channel matrices that severely degrade the…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Kabuto Arai , Takumi Yoshida , Takumi Takahashi , Koji Ishibashi

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

Nonlinear state estimation (SE), with the goal of estimating complex bus voltages based on all types of measurements available in the power system, is usually solved using the iterative Gauss-Newton method. The nonlinear SE presents some…

Machine Learning · Computer Science 2022-09-09 Ognjen Kundacina , Mirsad Cosovic , Dragisa Miskovic , Dejan Vukobratovic

This paper investigates sparse signal recovery based on expectation propagation (EP) from unitarily invariant measurements. A rigorous analysis is presented for the state evolution (SE) of an EP-based message-passing algorithm in the large…

Information Theory · Computer Science 2017-04-06 Keigo Takeuchi

We study the problem of downlink channel estimation in multi-user massive multiple input multiple output (MIMO) systems. To this end, we consider a Bayesian compressive sensing approach in which the clustered sparse structure of the channel…

Information Theory · Computer Science 2021-06-08 Mohammed Rashid , Mort Naraghi-Pour

Bayesian inference is a popular method to build learning algorithms but it is hampered by the fact that its key object, the posterior probability distribution, is often uncomputable. Expectation Propagation (EP) (Minka (2001)) is a popular…

Machine Learning · Statistics 2016-12-16 Guillaume P. Dehaene

Line spectral estimation (LSE) involves estimating both spectral frequencies and their associated complex amplitudes. Existing Fisher-information-based benchmarks are local and therefore do not capture either the threshold behavior of…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Fangqing Xiao , Dirk T. M. Slock

Line spectral estimation (LSE) from multi snapshot samples is studied utilizing the variational Bayesian methods. Motivated by the recently proposed variational line spectral estimation (VALSE) method for a single snapshot, we develop the…

Signal Processing · Electrical Eng. & Systems 2018-11-30 Qi Zhang , Jiang Zhu , Peter Gerstoft , Mihai-Alin Badiu , Zhiwei Xu

Expectation Propagation (Minka, 2001) is a widely successful algorithm for variational inference. EP is an iterative algorithm used to approximate complicated distributions, typically to find a Gaussian approximation of posterior…

Computation · Statistics 2016-04-01 Guillaume Dehaene , Simon Barthelmé

The use of dual system estimation (DSE) is heavily used in Census Bureau operations. With DSE methods, it is important to implement methods to infer the population size among those with missing data from one or both data sources. The use of…

Computation · Statistics 2026-05-27 Zhiyuan Lu

For line spectrum estimation, we derive the maximum a posteriori probability estimator where prior knowledge of frequencies is modeled probabilistically. Since the spectrum is periodic, an appropriate distribution is the circular von Mises…

Statistics Theory · Mathematics 2013-06-26 Dave Zachariah , Petter Wirfält , Magnus Jansson , Saikat Chatterjee

A common divide-and-conquer approach for Bayesian computation with big data is to partition the data, perform local inference for each piece separately, and combine the results to obtain a global posterior approximation. While being…

We extend the generalized approximate message passing (G-AMP) approach, originally proposed for high-dimensional generalized-linear regression in the context of compressive sensing, to the generalized-bilinear case, which enables its…

Information Theory · Computer Science 2015-06-17 Jason T. Parker , Philip Schniter , Volkan Cevher

The main goal of this paper is to study the parameter estimation problem, using the Bayesian methodology, for the drift coefficient of some linear (parabolic) SPDEs driven by a multiplicative noise of special structure. We take the spectral…

Statistics Theory · Mathematics 2019-03-05 Ziteng Cheng , Igor Cialenco , Ruoting Gong

Ensemble forecasting of nonlinear systems involves the use of a model to run forward a discrete ensemble (or set) of initial states. Data assimilation techniques tend to focus on estimating the true state of the system, even though model…

Chaotic Dynamics · Physics 2012-07-19 Reason L. Machete , Irene M. Moroz

Improved performance in higher-order spectral density estimation is achieved using a general class of infinite-order kernels. These estimates are asymptotically less biased but with the same order of variance as compared to the classical…

Statistics Theory · Mathematics 2007-06-13 Arthur Berg , Dimitris Politis