English
Related papers

Related papers: Asymptotics of MAP Inference in Deep Networks

200 papers

The problem of estimating a sparse channel, i.e. a channel with a few non-zero taps, appears in various areas of communications. Recently, we have developed an algorithm based on iterative alternating minimization which iteratively detects…

Information Theory · Computer Science 2013-08-27 Rad Niazadeh , Masoud Babaie-Zadeh , Christian Jutten

Deep generative models (DGM) are neural networks with many hidden layers trained to approximate complicated, high-dimensional probability distributions using a large number of samples. When trained successfully, we can use the DGMs to…

Machine Learning · Computer Science 2021-04-13 Lars Ruthotto , Eldad Haber

We propose efficient and low-complexity multiuser detection (MUD) algorithms for Gaussian multiple access channel (G-MAC) for short-packet transmission in massive machine type communications. To do so, we first formulate the G-MAC MUD…

Information Theory · Computer Science 2024-03-26 Mostafa Mohammadkarimi , Masoud Ardakani

This work establishes a framework of near-field communication under different array geometries of extremely large-scale multiple-input multiple-output (XL-MIMO). We first formulate the near-field spatial non-stationary channel model which…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Kangda Zhi , Yi Song , Tianyu Yang , Tuo Wu , Tengjiao Wang , Songyan Xue , Fangzhou Wu , Giuseppe Caire

Diffusion Posterior Sampling (DPS) provides a principled Bayesian approach to inverse problems by sampling from $p(x_0 \mid y)$. While posterior sampling is valuable for capturing uncertainty and multi-modality, many classical and practical…

Graphics · Computer Science 2026-05-26 Shaorong Zhang , Rob Brekelmans , Greg Ver Steeg

Approximate Message Passing (AMP) algorithms provide a valuable tool for studying mean-field approximations and dynamics in a variety of applications. Although these algorithms are often first derived for matrices having independent…

Probability · Mathematics 2024-09-10 Tianhao Wang , Xinyi Zhong , Zhou Fan

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

In this paper, we investigate the joint device activity and data detection in massive machine-type communications (mMTC) with a one-phase non-coherent scheme, where data bits are embedded in the pilot sequences and the base station…

Information Theory · Computer Science 2023-01-03 Zhe Ma , Wen Wu , Feifei Gao , Xuemin , Shen

Maximum a posteriori (MAP) estimation, like all Bayesian methods, depends on prior assumptions. These assumptions are often chosen to promote specific features in the recovered estimate. The form of the chosen prior determines the shape of…

Methodology · Statistics 2022-11-15 Zilai Si , Yucong Liu , Alexander Strang

Given a graphical model, one essential problem is MAP inference, that is, finding the most likely configuration of states according to the model. Although this problem is NP-hard, large instances can be solved in practice. A major open…

Machine Learning · Statistics 2017-03-09 Erik M. Lindgren , Alexandros G. Dimakis , Adam Klivans

One of the significant challenges of deep neural networks is that the complex nature of the network prevents human comprehension of the outcome of the network. Consequently, the applicability of complex machine learning models is limited in…

Computer Vision and Pattern Recognition · Computer Science 2020-06-22 Shailja Thakur , Sebastian Fischmeister

Parameter inference, i.e. inferring the posterior distribution of the parameters of a statistical model given some data, is a central problem to many scientific disciplines. Generative models can be used as an alternative to Markov Chain…

Machine Learning · Statistics 2023-06-06 Pablo Lemos , Adam Coogan , Yashar Hezaveh , Laurence Perreault-Levasseur

A near-field motion parameter estimation method is proposed. In contract to far-field sensing systems, the near-field sensing system leverages spherical-wave characteristics to enable full-vector location and velocity estimation. Despite…

Signal Processing · Electrical Eng. & Systems 2025-07-18 Chunwei Meng , Zhaolin Wang , Zhiqing Wei , Yuanwei Liu , Zhiyong Feng

Message passing (MP) is a computational technique used to find approximate solutions to a variety of problems defined on networks. MP approximations are generally accurate in locally tree-like networks but require corrections to maintain…

Physics and Society · Physics 2023-09-27 George T. Cantwell , Alec Kirkley , Filippo Radicchi

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

Pre-trained machine learning (ML) predictions have been increasingly used to complement incomplete data to enable downstream scientific inquiries, but their naive integration risks biased inferences. Recently, multiple methods have been…

Methodology · Statistics 2025-11-12 Xingran Chen , Tyler McCormick , Bhramar Mukherjee , Zhenke Wu

The maximum likelihood (ML) and maximum a posteriori (MAP) estimation techniques are widely used to address the direction-of-arrival (DOA) estimation problems, an important topic in sensor array processing. Conventionally the ML estimators…

Applications · Statistics 2016-03-31 Xin Zhang , Mohammed Nabil El Korso , Marius Pesavento

Recent advances in vision-language models have made zero-shot navigation feasible, enabling robots to follow natural language instructions without requiring labeling. However, existing methods that explicitly store language vectors in grid…

Robotics · Computer Science 2026-02-13 Sibaek Lee , Hyeonwoo Yu , Giseop Kim , Sunwook Choi

This paper proposes a distributed version of Determinant Point Processing (DPP) inference to enhance multi-source data diversification under limited communication bandwidth. DPP is a popular probabilistic approach that improves data…

Machine Learning · Computer Science 2023-11-21 Xiwen Chen , Huayu Li , Rahul Amin , Abolfazl Razi

Novel radio map estimation in optical wireless communications is proposed based on ML prediction rather than simulation techniques. ML training is performed on simulation and experimentally generated synthetic data and in both cases,…

Signal Processing · Electrical Eng. & Systems 2026-01-05 Helena Serpi , Christina , Politi