English
Related papers

Related papers: Bayesian Hypothesis Test using Nonparametric Belie…

200 papers

In this report, a novel efficient algorithm for recovery of jointly sparse signals (sparse matrix) from multiple incomplete measurements has been presented, in particular, the NESTA-based MMV optimization method. In a nutshell, the jointly…

Information Theory · Computer Science 2009-05-21 Lianlin Li , Fang Li

We propose and analyze a solution to the problem of recovering a block sparse signal with sparse blocks from linear measurements. Such problems naturally emerge inter alia in the context of mobile communication, in order to meet the…

Information Theory · Computer Science 2020-09-23 Ingo Roth , Martin Kliesch , Axel Flinth , Gerhard Wunder , Jens Eisert

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

Machine Learning · Statistics 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

We provide a novel statistical perspective on a classical problem at the intersection of computer science and information theory: recovering the empirical frequency of a symbol in a large discrete dataset using only a compressed…

Methodology · Statistics 2025-04-11 Mario Beraha , Stefano Favaro , Matteo Sesia

Compressed sensing (CS) or sparse signal reconstruction (SSR) is a signal processing technique that exploits the fact that acquired data can have a sparse representation in some basis. One popular technique to reconstruct or approximate the…

Information Theory · Computer Science 2014-05-08 Esa Ollila , Hyon-Jung Kim , Visa Koivunen

This paper presents a hierarchical Bayesian model to reconstruct sparse images when the observations are obtained from linear transformations and corrupted by an additive white Gaussian noise. Our hierarchical Bayes model is well suited to…

Data Analysis, Statistics and Probability · Physics 2011-01-19 Nicolas Dobigeon , Alfred O. Hero , Jean-Yves Tourneret

In compressive sensing (CS) theory, as the number of samples is decreased below a minimum threshold, the average error of the recovery increases. Sufficient sampling is either required for quality reconstruction or the error is resignedly…

Information Theory · Computer Science 2015-10-14 Miguel Dominguez , Behnaz Ghoraani , Ph. D

Sparse Bayesian Learning (SBL) models are extensively used in signal processing and machine learning for promoting sparsity through hierarchical priors. The hyperparameters in SBL models are crucial for the model's performance, but they are…

Machine Learning · Computer Science 2024-01-08 Feng Yu , Lixin Shen , Guohui Song

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

Noisy-OR Bayesian Networks (BNs) are a family of probabilistic graphical models which express rich statistical dependencies in binary data. Variational inference (VI) has been the main method proposed to learn noisy-OR BNs with complex…

Machine Learning · Computer Science 2023-02-02 Antoine Dedieu , Guangyao Zhou , Dileep George , Miguel Lazaro-Gredilla

Bayesian inference in high-dimensional discrete-input additive noise models is a fundamental challenge in communication systems, as the support of the required joint a posteriori probability (APP) mass function grows exponentially with the…

Information Theory · Computer Science 2026-04-08 Luca Schmid , Dominik Sulz , Shrinivas Chimmalgi , Laurent Schmalen

This work is a re-examination of the sparse Bayesian learning (SBL) of linear regression models of Tipping (2001) in a high-dimensional setting. We propose a hard-thresholded version of the SBL estimator that achieves, for orthogonal design…

Methodology · Statistics 2015-02-12 Yves Atchade , Chia Chye Yee

A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features,…

Machine Learning · Statistics 2015-10-07 Yohei Kondo , Kohei Hayashi , Shin-ichi Maeda

The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower…

Information Theory · Computer Science 2009-11-05 Gongguo Tang , Arye Nehorai

Bayesian Neural Networks (BNNs) provide principled estimates of model and data uncertainty by encoding parameters as distributions. This makes them key enablers for reliable AI that can be deployed on safety critical edge systems. These…

Emerging Technologies · Computer Science 2024-11-13 Prabodh Katti , Bashir M. Al-Hashimi , Bipin Rajendran

In this paper, we present a novel yet simple homotopy proximal mapping algorithm for compressive sensing. The algorithm adopts a simple proximal mapping of the $\ell_1$ norm at each iteration and gradually reduces the regularization…

Information Theory · Computer Science 2016-08-29 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu , Zhi-Hua Zhou

This paper addresses the problem of sparse phase retrieval, a fundamental inverse problem in applied mathematics, physics, and engineering, where a signal need to be reconstructed using only the magnitude of its transformation while phase…

Machine Learning · Statistics 2025-04-15 The Tien Mai

Compressed sensing typically deals with the estimation of a system input from its noise-corrupted linear measurements, where the number of measurements is smaller than the number of input components. The performance of the estimation…

Information Theory · Computer Science 2016-11-17 Jin Tan , Danielle Carmon , Dror Baron

Compressed sensing has been a very successful high-dimensional signal acquisition and recovery technique that relies on linear operations. However, the actual measurements of signals have to be quantized before storing or processing.…

Information Theory · Computer Science 2026-01-09 Namiko Matsumoto , Arya Mazumdar