English
Related papers

Related papers: Sparse Bayesian Learning Algorithms Revisited: Fro…

200 papers

A common strategy for sparse linear regression is to introduce regularization, which eliminates irrelevant features by letting the corresponding weights be zeros. However, regularization often shrinks the estimator for relevant features,…

Machine Learning · Statistics 2015-10-07 Yohei Kondo , Kohei Hayashi , Shin-ichi Maeda

Accurate channel estimation is critical for realizing the performance gains of massive multiple-input multiple-output (MIMO) systems. Traditional approaches to channel estimation typically assume ideal receiver hardware and linear signal…

Signal Processing · Electrical Eng. & Systems 2026-02-20 Arttu Arjas , Italo Atzeni

This paper concerns message passing based approaches to sparse Bayesian learning (SBL) with a linear model corrupted by additive white Gaussian noise with unknown variance. With the conventional factor graph, mean field (MF) message passing…

Information Theory · Computer Science 2016-09-07 Chuanzong Zhang , Zhengdao Yuan , Zhongyong Wang , Qinghua Guo

Neural networks (NNs) are primarily developed within the frequentist statistical framework. Nevertheless, frequentist NNs lack the capability to provide uncertainties in the predictions, and hence their robustness can not be adequately…

Computational Engineering, Finance, and Science · Computer Science 2023-10-26 Nastaran Dabiran , Brandon Robinson , Rimple Sandhu , Mohammad Khalil , Dominique Poirel , Abhijit Sarkar

The multiple measurement vector problem (MMV) is a generalization of the compressed sensing problem that addresses the recovery of a set of jointly sparse signal vectors. One of the important contributions of this paper is to reveal that…

Information Theory · Computer Science 2016-01-20 Jong Chul Ye , Jong Min Kim , Yoram Bresler

In this letter, we propose an algorithm for learning a sparse weighted graph by estimating its adjacency matrix under the assumption that the observed signals vary smoothly over the nodes of the graph. The proposed algorithm is based on the…

Signal Processing · Electrical Eng. & Systems 2022-05-11 Ghania Fatima , Aakash Arora , Prabhu Babu , Petre Stoica

Score based learning (SBL) is a promising approach for learning Bayesian networks in the discrete domain. However, when employing SBL in the continuous domain, one is either forced to move the problem to the discrete domain or use metrics…

Machine Learning · Computer Science 2024-10-30 Borzou Alipourfard , Jean X. Gao

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

The spectrum environment map (SEM), which can visualize the information of invisible electromagnetic spectrum, is vital for monitoring, management, and security of spectrum resources in cognitive radio (CR) networks. In view of a limited…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Jie Wang , Qiuming Zhu , Zhipeng Lin , Qihui Wu , Yang Huang , Xuezhao Cai , Weizhi Zhong , Yi Zhao

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

Energy consumption is an important issue in continuous wireless telemonitoring of physiological signals. Compressed sensing (CS) is a promising framework to address it, due to its energy-efficient data compression procedure. However, most…

Information Theory · Computer Science 2014-11-18 Zhilin Zhang , Tzyy-Ping Jung , Scott Makeig , Zhouyue Pi , Bhaskar D. Rao

We study the sparse recovery problem with an underdetermined linear system characterized by a Kronecker-structured dictionary and a Kronecker-supported sparse vector. We cast this problem into the sparse Bayesian learning (SBL) framework…

Signal Processing · Electrical Eng. & Systems 2023-08-03 Yanbin He , Geethu Joseph

The Broad Learning System (BLS) has gained significant attention for its computational efficiency and less network parameters compared to deep learning structures. However, the standard BLS relies on the pseudoinverse solution, which…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Zijing Li

This paper presents a sparse Bayesian learning (SBL) algorithm for linear inverse problems with a high order total variation (HOTV) sparsity prior. For the problem of sparse signal recovery, SBL often produces more accurate estimates than…

Signal Processing · Electrical Eng. & Systems 2020-07-20 Victor Churchill , Anne Gelb

This work proposes a decentralized, iterative, Bayesian algorithm called CB-DSBL for in-network estimation of multiple jointly sparse vectors by a network of nodes, using noisy and underdetermined linear measurements. The proposed algorithm…

Machine Learning · Computer Science 2016-11-15 Saurabh Khanna , Chandra R. Murthy

Sparse Bayesian learning (SBL) can be implemented with low complexity based on the approximate message passing (AMP) algorithm. However, it is vulnerable to `difficult' measurement matrices as AMP can easily diverge. Damped AMP has been…

Information Theory · Computer Science 2019-08-20 Man Luo , Qinghua Guo

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

Sparse Bayesian learning (SBL) is a powerful framework for tackling the sparse coding problem while also providing uncertainty quantification. The most popular inference algorithms for SBL exhibit prohibitively large computational costs for…

Signal Processing · Electrical Eng. & Systems 2022-08-31 Alexander Lin , Andrew H. Song , Berkin Bilgic , Demba Ba

We establish exact asymptotic expressions for the normalized mutual information and minimum mean-square-error (MMSE) of sparse linear regression in the sub-linear sparsity regime. Our result is achieved by a generalization of the adaptive…

Information Theory · Computer Science 2023-04-11 Lan V. Truong

The Bayesian Lasso is constructed in the linear regression framework and applies the Gibbs sampling to estimate the regression parameters. This paper develops a new sparse learning model, named the Bayesian Lasso Sparse (BLS) model, that…

Machine Learning · Statistics 2022-07-15 Ingvild M. Helgøy , Yushu Li