English
Related papers

Related papers: Bayesian Recovery for Probabilistic Coalition Stru…

200 papers

We consider the problem of recovering block-sparse signals whose structures are unknown \emph{a priori}. Block-sparse signals with nonzero coefficients occurring in clusters arise naturally in many practical scenarios. However, the…

Information Theory · Computer Science 2013-11-12 Jun Fang , Yanning Shen , Hongbin Li , Pu Wang

This paper introduces a new sparse Bayesian learning (SBL) algorithm that jointly recovers a temporal sequence of edge maps from noisy and under-sampled Fourier data. The new method is cast in a Bayesian framework and uses a prior that…

Applications · Statistics 2023-03-01 Yao Xiao , Anne Gelb , Guohui Song

Sparse Bayesian learning (SBL) is a powerful framework for tackling the sparse coding problem. However, the most popular inference algorithms for SBL become too expensive for high-dimensional settings, due to the need to store and compute a…

Signal Processing · Electrical Eng. & Systems 2022-02-28 Alexander Lin , Andrew H. Song , Berkin Bilgic , Demba Ba

Probabilistic Graphical Models (PGMs) are generative models of complex systems. They rely on conditional independence assumptions between variables to learn sparse representations which can be visualized in a form of a graph. Such models…

Machine Learning · Computer Science 2022-10-13 Harsh Shrivastava , Urszula Chajewska , Robin Abraham , Xinshi Chen

We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either…

Methodology · Statistics 2021-12-14 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

The recovery of block-sparse signals with unknown structural patterns remains a fundamental challenge in structured sparse signal reconstruction. By proposing a variance transformation framework, this paper unifies existing pattern-based…

Optimization and Control · Mathematics 2026-04-13 Yanhao Zhang , Zhihan Zhu , Yong Xia

Sparse signal recovery algorithms like sparse Bayesian learning work well but the complexity quickly grows when tackling higher dimensional parametric dictionaries. In this work we propose a novel Bayesian strategy to address the two…

Signal Processing · Electrical Eng. & Systems 2021-02-18 Rohan R. Pote , Bhaskar D. Rao

A novel Gaussian mixture model (GMM) aided sparse Bayesian learning (SBL) framework is proposed for channel state information (CSI) estimation in orthogonal time-frequency space (OTFS) modulated systems. The key attribute of the proposed…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Surbhi Gehlot , Suraj Srivastava , Sandeep Kumar Yadav , Lajos Hanzo

We characterize the effectiveness of a classical algorithm for recovering the Markov graph of a general discrete pairwise graphical model from i.i.d. samples. The algorithm is (appropriately regularized) maximum conditional log-likelihood,…

Machine Learning · Computer Science 2019-06-20 Shanshan Wu , Sujay Sanghavi , Alexandros G. Dimakis

In this paper, we consider the problem of recovering compressively sensed ultrasound images. We build on prior work, and consider a number of existing approaches that we consider to be the state-of-the-art. The methods we consider take…

Signal Processing · Electrical Eng. & Systems 2018-11-06 Richard Porter , Vladislav Tadic , Alin Achim

We consider the problem of estimating the parameters of a Gaussian or binary distribution in such a way that the resulting undirected graphical model is sparse. Our approach is to solve a maximum likelihood problem with an added l_1-norm…

Artificial Intelligence · Computer Science 2007-07-06 Onureena Banerjee , Laurent El Ghaoui , Alexandre d'Aspremont

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

Machine Learning · Statistics 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

Several learning applications require solving high-dimensional regression problems where the relevant features belong to a small number of (overlapping) groups. For very large datasets and under standard sparsity constraints, hard…

Machine Learning · Statistics 2016-05-30 Prateek Jain , Nikhil Rao , Inderjit Dhillon

Sparse Bayesian learning (SBL) has been extensively utilized in data-driven modeling to combat the issue of overfitting. While SBL excels in linear-in-parameter models, its direct applicability is limited in models where observations…

Computational Engineering, Finance, and Science · Computer Science 2023-10-24 Nastaran Dabiran , Brandon Robinson , Rimple Sandhu , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

The reconstruction of sparse signals requires the solution of an $\ell_0$-norm minimization problem in Compressed Sensing. Previous research has focused on the investigation of a single candidate to identify the support (index of nonzero…

Information Theory · Computer Science 2017-01-12 Zhetao Li , Hongqing Zeng , Chengqing Li , Jun Fang

In this paper the problem of restoration of non-negative sparse signals is addressed in the Bayesian framework. We introduce a new probabilistic hierarchical prior, based on the Generalized Hyperbolic (GH) distribution, which explicitly…

Signal Processing · Electrical Eng. & Systems 2021-02-12 Mehdi Chahine Amrouche , Hervé Carfantan , Jérôme Idier

Our work is focused on the joint sparsity recovery problem where the common sparsity pattern is corrupted by Poisson noise. We formulate the confidence-constrained optimization problem in both least squares (LS) and maximum likelihood (ML)…

Machine Learning · Statistics 2013-10-10 E. Chunikhina , R. Raich , T. Nguyen

The non-negative solution to an underdetermined linear system can be uniquely recovered sometimes, even without imposing any additional sparsity constraints. In this paper, we derive conditions under which a unique non-negative solution for…

Numerical Analysis · Mathematics 2013-09-24 Karthikeyan Natesan Ramamurthy , Jayaraman J. Thiagarajan , Andreas Spanias

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian