English
Related papers

Related papers: Rectified Gaussian Scale Mixtures and the Sparse N…

200 papers

This paper presents a new Bayesian collaborative sparse regression method for linear unmixing of hyperspectral images. Our contribution is twofold; first, we propose a new Bayesian model for structured sparse regression in which the…

Computation · Statistics 2023-07-19 Yoann Altmann , Marcelo Pereyra , Jose Bioucas-Dias

In this paper, we investigate a Bayesian sparse reconstruction algorithm called compressive sensing via Bayesian support detection (CS-BSD). This algorithm is quite robust against measurement noise and achieves the performance of a minimum…

Information Theory · Computer Science 2012-05-15 Jaewook Kang , Heung-No Lee , Kiseon Kim

The R package sns implements Stochastic Newton Sampler (SNS), a Metropolis-Hastings Monte Carlo Markov Chain algorithm where the proposal density function is a multivariate Gaussian based on a local, second-order Taylor series expansion of…

Computation · Statistics 2015-02-09 Alireza S. Mahani , Asad Hasan , Marshall Jiang , Mansour T. A. Sharabiani

In this paper, we propose a generalized scale mixture family of distributions, namely the Power Exponential Scale Mixture (PESM) family, to model the sparsity inducing priors currently in use for sparse signal recovery (SSR). We show that…

Machine Learning · Computer Science 2016-05-10 Ritwik Giri , Bhaskar D. Rao

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

Solving linear regression problems based on the total least-squares (TLS) criterion has well-documented merits in various applications, where perturbations appear both in the data vector as well as in the regression matrix. However,…

Information Theory · Computer Science 2011-04-20 Hao Zhu , Geert Leus , Georgios B. Giannakis

In this paper, we propose a regularized mixture probabilistic model to cluster matrix data and apply it to brain signals. The approach is able to capture the sparsity (low rank, small/zero values) of the original signals by introducing…

Methodology · Statistics 2018-08-07 Xu Gao , Weining Shen , Hernando Ombao

Learning from implicit feedback in recommender systems is fundamentally challenged by pervasive label noise. While conventional denoising approaches often discard noisy instances to ensure robustness, this strategy inevitably suffers from…

Machine Learning · Computer Science 2026-05-21 Zongyu Li , Xuanyu Liu , Gongce Cao , Shirui Sun , Yaqi Fang , Yongshuai Yu

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

We develop a novel randomized conjugate gradient least squares (RCGLS) method for solving least-squares problems, in which iterative sketching is employed at each step to reduce the dimension and hence the computational cost. In particular,…

Numerical Analysis · Mathematics 2026-05-26 Yun Zeng , Jian-Feng Cai , Deren Han , Jiaxin Xie

We revisit skip-gram negative sampling (SGNS), one of the most popular neural-network based approaches to learning distributed word representation. We first point out the ambiguity issue undermining the SGNS model, in the sense that the…

Computation and Language · Computer Science 2019-01-15 Cun Mu , Guang Yang , Zheng Yan

The typical approach for recovery of spatially correlated signals is regularized least squares with a coupled regularization term. In the Bayesian framework, this algorithm is seen as a maximum-a-posterior estimator whose postulated prior…

Information Theory · Computer Science 2018-05-31 Ali Bereyhi , Saeid Haghighatshoar , Ralf R. Müller

Quantifying predictive uncertainty is essential for real world machine learning applications, especially in scenarios requiring reliable and interpretable predictions. Many common parametric approaches rely on neural networks to estimate…

Machine Learning · Statistics 2026-03-31 Yang Yang , Chunlin Ji , Haoyang Li , Ke Deng

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Bayesian multidimensional scaling (BMDS) is a probabilistic dimension reduction tool that allows one to model and visualize data consisting of dissimilarities between pairs of objects. Although BMDS has proven useful within, e.g., Bayesian…

Methodology · Statistics 2025-05-23 Ami Sheth , Aaron Smith , Andrew J. Holbrook

Graph sampling with noise is a fundamental problem in graph signal processing (GSP). Previous works assume an unbiased least square (LS) signal reconstruction scheme and select samples greedily via expensive extreme eigenvector computation.…

Signal Processing · Electrical Eng. & Systems 2019-02-19 Yuanchao Bai , Gene Cheung , Fen Wang , Xianming Liu , Wen Gao

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

High-dimensional data common in genomics, proteomics, and chemometrics often contains complicated correlation structures. Recently, partial least squares (PLS) and Sparse PLS methods have gained attention in these areas as dimension…

Machine Learning · Statistics 2012-04-19 Genevera I. Allen , Christine Peterson , Marina Vannucci , Mirjana Maletic-Savatic

Nuclear Magnetic Resonance (NMR) spectroscopy is an efficient technique to analyze chemical mixtures in which one acquires spectra of the chemical mixtures along one ore more dimensions. One of the important issues is to efficiently analyze…

Medical Physics · Physics 2020-11-03 Afef Cherni , Sandrine Anthoine , Caroline Chaux