English
Related papers

Related papers: Total Variation Sparse Bayesian Learning for Block…

200 papers

This paper concerns message passing based approaches to sparse Bayesian learning (SBL) with a linear model corrupted by additive white Gaussian noise with unknown variance. With the conventional factor graph, mean field (MF) message passing…

Information Theory · Computer Science 2016-09-07 Chuanzong Zhang , Zhengdao Yuan , Zhongyong Wang , Qinghua Guo

In this paper we revisit one of the classical problems of compressed sensing. Namely, we consider linear under-determined systems with sparse solutions. A substantial success in mathematical characterization of an $\ell_1$ optimization…

Information Theory · Computer Science 2015-07-17 Mihailo Stojnic

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

Optimization and Control · Mathematics 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

The problem of covariate-shift generalization has attracted intensive research attention. Previous stable learning algorithms employ sample reweighting schemes to decorrelate the covariates when there is no explicit domain information about…

Machine Learning · Computer Science 2022-12-05 Han Yu , Peng Cui , Yue He , Zheyan Shen , Yong Lin , Renzhe Xu , Xingxuan Zhang

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

The energy consumption of large-scale ML models is dominated by data movement, shuffling billions of parameters across memory hierarchies and data centers. Sparsification offers a principled way to mitigate these costs by pruning redundant…

Probabilistic Coalition Structure Generation (PCSG) is NP-hard and can be recast as an $l_0$-type sparse recovery problem by representing coalition structures as sparse coefficient vectors over a coalition-incidence design. A natural…

Computer Science and Game Theory · Computer Science 2026-01-12 Angshul Majumdar

Sparse dictionary learning (SDL) is a fundamental technique that is useful for many image processing tasks. As an example we consider here image recovery, where SDL can be cast as a nonsmooth optimization problem. For this kind of problems,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Mohammadsadegh Khoshghiaferezaee , Moritz Krauth , Shima Shabani , Michael Breuß

In this paper we propose a two-level hierarchical Bayesian model and an annealing schedule to re-enable the noise variance learning capability of the fast marginalized Sparse Bayesian Learning Algorithms. The performance such as NMSE and…

Information Theory · Computer Science 2013-05-02 Benyuan Liu , Hongqi Fan , Zaiqi Lu , Qiang Fu

Achieving high-resolution Direction of Arrival (DoA) recovery typically requires high Signal to Noise Ratio (SNR) and a sufficiently large number of snapshots. This paper presents NUV-DoA algorithm, that augments Bayesian sparse…

Signal Processing · Electrical Eng. & Systems 2023-12-27 Mengyuan Zhao , Guy Revach , Tirza Routtenberg , Nir Shlezinger

In this paper, a s-difference type regularization for sparse recovery problem is proposed, which is the difference of the normal penalty function R(x) and its corresponding struncated function R (xs). First, we show the equivalent…

Information Theory · Computer Science 2019-05-14 Yuli Sun , Xiang Tan , Xiao Li , Lin Lei , Gangyao Kuang

Variational inference is becoming more and more popular for approximating intractable posterior distributions in Bayesian statistics and machine learning. Meanwhile, a few recent works have provided theoretical justification and new…

Statistics Theory · Mathematics 2019-09-09 Badr-Eddine Chérief-Abdellatif

Deep latent generative models have attracted increasing attention due to the capacity of combining the strengths of deep learning and probabilistic models in an elegant way. The data representations learned with the models are often…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Daniel Onoro Rubio , Giuseppe Serra , Mathias Niepert

This paper focuses on the development of a space-variant regularization model for solving an under-determined linear inverse problem. The case study is a medical image reconstruction from few-view tomographic noisy data. The primary…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Elena Morotti , Davide Evangelista , Andrea Sebastiani , Elena Loli Piccolomini

Deep neural networks have significantly alleviated the burden of feature engineering, but comparable efforts are now required to determine effective architectures for these networks. Furthermore, as network sizes have become excessively…

Machine Learning · Computer Science 2023-10-25 Yognjin Lee

This work studies the problem of jointly estimating unknown parameters from Kronecker-structured multidimensional signals, which arises in applications like intelligent reflecting surface (IRS)-aided channel estimation. Exploiting the…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Yanbin He , Geethu Joseph

It is now widely accepted that knowledge can be acquired from networks by clustering their vertices according to connection profiles. Many methods have been proposed and in this paper we concentrate on the Stochastic Block Model (SBM). The…

Applications · Statistics 2010-07-27 Pierre Latouche , Etienne Birmele , Christophe Ambroise

In this paper, direction-of-arrival estimation using nested array is studied in the framework of sparse signal representation. With the vectorization operator, a new real-valued nonnegative sparse signal recovery model which has a wider…

Signal Processing · Electrical Eng. & Systems 2019-04-12 Yunmei Shi , Xing-Peng Mao , Chunlei Zhao , Yong-Tan Liu

Modern statistical learning algorithms are capable of amazing flexibility, but struggle with interpretability. One possible solution is sparsity: making inference such that many of the parameters are estimated as being identically 0, which…

Methodology · Statistics 2023-05-15 Nathan Wycoff , Ali Arab , Katharine M. Donato , Lisa O. Singh

In high-dimensional settings, sparse structures are critical for efficiency in term of memory and computation complexity. For a linear system, to find the sparsest solution provided with an over-complete dictionary of features directly is…

Machine Learning · Statistics 2020-07-09 Yiping Jiang , Tianshi Chen