English
Related papers

Related papers: Density Evolution Analysis of Node-Based Verificat…

200 papers

Variational Bayes (VB) has been used to facilitate the calculation of the posterior distribution in the context of Bayesian inference of the parameters of nonlinear models from data. Previously an analytical formulation of VB has been…

Signal Processing · Electrical Eng. & Systems 2020-07-06 Michael A. Chappell , Martin S. Craig , Mark W. Woolrich

This paper establishes the asymptotic consistency of the {\it loss-calibrated variational Bayes} (LCVB) method. LCVB was proposed in~\cite{LaSiGh2011} as a method for approximately computing Bayesian posteriors in a `loss aware' manner.…

Machine Learning · Statistics 2019-11-05 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Noiseless compressive sensing is a two-steps setting that allows for undersampling a sparse signal and then reconstructing it without loss of information. The LASSO algorithm, based on $\lone$ regularization, provides an efficient and…

Information Theory · Computer Science 2025-11-13 Damien Barbier , Carlo Lucibello , Luca Saglietti , Florent Krzakala , Lenka Zdeborová

Variable kernel density estimation allows the approximation of a probability density by the mean of differently stretched and rotated kernels centered at given sampling points $y_n\in\mathbb{R}^d,\ n=1,\dots,N$. Up to now, the choice of the…

Statistics Theory · Mathematics 2018-05-07 Ilja Klebanov

Regularization of inverse problems is of paramount importance in computational imaging. The ability of neural networks to learn efficient image representations has been recently exploited to design powerful data-driven regularizers. While…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Maud Biquard , Marie Chabert , Florence Genin , Christophe Latry , Thomas Oberlin

Compressive sensing is a methodology for the reconstruction of sparse or compressible signals using far fewer samples than required by the Nyquist criterion. However, many of the results in compressive sensing concern random sampling…

Numerical Analysis · Mathematics 2014-04-02 Guangliang Chen , Atul Divekar , Deanna Needell

Nonlinear system identification is important with a wide range of applications. The typical approaches for nonlinear system identification include Volterra series models, nonlinear autoregressive with exogenous inputs models,…

Systems and Control · Electrical Eng. & Systems 2019-11-28 Hongpeng Zhou , Chahine Ibrahim , Wei Pan

We introduce a novel algorithm for nonlinear processing of data gathered by an active array of sensors which probes a medium with pulses and measures the resulting waves. The algorithm is motivated by the application of array imaging. We…

Numerical Analysis · Mathematics 2019-02-20 Liliana Borcea , Vladimir Druskin , Alexander V. Mamonov , Mikhail Zaslavsky

Gradient descent is one of the most widely used iterative algorithms in modern statistical learning. However, its precise algorithmic dynamics in high-dimensional settings remain only partially understood, which has limited its broader…

Statistics Theory · Mathematics 2025-11-19 Qiyang Han , Xiaocong Xu

Understanding how systems evolve over time often requires discovering the differential equations that govern their behavior. Automatically learning these equations from experimental data is challenging when the data are noisy or limited,…

Data Analysis, Statistics and Probability · Physics 2025-11-19 Oriol Cabanas-Tirapu , Sergio Cobo-Lopez , Savannah E. Sanchez , Forest L. Rohwer , Marta Sales-Pardo , Roger Guimerà

In this paper, we propose \textit{coded compressive sensing} that recovers an $n$-dimensional integer sparse signal vector from a noisy and quantized measurement vector whose dimension $m$ is far-fewer than $n$. The core idea of coded…

Information Theory · Computer Science 2016-01-27 Namyoon Lee , Song-Nam Hong

We solve the compressive sensing problem via convolutional factor analysis, where the convolutional dictionaries are learned {\em in situ} from the compressed measurements. An alternating direction method of multipliers (ADMM) paradigm for…

Machine Learning · Statistics 2017-01-12 Xin Yuan , Yunchen Pu , Lawrence Carin

We consider a structured estimation problem where an observed matrix is assumed to be generated as an $s$-sparse linear combination of $N$ given $n\times n$ positive-semidefinite matrices. Recovering the unknown $N$-dimensional and…

Information Theory · Computer Science 2020-03-27 Fabian Jaensch , Peter Jung

Nonlinear equations systems (NESs) are widely used in real-world problems while they are also difficult to solve due to their characteristics of nonlinearity and multiple roots. Evolutionary algorithm (EA) is one of the methods for solving…

Neural and Evolutionary Computing · Computer Science 2020-08-11 Aijuan Song , Guohua Wu , Witold Pedrycz

Data compression algorithms are generally perceived as being of interest for data communication and storage purposes only. However, their use in the field of data classification and analysis is also of equal importance. Automatic data…

In the classical non-adaptive group testing setup, pools of items are tested together, and the main goal of a recovery algorithm is to identify the "complete defective set" given the outcomes of different group tests. In contrast, the main…

Information Theory · Computer Science 2016-03-01 Abhay Sharma , Chandra R. Murthy

We study data-driven decision-making problems in the Bayesian framework, where the expectation in the Bayes risk is replaced by a risk-sensitive entropic risk measure. We focus on problems where calculating the posterior distribution is…

Optimization and Control · Mathematics 2021-09-13 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

This paper proposes a verification-based decoding approach for reconstruction of a sparse signal with incremental sparse measurements. In its first step, the verification-based decoding algorithm is employed to reconstruct the signal with a…

Information Theory · Computer Science 2013-02-12 Xiaofu Wu , Zhen Yang , Lu Gan

This paper aims to propose and theoretically analyze a new distributed scheme for sparse linear regression and feature selection. The primary goal is to learn the few causal features of a high-dimensional dataset based on noisy observations…

Machine Learning · Statistics 2021-11-05 Hanie Barghi , Amir Najafi , Seyed Abolfazl Motahari

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. In many applications, the spatial distribution of a field needs to be…

Machine Learning · Computer Science 2021-09-01 Roberto Ponciroli , Andrea Rovinelli , Lander Ibarra