English
Related papers

Related papers: Rigorous Dynamics of Expectation-Propagation-Based…

200 papers

The sparse optimization problems arise in many areas of science and engineering, such as compressed sensing, image processing, statistical and machine learning. The $\ell_{0}$-minimization problem is one of such optimization problems, which…

Optimization and Control · Mathematics 2019-04-23 Jialiang Xu , Yun-Bin Zhao

We consider the problem of reconstructing a signal from multi-layered (possibly) non-linear measurements. Using non-rigorous but standard methods from statistical physics we present the Multi-Layer Approximate Message Passing (ML-AMP)…

Information Theory · Computer Science 2020-01-22 Andre Manoel , Florent Krzakala , Marc Mézard , Lenka Zdeborová

The problem of estimating a sparse signal from low dimensional noisy observations arises in many applications, including super resolution, signal deconvolution, and radar imaging. In this paper, we consider a sparse signal model with…

Information Theory · Computer Science 2020-06-24 Youye Xie , Michael B. Wakin , Gongguo Tang

Compressed sensing is a promising technique that attempts to faithfully recover sparse signal with as few linear and nonadaptive measurements as possible. Its performance is largely determined by the characteristic of sensing matrix.…

Information Theory · Computer Science 2013-10-03 Weizhi Lu , Weiyu Li , Kidiyo Kpalma , Joseph Ronsin

Non-Hermitian systems associated with exceptional points (EPs) are expected to demonstrate a giant response enhancement for various sensors. The widely investigated enhancement mechanism based on diverging from an EP should destroy the EP…

Optics · Physics 2023-07-19 Xuan Mao , Guo-Qing Qin , Hao Zhang , Bo-Yang Wang , Dan Long , Gui-Qin Li , Gui-Lu Long

Many conventional statistical procedures are extremely sensitive to seemingly minor deviations from modeling assumptions. This problem is exacerbated in modern high-dimensional settings, where the problem dimension can grow with and…

Machine Learning · Statistics 2017-02-27 Simon S. Du , Sivaraman Balakrishnan , Aarti Singh

Approximate Message Passing (AMP) algorithms are a class of iterative procedures for computationally-efficient estimation in high-dimensional inference and estimation tasks. Due to the presence of an 'Onsager' correction term in its…

Statistics Theory · Mathematics 2023-02-02 Collin Cademartori , Cynthia Rush

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

Machine Learning · Statistics 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

Efficient estimation of line spectral from quantized samples is of significant importance in information theory and signal processing, e.g., channel estimation in energy efficient massive MIMO systems and direction of arrival estimation.…

Information Theory · Computer Science 2019-09-04 Jiang Zhu , Qi Zhang , Xiangming Meng

This work deals with directional of arrival (DOA) estimation with a large antenna array. We first develop a novel signal model with a sparse system transfer matrix using an inverse discrete Fourier transform (DFT) operation, which leads to…

Signal Processing · Electrical Eng. & Systems 2023-09-04 Yiwen Mao , Dawei Gao , Qinghua Guo , Ming Jin

We consider the estimation of an i.i.d. (possibly non-Gaussian) vector $\xbf \in \R^n$ from measurements $\ybf \in \R^m$ obtained by a general cascade model consisting of a known linear transform followed by a probabilistic componentwise…

Information Theory · Computer Science 2012-12-04 Ulugbek S. Kamilov , Sundeep Rangan , Alyson K. Fletcher , Michael Unser

Backpropagation learning algorithm, the workhorse of modern artificial intelligence, is notoriously difficult to implement in physical neural networks. Equilibrium Propagation (EP) is an alternative with comparable efficiency and strong…

Machine Learning · Computer Science 2026-03-17 Karol Sajnok , Michał Matuszewski

In this letter, we propose a sparsity promoting feedback acquisition and reconstruction scheme for sensing, encoding and subsequent reconstruction of spectrally sparse signals. In the proposed scheme, the spectral components are estimated…

Information Theory · Computer Science 2017-11-28 Mahdi Boloursaz Mashhadi , Saeed Gazor , Nazanin Rahnavard , Farokh Marvasti

Deregulation of energy markets, penetration of renewables, advanced metering capabilities, and the urge for situational awareness, all call for system-wide power system state estimation (PSSE). Implementing a centralized estimator though is…

Machine Learning · Statistics 2012-07-03 Vassilis Kekatos , Georgios B. Giannakis

Inducing-point-based sparse variational Gaussian processes have become the standard workhorse for scaling up GP models. Recent advances show that these methods can be improved by introducing a diagonal scaling matrix to the conditional…

Machine Learning · Statistics 2025-07-04 Thang D. Bui , Michalis K. Titsias

We give some new results on sparse signal recovery in the presence of noise, for weighted spaces. Traditionally, were used dictionaries that have the norm equal to 1, but, for random dictionaries this condition is rarely satisfied.…

Functional Analysis · Mathematics 2016-01-27 L. Gavruta , G. Zamani Eskandani , P. Gavruta

Equilibrium Propagation (EP) is a supervised learning algorithm that trains network parameters using local neuronal activity. This is in stark contrast to backpropagation, where updating the parameters of the network requires significant…

Machine Learning · Computer Science 2025-04-01 Jonathan Peters , Philippe Talatchian

This paper studies the problem of power allocation in compressed sensing when different components in the unknown sparse signal have different probability to be non-zero. Given the prior information of the non-uniform sparsity and the total…

Information Theory · Computer Science 2014-05-12 Xiaochen Zhao , Wei Dai

The recovery of signals that are sparse not in a basis, but rather sparse with respect to an over-complete dictionary is one of the most flexible settings in the field of compressed sensing with numerous applications. As in the standard…

Information Theory · Computer Science 2021-10-01 Pedro Abdalla , Christian Kümmerle

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová
‹ Prev 1 8 9 10 Next ›