English
Related papers

Related papers: Phase Transitions with Structured Sparsity

200 papers

Fusion frames are collection of subspaces which provide a redundant representation of signal spaces. They generalize classical frames by replacing frame vectors with frame subspaces. This paper considers the sparse recovery of a signal from…

Information Theory · Computer Science 2018-04-09 Ulaş Ayaz

We present a simple model of communication in networks with hierarchical branching. We analyze the behavior of the model from the viewpoint of critical systems under different situations. For certain values of the parameters, a continuous…

Statistical Mechanics · Physics 2009-10-31 A. Arenas , A. Diaz-Guilera , R. Guimera

We consider the problem of recovering the support of a sparse signal using noisy projections. While extensive work has been done on the dense measurement matrix setting, the sparse setting remains less explored. In this work, we establish…

Machine Learning · Statistics 2025-09-03 Youssef Chaabouni , David Gamarnik

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

Numerical Analysis · Mathematics 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

Non-convex constraints have recently proven a valuable tool in many optimisation problems. In particular sparsity constraints have had a significant impact on sampling theory, where they are used in Compressed Sensing and allow structured…

Information Theory · Computer Science 2012-05-09 Thomas Blumensath

The growing environmental footprint of artificial intelligence (AI), especially in terms of storage and computation, calls for more frugal and interpretable models. Sparse models (e.g., linear, neural networks) offer a promising solution by…

Machine Learning · Statistics 2025-09-23 Sylvain Sardy , Maxime van Cutsem , Xiaoyu Ma

We study the phase transition phenomenon inherent in the shuffled (permuted) regression problem, which has found numerous applications in databases, privacy, data analysis, etc. In this study, we aim to precisely identify the locations of…

Machine Learning · Statistics 2023-11-01 Hang Zhang , Ping Li

We present a signal representation framework called the sparse manifold transform that combines key ideas from sparse coding, manifold learning, and slow feature analysis. It turns non-linear transformations in the primary sensory signal…

Machine Learning · Statistics 2018-12-04 Yubei Chen , Dylan M. Paiton , Bruno A. Olshausen

We survey known results about phase transitions in various models of statistical physics when the underlying space is a nonamenable graph. Most attention is devoted to transitive graphs and trees.

Probability · Mathematics 2009-10-31 Russell Lyons

Compressed sensing provided a data-acquisition paradigm for sparse signals. Remarkably, it has been shown that practical algorithms provide robust recovery from noisy linear measurements acquired at a near optimal sampling rate. In many…

Information Theory · Computer Science 2017-08-03 Kiryung Lee , Yanjun Li , Kyong Hwan Jin , Jong Chul Ye

In frameworks of the phenomenological approach we analyze of the phase diagram of mixed compounds. We obtain space groups of symmetry of the real structures as result of phase transition from close-packed degenerate structure. The theory of…

Statistical Mechanics · Physics 2007-05-23 B. R. Gadjiev

The fields of compressed sensing (CS) and matrix completion have shown that high-dimensional signals with sparse or low-rank structure can be effectively projected into a low-dimensional space (for efficient acquisition or processing) when…

Information Theory · Computer Science 2013-05-16 Han Lun Yap , Michael B. Wakin , Christopher J. Rozell

In many areas of imaging science, it is difficult to measure the phase of linear measurements. As such, one often wishes to reconstruct a signal from intensity measurements, that is, perform phase retrieval. In several applications the…

Information Theory · Computer Science 2015-06-16 Afonso S. Bandeira , Dustin G. Mixon

Here we present a simple stochastic threshold model consisting of a deterministic slowly decaying term and a fast stochastic noise term. The process shows a pseudo-resonance, in the sense that for small and large intensities of the noise…

Chaotic Dynamics · Physics 2011-06-08 Peter D. Ditlevsen , Holger Braun

In the first part of the series papers, we set out to answer the following question: given specific restrictions on a set of samplers, what kind of signal can be uniquely represented by the corresponding samples attained, as the foundation…

Information Theory · Computer Science 2021-08-25 Hanshen Xiao , Yaowen Zhang , Guoqiang Xiao

We consider the statistical inference problem of recovering an unknown perfect matching, hidden in a weighted random graph, by exploiting the information arising from the use of two different distributions for the weights on the edges…

Disordered Systems and Neural Networks · Physics 2020-08-10 Guilhem Semerjian , Gabriele Sicuro , Lenka Zdeborová

We consider statistical models of estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix in the sparse limit. In this limit the underlying hidden vector (that constructs the rank-one matrix) has a number…

Information Theory · Computer Science 2019-11-13 Jean Barbier , Nicolas Macris

Parsimony in signal representation is a topic of active research. Sparse signal processing and representation is the outcome of this line of research which has many applications in information processing and has shown significant…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Hojjat Seyed Mousavi

The problem of signal recovery from its Fourier transform magnitude is of paramount importance in various fields of engineering and has been around for over 100 years. Due to the absence of phase information, some form of additional…

Information Theory · Computer Science 2015-07-02 Kishore Jaganathan , Samet Oymak , Babak Hassibi

A signal is sparse in one of its representation domain if the number of nonzero coefficients in that domain is much smaller than the total number of coefficients. Sparse signals can be reconstructed from a very reduced set of…

Information Theory · Computer Science 2017-06-19 Ljubisa Stankovic , Milos Dakovic , Srdjan Stankovic , Irena Orovic