English
Related papers

Related papers: Greedier is Better: Selecting Multiple Neighbors p…

200 papers

In this paper, we present a convergence analysis of the Group Projected Subspace Pursuit (GPSP) algorithm proposed by He et al. [HKL+23] (Group Projected subspace pursuit for IDENTification of variable coefficient differential equations…

Information Theory · Computer Science 2024-07-16 Roy Y. He , Haixia Liu , Hao Liu

Orthogonal Matching pursuit (OMP) is a popular algorithm to estimate an unknown sparse vector from multiple linear measurements of it. Assuming exact sparsity and that the measurements are corrupted by additive Gaussian noise, the success…

Statistics Theory · Mathematics 2020-08-07 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

In this paper we define a new coherence index, named the global 2-coherence, of a given dictionary and study its relationship with the traditional mutual coherence and the restricted isometry constant. By exploring this relationship, we…

Information Theory · Computer Science 2014-05-15 Mingrui Yang , Frank de Hoog

Overlapping Community Search (OCS) identifies nodes that interact with multiple communities based on a specified query. Existing community search approaches fall into two categories: algorithm-based models and Machine Learning-based (ML)…

Social and Information Networks · Computer Science 2025-01-10 Qing Sima , Jianke Yu , Xiaoyang Wang , Wenjie Zhang , Ying Zhang , Xuemin Lin

Support recovery of sparse signals from compressed linear measurements is a fundamental problem in compressed sensing (CS). In this paper, we study the orthogonal matching pursuit (OMP) algorithm for the recovery of support under noise. We…

Information Theory · Computer Science 2015-10-28 Jian Wang

Remarkable properties of Compressed sensing (CS) has led researchers to utilize it in various other fields where a solution to an underdetermined system of linear equations is needed. One such application is in the area of array signal…

Information Theory · Computer Science 2018-01-26 Abhishek Aich , P. Palanisamy

We propose a novel application of the Simultaneous Orthogonal Matching Pursuit (S-OMP) procedure for sparsistant variable selection in ultra-high dimensional multi-task regression problems. Screening of variables, as introduced in…

Machine Learning · Statistics 2010-12-20 Mladen Kolar , Eric P. Xing

Direction of Arrival (DOA) estimation of multiple narrow-band coherent or partially coherent sources is a major challenge in array signal processing. Though many subspace- based algorithms are available in literature, none of them tackle…

Information Theory · Computer Science 2018-01-26 Abhishek Aich , P. Palanisamy

In this paper we present a new coherence-based performance guarantee for the Orthogonal Matching Pursuit (OMP) algorithm. An upper bound for the probability of correctly identifying the support of a sparse signal with additive white…

Information Theory · Computer Science 2016-10-25 Mohammad Emadi , Ehsan Miandji , Jonas Unger , Ehsan Afshari

Clustering a graph means identifying internally dense subgraphs which are only sparsely interconnected. Formalizations of this notion lead to measures that quantify the quality of a clustering and to algorithms that actually find…

Data Structures and Algorithms · Computer Science 2011-12-12 Robert Görke , Andrea Schumm , Dorothea Wagner

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

For identifying the non-Gaussian impulsive noise systems, normalized LMP (NLMP) has been proposed to combat impulsive-inducing instability. However, the standard algorithm is without considering the inherent sparse structure distribution of…

Information Theory · Computer Science 2015-03-04 Wentao Ma , Hua Qu , Jihong Zhao , Badong Chen , Guan Gui

This paper presents a new analysis for the orthogonal matching pursuit (OMP) algorithm. It is shown that if the restricted isometry property (RIP) is satisfied at sparsity level $O(\bar{k})$, then OMP can recover a $\bar{k}$-sparse signal…

Information Theory · Computer Science 2011-06-06 Tong Zhang

The reconstruction of sparse signals requires the solution of an $\ell_0$-norm minimization problem in Compressed Sensing. Previous research has focused on the investigation of a single candidate to identify the support (index of nonzero…

Information Theory · Computer Science 2017-01-12 Zhetao Li , Hongqing Zeng , Chengqing Li , Jun Fang

Configuration Optimization Problems (COPs), which involve minimizing a loss function over a set of discrete points $\boldsymbol{\gamma} \subset P$, are common in areas like Model Order Reduction, Active Learning, and Optimal Experimental…

Numerical Analysis · Mathematics 2024-10-24 Evie Nielen , Oliver Tse , Karen Veroy

Sparse Filtering is a popular feature learning algorithm for image classification pipelines. In this paper, we connect the performance of Sparse Filtering with spectral properties of the corresponding feature matrices. This connection…

Computer Vision and Pattern Recognition · Computer Science 2015-05-26 Johannes Lederer , Sergio Guadarrama

This paper considers the parameter estimation problem in Mixed Membership Stochastic Block Model (MMSB), which is a quite general instance of random graph model allowing for overlapping community structure. We present the new algorithm…

Statistics Theory · Mathematics 2020-01-24 Maxim Panov , Konstantin Slavnov , Roman Ushakov

Finding the sparsest solution to the underdetermined system $\mathbf{y}=\mathbf{Ax}$, given a tolerance, is known to be NP-hard. Many approximate solutions to this problem exist, and Orthogonal Matching Pursuit (OMP) is one of the most…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-01 Ariel Lubonja , Sebastian Kazmarek Praesius , Trac Duy Tran

In this paper we present a new coherence-based performance guarantee for the Orthogonal Matching Pursuit (OMP) algorithm. A lower bound for the probability of correctly identifying the support of a sparse signal with additive white Gaussian…

Information Theory · Computer Science 2017-09-28 Ehsan Miandji , Mohammad Emadi , Jonas Unger , Ehsan Afshari

In this study, we examine a clustering problem in which the covariates of each individual element in a dataset are associated with an uncertainty specific to that element. More specifically, we consider a clustering approach in which a…

Methodology · Statistics 2022-04-19 Akifumi Okuno , Kohei Hattori