English
Related papers

Related papers: An algorithmic regularity lemma for $L_p$ regular …

200 papers

The classical sparse parameter identification methods are usually based on the iterative basis selection such as greedy algorithms, or the numerical optimization of regularized cost functions such as LASSO and Bayesian posterior probability…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Yanxin Fu , Wenxiao Zhao

The joint sparse recovery problem is a generalization of the single measurement vector problem which is widely studied in Compressed Sensing and it aims to recovery a set of jointly sparse vectors. i.e. have nonzero entries concentrated at…

Information Theory · Computer Science 2017-01-10 Changlong Wang , Jigen Peng

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

In this paper we present a rare combination of abstract results on the spectral properties of slanted matrices and some of their very specific applications to frame theory and sampling problems. We show that for a large class of slanted…

Functional Analysis · Mathematics 2007-05-31 A. Aldroubi , A. Baskakov , I. Krishtal

This paper investigates regularity properties of two non-negative sparsity sets: non-negative sparse vectors, and low-rank positive semi-definite matrices. Novel formulae for their Mordukhovich normal cones are given and used to formulate…

Optimization and Control · Mathematics 2018-05-28 Matthew K. Tam

The \(L_1/L_2\) norm ratio has gained significant attention as a measure of sparsity due to three merits: sharper approximation to the \(L_0\) norm compared to the \(L_1\) norm, being parameter-free and scale-invariant, and exceptional…

Optimization and Control · Mathematics 2024-11-14 Min Tao , Xiao-Ping Zhang , Yun-Bin Zhao

Many of today's problems require techniques that involve the solution of arbitrarily large systems $A\mathbf{x}=\mathbf{b}$. A popular numerical approach is the so-called Greedy Rank-One Update Algorithm, based on a particular tensor…

Numerical Analysis · Mathematics 2022-09-07 J. A. Conejero , A. Falcó , M. Mora-Jiménez

We study algorithms for the Schatten-$p$ Low Rank Approximation (LRA) problem. First, we show that by using fast rectangular matrix multiplication algorithms and different block sizes, we can improve the running time of the algorithms in…

Data Structures and Algorithms · Computer Science 2024-07-17 Praneeth Kacham , David P. Woodruff

We derive estimates for the largest and smallest singular values of sparse rectangular $N\times n$ random matrices, assuming $\lim_{N,n\to\infty}\frac nN=y\in(0,1)$. We consider a model with sparsity parameter $p_N$ such that $Np_N\sim…

Probability · Mathematics 2022-11-29 F. Götze , A. Tikhomirov

The sparsity in levels model recently inspired a new generation of effective acquisition and reconstruction modalities for compressive imaging. Moreover, it naturally arises in various areas of signal processing such as parallel…

Information Theory · Computer Science 2021-07-07 Ben Adcock , Simone Brugiapaglia , Matthew King-Roskamp

Many latent-variable applications, including community detection, collaborative filtering, genomic analysis, and NLP, model data as generated by low-rank matrices. Yet despite considerable research, except for very special cases, the number…

Machine Learning · Computer Science 2020-10-02 Ayush Jain , Alon Orlitsky

We consider a regularization problem whose objective function consists of a convex fidelity term and a regularization term determined by the $\ell_1$ norm composed with a linear transform. Empirical results show that the regularization with…

Numerical Analysis · Mathematics 2023-01-18 Qianru Liu , Rui Wang , Yuesheng Xu , Mingsong Yan

We consider the statistics of the extreme eigenvalues of sparse random matrices, a class of random matrices that includes the normalized adjacency matrices of the Erd{\H o}s-R{\'e}nyi graph $G(N,p)$. Recently, it was shown by Lee, up to an…

Probability · Mathematics 2023-05-05 Jiaoyang Huang , Horng-Tzer Yau

Szemeredi's Regularity Lemma is a very useful tool of extremal combinatorics. Recently, several refinements of this seminal result were obtained for special, more structured classes of graphs. We survey these results in their rich…

Combinatorics · Mathematics 2020-03-31 Yiting Jiang , Jaroslav Nesetril , Patrice Ossona de Mendez , Sebastian Siebertz

In prior work, Gupta et al. (SPAA 2022) presented a distributed algorithm for multiplying sparse $n \times n$ matrices, using $n$ computers. They assumed that the input matrices are uniformly sparse--there are at most $d$ non-zeros in each…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Chetan Gupta , Janne H. Korhonen , Jan Studený , Jukka Suomela , Hossein Vahidi

In this paper, we fully resolve the question of whether the Regularity problem for the parabolic PDE $-\partial_tu + \mbox{div}(A\nabla u)=0$ on a Lipschitz cylinder $\mathcal O\times\mathbb R$ is solvable for some $p\in (1,\infty)$ under…

Analysis of PDEs · Mathematics 2026-04-28 Martin Dindoš , Linhan Li , Jill Pipher

The low-rank matrix recovery (LMR) is a rank minimization problem subject to linear equality constraints, and it arises in many fields such as signal and image processing, statistics, computer vision, system identification and control. This…

Information Theory · Computer Science 2011-06-17 Lingchen Kong , Levent Tunçel , Naihua Xiu

Matrix regularity is a key to various problems in applied mathematics. The sufficient conditions, used for checking regularity of interval parametric matrices, usually fail in case of large parameter intervals. We present necessary and…

Numerical Analysis · Mathematics 2021-06-29 Evgenija D. Popova

We present and analyze a simple, two-step algorithm to approximate the optimal solution of the sparse PCA problem. Our approach first solves a L1 penalized version of the NP-hard sparse PCA optimization problem and then uses a randomized…

Data Structures and Algorithms · Computer Science 2016-11-24 Kimon Fountoulakis , Abhisek Kundu , Eugenia-Maria Kontopoulou , Petros Drineas

Recently there has been much interest in "sparsifying" sums of rank one matrices: modifying the coefficients such that only a few are nonzero, while approximately preserving the matrix that results from the sum. Results of this sort have…

Discrete Mathematics · Computer Science 2018-01-30 Marcel K. de Carli Silva , Nicholas J. A. Harvey , Cristiane M. Sato