English
Related papers

Related papers: On block coherence of frames

200 papers

In the worst-case analysis of algorithms, the overall performance of an algorithm is summarized by its worst performance on any input. This approach has countless success stories, but there are also important computational problems --- like…

Data Structures and Algorithms · Computer Science 2018-06-27 Tim Roughgarden

Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems. Theoretical guarantees for Alternating Minimization have been hard to come by and are still…

Machine Learning · Computer Science 2014-05-15 Moritz Hardt

The bound that arises out of sparse recovery analysis in compressed sensing involves input signal sparsity and some property of the sensing matrix. An effort has therefore been made in the literature to optimize sensing matrices for optimal…

Information Theory · Computer Science 2017-07-12 Alankar Kotwal , Ajit Rajwade

Motivated by a neuroscience application we study the problem of statistical estimation of a high-dimensional covariance matrix with a block structure. The block model embeds a structural assumption: the population of items (neurons) can be…

Methodology · Statistics 2025-03-03 Yunran Chen , Surya T Tokdar , Jennifer M Groh

The uniqueness of sparsest solutions of underdetermined linear systems plays a fundamental role in the newly developed compressed sensing theory. Several new algebraic concepts, including the sub-mutual coherence, scaled mutual coherence,…

Numerical Analysis · Mathematics 2012-12-27 Yun-Bin Zhao

Nonconvex optimization is central in solving many machine learning problems, in which block-wise structure is commonly encountered. In this work, we propose cyclic block coordinate methods for nonconvex optimization problems with…

Optimization and Control · Mathematics 2023-01-31 Xufeng Cai , Chaobing Song , Stephen J. Wright , Jelena Diakonikolas

The construction of highly incoherent frames, sequences of vectors placed on the unit hyper sphere of a finite dimensional Hilbert space with low correlation between them, has proven very difficult. Algorithms proposed in the past have…

Information Theory · Computer Science 2016-11-28 Cristian Rusu , Nuria González-Prelcic

The latent block model is used to simultaneously rank the rows and columns of a matrix to reveal a block structure. The algorithms used for estimation are often time consuming. However, recent work shows that the log-likelihood ratios are…

Statistics Theory · Mathematics 2023-03-10 Vincent Brault , Antoine Channarond

In 'An asymptotic result on compressed sensing matrices', a new construction for compressed sensing matrices using combinatorial design theory was introduced. In this paper, we use deterministic and probabilistic methods to analyse the…

Information Theory · Computer Science 2015-05-21 Darryn Bryant , Charles Colbourn , Daniel Horsley , Padraig Ó Catháin

Kronecker compressed sensing refers to using Kronecker product matrices as sparsifying bases and measurement matrices in compressed sensing. This work focuses on the Kronecker compressed sensing problem, encompassing three sparsity…

Signal Processing · Electrical Eng. & Systems 2025-04-11 Yanbin He , Geethu Joseph

In this paper, we study the convergence properties of a randomized block-coordinate descent algorithm for the minimization of a composite convex objective function, where the block-coordinates are updated asynchronously and randomly…

Optimization and Control · Mathematics 2023-04-14 Cheik Traoré , Saverio Salzo , Silvia Villa

In this paper we study a worst case to average case reduction for the problem of matrix multiplication over finite fields. Suppose we have an efficient average case algorithm, that given two random matrices $A,B$ outputs a matrix that has a…

Data Structures and Algorithms · Computer Science 2024-04-15 Ashish Gola , Igor Shinkar , Harsimran Singh

We study the block-coordinate forward-backward algorithm in which the blocks are updated in a random and possibly parallel manner, according to arbitrary probabilities. The algorithm allows different stepsizes along the block-coordinates to…

Optimization and Control · Mathematics 2020-11-30 Saverio Salzo , Silvia Villa

At each iteration of a Block Coordinate Descent method one minimizes an approximation of the objective function with respect to a generally small set of variables subject to constraints in which these variables are involved. The…

Optimization and Control · Mathematics 2023-04-28 E. G. Birgin , J. M. Martínez

How to construct a suitable measurement matrix is still an open question in compressed sensing. A significant part of the recent work is that the measurement matrices are not completely random on the entries but exhibit considerable…

Information Theory · Computer Science 2017-09-08 Tao Huang , Yi-Zheng Fan , Ming Zhu

Recently, sparse subspace clustering has been a valid tool to deal with high-dimensional data. There are two essential steps in the framework of sparse subspace clustering. One is solving the coefficient matrix of data, and the other is…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Wen-Jin Fu , Xiao-Jun Wu , He-Feng Yin , Wen-Bo Hu

Reference [11] investigated the almost sure weak convergence of block-coordinate fixed point algorithms and discussed their applications to nonlinear analysis and optimization. This algorithmic framework features random sweeping rules to…

Optimization and Control · Mathematics 2018-04-17 Patrick L. Combettes , Jean-Christophe Pesquet

This article establishes the performance of stochastic blockmodels in addressing the co-clustering problem of partitioning a binary array into subsets, assuming only that the data are generated by a nonparametric process satisfying the…

Statistics Theory · Mathematics 2014-01-17 David Choi , Patrick J. Wolfe

Recursive blocked algorithms have proven to be highly efficient at the numerical solution of the Sylvester matrix equation and its generalizations. In this work, we show that these algorithms extend in a seamless fashion to…

Numerical Analysis · Mathematics 2019-05-24 Minhong Chen , Daniel Kressner

Covariance matrix plays a central role in multivariate statistical analysis. Significant advances have been made recently on developing both theory and methodology for estimating large covariance matrices. However, a minimax theory has yet…

Statistics Theory · Mathematics 2010-10-20 T. Tony Cai , Cun-Hui Zhang , Harrison H. Zhou