English
Related papers

Related papers: Near-Optimal Performance Bounds for Orthogonal and…

200 papers

This paper presents a new approach to the recovery of a spectrally sparse signal (SSS) from partially observed entries, focusing on challenges posed by large-scale data and heavy noise environments. The SSS reconstruction can be formulated…

Signal Processing · Electrical Eng. & Systems 2024-05-14 Xi Yao , Wei Dai

The mutual intensity and its equivalent phase-space representations quantify an optical field's state of coherence and are important tools in the study of light propagation and dynamics, but they can only be estimated indirectly from…

Optics · Physics 2017-11-16 Chenglong Bao , George Barbastathis , Hui Ji , Zuowei Shen , Zhengyun Zhang

In this paper, we present a unified and general framework for analyzing the batch updating approach to nonlinear, high-dimensional optimization. The framework encompasses all the currently used batch updating approaches, and is applicable…

Optimization and Control · Mathematics 2023-01-30 Tadipatri Uday Kiran Reddy , M. Vidyasagar

We adapt the quasi-monotone method from [2] for composite convex minimization in the stochastic setting. For the proposed numerical scheme we derive the optimal convergence rate in terms of the last iterate, rather than on average as it is…

Optimization and Control · Mathematics 2021-07-09 Vyacheslav Kungurtsev , Vladimir Shikhman

Spectral clustering is a novel clustering method which can detect complex shapes of data clusters. However, it requires the eigen decomposition of the graph Laplacian matrix, which is proportion to $O(n^3)$ and thus is not suitable for…

Machine Learning · Computer Science 2013-07-02 Nguyen Lu Dang Khoa , Sanjay Chawla

We revisit the theoretical performances of Spectral Clustering, a classical algorithm for graph partitioning that relies on the eigenvectors of a matrix representation of the graph. Informally, we show that Spectral Clustering works well as…

Machine Learning · Computer Science 2025-12-01 George Tyler , Luca Zanetti

Audio source separation is often achieved by estimating the magnitude spectrogram of each source, and then applying a phase recovery (or spectrogram inversion) algorithm to retrieve time-domain signals. Typically, spectrogram inversion is…

Sound · Computer Science 2023-07-03 Paul Magron , Tuomas Virtanen

Gradient descent algorithms perform well in convex optimization but can get tied for finding local minima in non-convex optimization. A robust method that combines a spectral approach with nonmonotone line search strategy for solving…

Optimization and Control · Mathematics 2025-01-07 Oday Hazaimah

We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden…

Statistics Theory · Mathematics 2014-12-31 Jing Lei , Alessandro Rinaldo

Hyperspectral images provide much more information than conventional imaging techniques, allowing a precise identification of the materials in the observed scene, but because of the limited spatial resolution, the observations are usually…

Image and Video Processing · Electrical Eng. & Systems 2019-03-29 Lucas Drumetz , Travis R. Meyer , Jocelyn Chanussot , Andrea L. Bertozzi , Christian Jutten

Even without auxiliary images, single hyperspectral image super-resolution (SHSR) methods can be designed to improve the spatial resolution of hyperspectral images. However, failing to explore coherence thoroughly along bands and…

Image and Video Processing · Electrical Eng. & Systems 2025-06-25 Xufei Wang , Mingjian Zhang , Fei Ge , Jinchen Zhu , Wen Sha , Jifen Ren , Zhimeng Hou , Shouguo Zheng , ling Zheng , Shizhuang Weng

We introduce an extension of a variationally optimized perturbation method, by combining it with renormalization group properties in a straightforward (perturbative) form. This leads to a very transparent and efficient procedure, with a…

High Energy Physics - Theory · Physics 2014-11-20 J. -L. Kneur , A. Neveu

Line spectral estimation theory aims to estimate the off-the-grid spectral components of a time signal with optimal precision. Recent results have shown that it is possible to recover signals having sparse line spectra from few temporal…

Information Theory · Computer Science 2017-01-31 Maxime Ferreira Da Costa , Wei Dai

We address the non-convex optimisation problem of finding a sparse matrix on the Stiefel manifold (matrices with mutually orthogonal columns of unit length) that maximises (or minimises) a quadratic objective function. Optimisation problems…

Optimization and Control · Mathematics 2021-10-04 Florian Bernard , Daniel Cremers , Johan Thunberg

Spectral clustering is one of the most widely used techniques for extracting the underlying global structure of a data set. Compressed sensing and matrix completion have emerged as prevailing methods for efficiently recovering sparse and…

Numerical Analysis · Mathematics 2010-11-05 Blake Hunter , Thomas Strohmer

We propose a general framework for solving the group synchronization problem, where we focus on the setting of adversarial or uniform corruption and sufficiently small noise. Specifically, we apply a novel message passing procedure that…

Machine Learning · Statistics 2021-07-29 Gilad Lerman , Yunpeng Shi

The identification of sampling sets that enable unique signal recovery is fundamental to many applications in signal processing and remains a central problem in mathematical analysis. Recent studies in the mathematical literature,…

Classical Analysis and ODEs · Mathematics 2025-12-16 Oleg Szehr

We consider the problem of estimating a consensus community structure by combining information from multiple layers of a multi-layer network using methods based on the spectral clustering or a low-rank matrix factorization. As a general…

Machine Learning · Statistics 2018-12-04 Subhadeep Paul , Yuguo Chen

Perturbative renormalization group theory is developed as a unified tool for global asymptotic analysis. With numerous examples, we illustrate its application to ordinary differential equation problems involving multiple scales, boundary…

High Energy Physics - Theory · Physics 2008-11-26 Lin-Yuan Chen , Nigel Goldenfeld , Y. Oono

Orthogonal matching pursuit (OMP) is a widely used algorithm for recovering sparse high dimensional vectors in linear regression models. The optimal performance of OMP requires \textit{a priori} knowledge of either the sparsity of…

Machine Learning · Statistics 2018-06-05 Sreejith Kallummil , Sheetal Kalyani