English
Related papers

Related papers: Near-Optimal Performance Bounds for Orthogonal and…

200 papers

A greedy pursuit strategy which finds a common basis for approximating a set of similar signals is proposed. The strategy extends the Optimized Orthogonal Matching Pursuit approach to selecting the subspace containing the approximation of…

Signal Processing · Electrical Eng. & Systems 2025-03-24 Laura Rebollo-Neira

Spectral clustering refers to a family of unsupervised learning algorithms that compute a spectral embedding of the original data based on the eigenvectors of a similarity graph. This non-linear transformation of the data is both the key of…

Machine Learning · Computer Science 2019-01-30 Nicolas Tremblay , Andreas Loukas

Spectral clustering is one of the most popular clustering methods. However, the high computational cost due to the involved eigen-decomposition procedure can immediately hinder its applications in large-scale tasks. In this paper we use…

Machine Learning · Computer Science 2023-01-24 Yongyu Wang

In this work we study the fundamental limits of approximate recovery in the context of group testing. One of the most well-known, theoretically optimal, and easy to implement testing procedures is the non-adaptive Bernoulli group testing…

Statistics Theory · Mathematics 2021-07-30 Fotis Iliopoulos , Ilias Zadik

In this paper we analyze a simple spectral method (EIG1) for the problem of matrix alignment, consisting in aligning their leading eigenvectors: given two matrices $A$ and $B$, we compute $v_1$ and $v'_1$ two corresponding leading…

Probability · Mathematics 2024-09-06 Luca Ganassali , Marc Lelarge , Laurent Massoulié

We consider the phase retrieval problem, in which the observer wishes to recover a $n$-dimensional real or complex signal $\mathbf{X}^\star$ from the (possibly noisy) observation of $|\mathbf{\Phi} \mathbf{X}^\star|$, in which…

Information Theory · Computer Science 2022-10-03 Antoine Maillard , Florent Krzakala , Yue M. Lu , Lenka Zdeborová

The simultaneous orthogonal matching pursuit (SOMP) is a popular, greedy approach for common support recovery of a row-sparse matrix. However, compared to the noiseless scenario, the performance analysis of noisy SOMP is still nascent,…

Information Theory · Computer Science 2023-12-01 Wei Zhang , Taejoon Kim

In this article we study the problem of signal recovery for group models. More precisely for a given set of groups, each containing a small subset of indices, and for given linear sketches of the true signal vector which is known to be…

Optimization and Control · Mathematics 2020-02-28 Bubacarr Bah , Jannis Kurtz , Oliver Schaudt

This work addresses approximate nearest neighbor search applied in the domain of large-scale image retrieval. Within the group testing framework we propose an efficient off-line construction of the search structures. The linear-time…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Ahmet Iscen , Ondrej Chum

In this paper, we study a generalized finite element method for solving second-order elliptic partial differential equations with rough coefficients. The method uses local approximation spaces computed by solving eigenvalue problems on…

Numerical Analysis · Mathematics 2025-07-17 Christian Alber , Peter Bastian , Moritz Hauck , Robert Scheichl

Synchronization is an important dynamical phenomenon in coupled nonlinear systems, which has been studied extensively in recent years. However, analysis focused on individual orbits seems hard to extend to complex systems while a global…

Chaotic Dynamics · Physics 2021-01-04 Jing Hu , Yueheng Lan

An adaptive algorithm for spectral proper orthogonal decomposition (SPOD) of mixed broadband-tonal turbulent flows is developed. Sharp peak resolution at tonal frequencies is achieved by locally minimizing the bias of the spectrum. Smooth…

Fluid Dynamics · Physics 2024-06-25 Brandon C. Y. Yeung , Oliver T. Schmidt

In a mixed generalized linear model, the goal is to learn multiple signals from unlabeled observations: each sample comes from exactly one signal, but it is not known which one. We consider the prototypical problem of estimating two…

Statistics Theory · Mathematics 2026-01-12 Yihan Zhang , Marco Mondelli , Ramji Venkataramanan

The renormalization group (RG) method is one of the singular perturbation methods which is used in search for asymptotic behavior of solutions of differential equations. In this article, time-independent vector fields and time (almost)…

Dynamical Systems · Mathematics 2015-05-14 Hayato Chiba

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

Spectral methods are widely used in geometry processing of 3D models. They rely on the projection of the mesh geometry on the basis defined by the eigenvectors of the graph Laplacian operator, becoming computationally prohibitive as the…

Signal Processing · Electrical Eng. & Systems 2018-10-08 Gerasimos Arvanitis , Aris S. Lalos , Konstantinos Moustakas

Muon orthogonalizes the momentum buffer before each update, replacing its singular values with ones via Newton-Schulz iterations. This simple change lets Muon tolerate far larger learning rates and converge faster than other optimizers, but…

Machine Learning · Computer Science 2026-05-14 Tien-Phat Nguyen , Truong Nguyen , Minh-Phuc Truong , Tuc Nguyen , James Bailey , Trung Le

We apply the functional renormalization group method to the calculation of dynamical properties of zero-dimensional interacting quantum systems. As case studies we discuss the anharmonic oscillator and the single impurity Anderson model. We…

Strongly Correlated Electrons · Physics 2009-11-10 R. Hedden , V. Meden , Th. Pruschke , K. Schoenhammer

In this work, we propose an adaptive spectral element algorithm for solving nonlinear optimal control problems. The method employs orthogonal collocation at the shifted Gegenbauer-Gauss points combined with very accurate and stable…

Optimization and Control · Mathematics 2023-03-06 Kareem T. Elgindy

Spectral estimators are fundamental in lowrank matrix models and arise throughout machine learning and statistics, with applications including network analysis, matrix completion and PCA. These estimators aim to recover the leading…

Statistics Theory · Mathematics 2025-02-17 Hao Yan , Keith Levin