English
Related papers

Related papers: Exact Minimax Optimality of Spectral Methods in Ph…

200 papers

To estimate accurate voltage phasors from inaccurate voltage magnitude and complex power measurements, the standard approach is to iteratively refine a good initial guess using the Gauss--Newton method. But the nonconvexity of the…

Optimization and Control · Mathematics 2025-04-01 Iven Guzel , Richard Y. Zhang

In this work, we propose an adaptive spectral element algorithm for solving nonlinear optimal control problems. The method employs orthogonal collocation at the shifted Gegenbauer-Gauss points combined with very accurate and stable…

Optimization and Control · Mathematics 2023-03-06 Kareem T. Elgindy

We show that asymptotically, completely asynchronous stochastic gradient procedures achieve optimal (even to constant factors) convergence rates for the solution of convex optimization problems under nearly the same conditions required for…

Optimization and Control · Mathematics 2015-08-05 John C. Duchi , Sorathan Chaturapruek , Christopher Ré

We study the problem of exact community recovery in general, two-community block models, in the presence of node-attributed $side$ $information$. We allow for a very general side information channel for node attributes, and for pairwise…

Social and Information Networks · Computer Science 2025-03-11 Julia Gaudio , Nirmit Joshi

We study the phase synchronization problem with measurements $Y=z^*z^{*H}+\sigma W\in\mathbb{C}^{n\times n}$, where $z^*$ is an $n$-dimensional complex unit-modulus vector and $W$ is a complex-valued Gaussian random matrix. It is assumed…

Statistics Theory · Mathematics 2021-01-08 Chao Gao , Anderson Y. Zhang

The two-step spectral clustering method, which consists of the Laplacian eigenmap and a rounding step, is a widely used method for graph partitioning. It can be seen as a natural relaxation to the NP-hard minimum ratio cut problem. In this…

Machine Learning · Statistics 2020-07-14 March Boedihardjo , Shaofeng Deng , Thomas Strohmer

Expectation Maximization (EM) algorithm is a parameter estimation method from incomplete observations. In this paper, an implementation of this method to the calibration of HKS spectrometer at Jefferson Lab is described. We show that the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Lulin Yuan

In this paper, we develop a novel framework to optimally design spectral estimators for phase retrieval given measurements realized from an arbitrary model. We begin by deconstructing spectral methods, and identify the fundamental…

Signal Processing · Electrical Eng. & Systems 2020-12-14 Bariscan Yonel , Birsen Yazici

Gradient descent algorithms perform well in convex optimization but can get tied for finding local minima in non-convex optimization. A robust method that combines a spectral approach with nonmonotone line search strategy for solving…

Optimization and Control · Mathematics 2025-01-07 Oday Hazaimah

Spectral methods provide an elegant and efficient way of numerically solving differential equations of all kinds. For smooth problems, truncation error for spectral methods vanishes exponentially in the infinity norm and $L_2$-norm.…

Numerical Analysis · Computer Science 2019-10-09 Joanna Piotrowska , Jonah M. Miller , Erik Schnetter

We consider the problem of estimating a consensus community structure by combining information from multiple layers of a multi-layer network using methods based on the spectral clustering or a low-rank matrix factorization. As a general…

Machine Learning · Statistics 2018-12-04 Subhadeep Paul , Yuguo Chen

We derive, similar to Lau and Riha, a matrix formulation of a general best approximation theorem of Singer for the special case of spectral approximations of a given matrix from a given subspace. Using our matrix formulation we describe the…

Numerical Analysis · Mathematics 2025-06-12 Vance Faber , Jörg Liesen , Petr Tichý

We demonstrate an application of the spectral method as a numerical approximation for solving Hyperbolic PDEs. In this method a finite basis is used for approximating the solutions. In particular, we demonstrate a set of such solutions for…

Mathematical Physics · Physics 2008-11-26 P. Pedram , M. Mirzaei , S. S. Gousheh

Inspired by the quantum computing algorithms for Linear Algebra problems [HHL,TaShma] we study how the simulation on a classical computer of this type of "Phase Estimation algorithms" performs when we apply it to solve the Eigen-Problem of…

Data Structures and Algorithms · Computer Science 2017-04-07 Michael Ben-Or , Lior Eldar

Spectral methods have emerged as a simple yet surprisingly effective approach for extracting information from massive, noisy and incomplete data. In a nutshell, spectral methods refer to a collection of algorithms built upon the eigenvalues…

Machine Learning · Statistics 2021-10-26 Yuxin Chen , Yuejie Chi , Jianqing Fan , Cong Ma

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

This paper establishes a nearly optimal algorithm for estimating the frequencies and amplitudes of a mixture of sinusoids from noisy equispaced samples. We derive our algorithm by viewing line spectral estimation as a sparse recovery…

Information Theory · Computer Science 2013-04-02 Gongguo Tang , Badri Narayan Bhaskar , Benjamin Recht

The synchronization problem over the special orthogonal group $SO(d)$ consists of estimating a set of unknown rotations $R_1,R_2,...,R_n$ from noisy measurements of a subset of their pairwise ratios $R_{i}^{-1}R_{j}$. The problem has found…

Information Theory · Computer Science 2013-07-17 Lanhui Wang , Amit Singer

In this paper we analyze a simple spectral method (EIG1) for the problem of matrix alignment, consisting in aligning their leading eigenvectors: given two matrices $A$ and $B$, we compute $v_1$ and $v'_1$ two corresponding leading…

Probability · Mathematics 2024-09-06 Luca Ganassali , Marc Lelarge , Laurent Massoulié

Spectral methods have myriad applications in high-dimensional statistics and data science, and while previous works have primarily focused on $\ell_2$ or $\ell_{2,\infty}$ eigenvector and singular vector perturbation theory, in many…

Statistics Theory · Mathematics 2026-05-11 Joshua Agterberg