English
Related papers

Related papers: On Pseudospectral Concentration for Rank-1 Samplin…

200 papers

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We introduce a random matrix framework for studying statistical-mechanical lattice systems through spectral observables. Equilibrium configurations sampled from a Boltzmann measure are mapped to matrix ensembles whose covariance structure…

Disordered Systems and Neural Networks · Physics 2026-05-21 Yaprak Önder , Abbas Ali Saberi , Roderich Moessner

We revisit the theoretical performances of Spectral Clustering, a classical algorithm for graph partitioning that relies on the eigenvectors of a matrix representation of the graph. Informally, we show that Spectral Clustering works well as…

Machine Learning · Computer Science 2025-12-01 George Tyler , Luca Zanetti

Trained attention layers exhibit striking and reproducible spectral structure of the weights, including low-rank collapse, bulk deformation, and isolated spectral outliers, yet the origin of these phenomena and their implications for…

Matrix sensing is a problem in signal processing and machine learning that involves recovering a low-rank matrix from a set of linear measurements. The goal is to reconstruct the original matrix as accurately as possible, given only a set…

Information Theory · Computer Science 2023-03-14 Yichuan Deng , Zhihang Li , Zhao Song

Tensor-based methods have recently emerged as a more natural and effective formulation to address many problems in hyperspectral imaging. In hyperspectral unmixing (HU), low-rank constraints on the abundance maps have been shown to act as a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 Tales Imbiriba , Ricardo Augusto Borsoi , José Carlos Moreira Bermudez

Spectral compressed sensing involves reconstructing a spectral-sparse signal from a subset of uniformly spaced samples, with applications in radar imaging and wireless channel estimation. By fully exploiting the signal structures, this…

Optimization and Control · Mathematics 2025-11-25 Wenlong Wang , Wen Huang , Zai Yang

Statistical inference and information processing of high-dimensional data often require efficient and accurate estimation of their second-order statistics. With rapidly changing data, limited processing power and storage at the acquisition…

Information Theory · Computer Science 2015-03-23 Yuxin Chen , Yuejie Chi , Andrea Goldsmith

This paper develops a unified analytical framework for determinant identities under finite-rank perturbations of square matrices that remains valid without invertibility assumptions. In contrast to classical inverse-based formulations, the…

Optimization and Control · Mathematics 2026-04-07 Robert Vrabel

Random contractions (sub-unitary random matrices) appear naturally when considering quantized chaotic maps within a general theory of open linear stationary systems with discrete time. We analyze statistical properties of complex…

Chaotic Dynamics · Physics 2009-10-31 Yan V. Fyodorov , H. -J. Sommmers

In this paper we develop and apply methods for the spectral analysis of non-self-adjoint tridiagonal infinite and finite random matrices, and for the spectral analysis of analogous deterministic matrices which are pseudo-ergodic in the…

Spectral Theory · Mathematics 2013-05-14 Simon N. Chandler-Wilde , Ratchanikorn Chonchaiya , Marko Lindner

Sparse regression methods have been proven effective in a wide range of signal processing problems such as image compression, speech coding, channel equalization, linear regression and classification. In this paper a new convex method of…

Optimization and Control · Mathematics 2018-03-07 Victor Stefan Aldea

We study random submatrices of a large matrix A. We show how to approximately compute A from its random submatrix of the smallest possible size O(r log r) with a small error in the spectral norm, where r = ||A||_F^2 / ||A||_2^2 is the…

Functional Analysis · Mathematics 2016-12-23 Mark Rudelson , Roman Vershynin

To conduct a more in-depth investigation of randomized solvers for solving linear systems, we adopt a unified randomized batch-sampling Kaczmarz framework with per-iteration costs as low as cyclic block methods, and develop a general…

Numerical Analysis · Mathematics 2026-04-21 Dong-Yue Xie , Xi Yang

Motivated by a need to characterize transient behaviors in large network systems in terms of relevant signal norms and worst-case input scenarios, we propose a novel approach based on existing theory for matrix pseudospectra. We extend…

Optimization and Control · Mathematics 2022-10-18 Jonas Hansson , Emma Tegling

Modern technologies are producing a wealth of data with complex structures. For instance, in two-dimensional digital imaging, flow cytometry, and electroencephalography, matrix type covariates frequently arise when measurements are obtained…

Methodology · Statistics 2013-10-22 Hua Zhou , Lexin Li

We study the hierarchy of communities in real-world networks under a generic stochastic block model, in which the connection probabilities are structured in a binary tree. Under such model, a standard recursive bi-partitioning algorithm is…

Statistics Theory · Mathematics 2021-11-19 Lihua Lei , Xiaodong Li , Xingmei Lou

We analyze statistical properties of complex eigenvalues of random matrices $\hat{A}$ close to unitary. Such matrices appear naturally when considering quantized chaotic maps within a general theory of open linear stationary systems with…

Chaotic Dynamics · Physics 2009-10-31 Yan V. Fyodorov

Manifold regularization is a commonly used technique in semi-supervised learning. It enforces the classification rule to be smooth with respect to the data-manifold. Here, we derive sample complexity bounds based on pseudo-dimension for…

Machine Learning · Computer Science 2020-07-31 Alexander Mey , Tom Viering , Marco Loog

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu