English
Related papers

Related papers: Structured Matrix Recovery via the Generalized Dan…

200 papers

We prove an asymptotic normality guarantee for generalized low-rank matrix sensing -- i.e., matrix sensing under a general convex loss $\bar\ell(\langle X,M\rangle,y^*)$, where $M\in\mathbb{R}^{d\times d}$ is the unknown rank-$k$ matrix,…

Machine Learning · Statistics 2025-02-14 Osbert Bastani

In this paper, we propose a generalized expectation consistent signal recovery algorithm to estimate the signal $\mathbf{x}$ from the nonlinear measurements of a linear transform output $\mathbf{z}=\mathbf{A}\mathbf{x}$. This estimation…

Information Theory · Computer Science 2017-05-15 Hengtao He , Chao-Kai Wen , Shi Jin

Concave regularization methods provide natural procedures for sparse recovery. However, they are difficult to analyze in the high dimensional setting. Only recently a few sparse recovery results have been established for some specific local…

Machine Learning · Statistics 2012-02-14 Cun-Hui Zhang , Tong Zhang

Learning operators between infinitely dimensional spaces is an important learning task arising in wide applications in machine learning, imaging science, mathematical modeling and simulations, etc. This paper studies the nonparametric…

Machine Learning · Statistics 2022-01-04 Hao Liu , Haizhao Yang , Minshuo Chen , Tuo Zhao , Wenjing Liao

Analyzing large samples of high-dimensional data under dependence is a challenging statistical problem as long time series may have change points, most importantly in the mean and the marginal covariances, for which one needs valid tests.…

Methodology · Statistics 2022-11-07 Fabian Mies , Ansgar Steland

Matrix sensing has many real-world applications in science and engineering, such as system control, distance embedding, and computer vision. The goal of matrix sensing is to recover a matrix $A_\star \in \mathbb{R}^{n \times n}$, based on a…

Data Structures and Algorithms · Computer Science 2023-03-23 Lianke Qin , Zhao Song , Ruizhe Zhang

One goal of geometric measure theory is to understand how measures in the plane or higher dimensional Euclidean space interact with families of lower dimensional sets. An important dichotomy arises between the class of rectifiable measures,…

Classical Analysis and ODEs · Mathematics 2020-07-21 Matthew Badger

There has recently been renewed recognition of the need to understand the consistency properties that must be preserved when a generalized matrix inverse is required. The most widely known generalized inverse, the Moore-Penrose…

Numerical Analysis · Computer Science 2018-08-03 Jeffrey Uhlmann

We consider the problem of recovering an unknown low-rank matrix X with (possibly) non-orthogonal, effectively sparse rank-1 decomposition from measurements y gathered in a linear measurement process A. We propose a variational formulation…

Information Theory · Computer Science 2023-06-13 Johannes Maly

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

In many applications one may acquire a composition of several signals that may be corrupted by noise, and it is a challenging problem to reliably separate the components from one another without sacrificing significant details. Adding to…

Numerical Analysis · Mathematics 2015-01-21 Ashley Prater , Lixin Shen

Continuing the analysis in a unified scheme for treating generalized superselection sectors based upon the notion of selection criteria for states of relevance in quantum physics, we extend the Doplicher-Roberts superselection theory for…

Mathematical Physics · Physics 2007-05-23 I. Ojima

In this paper, we study the problem of matrix recovery, which aims to restore a target matrix of authentic samples from grossly corrupted observations. Most of the existing methods, such as the well-known Robust Principal Component Analysis…

Computer Vision and Pattern Recognition · Computer Science 2018-11-12 Xingyu Xie , Jianlong Wu , Guangcan Liu , Jun Wang

In this paper, we introduce structured sparsity estimators in Generalized Linear Models. Structured sparsity estimators in the least squares loss are introduced by Stucky and van de Geer (2018) recently for fixed design and normal errors.…

Machine Learning · Statistics 2021-04-30 Mehmet Caner

This paper considers the problem of robustly estimating a structured covariance matrix with an elliptical underlying distribution with known mean. In applications where the covariance matrix naturally possesses a certain structure, taking…

Applications · Statistics 2016-06-29 Ying Sun , Prabhu Babu , Daniel P. Palomar

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

We take a geometrical viewpoint and present a unifying view on supervised deep learning with the Bregman divergence loss function - this entails frequent classification and prediction tasks. Motivated by simulations we suggest that there is…

Machine Learning · Computer Science 2021-07-07 Petr Taborsky , Lars Kai Hansen

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural

We propose a robust and efficient approach to the problem of compressive phase retrieval in which the goal is to reconstruct a sparse vector from the magnitude of a number of its linear measurements. The proposed framework relies on…

Information Theory · Computer Science 2015-10-28 Sohail Bahmani , Justin Romberg

This paper considers reconstructing a spectrally sparse signal from a small number of randomly observed time-domain samples. The signal of interest is a linear combination of complex sinusoids at $R$ distinct frequencies. The frequencies…

Information Theory · Computer Science 2015-07-15 Jian-Feng Cai , Suhui Liu , Weiyu Xu