English
Related papers

Related papers: Hotelling Deflation on Large Symmetric Spiked Tens…

200 papers

In Compressed Sensing, a real-valued sparse vector has to be estimated from an underdetermined system of linear equations. In many applications, however, the elements of the sparse vector are drawn from a finite set. For the estimation of…

Information Theory · Computer Science 2016-08-24 Susanne Sparrer , Robert F. H. Fischer

We use tools from random matrix theory to study the multi-spiked tensor model, i.e., a rank-$r$ deformation of a symmetric random Gaussian tensor. In particular, thanks to the nature of local optimization methods used to find the maximum…

Statistics Theory · Mathematics 2025-03-06 Yang Qi , Alexis Decurninge

In this paper, we study the power iteration algorithm for the spiked tensor model, as introduced in [44]. We give necessary and sufficient conditions for the convergence of the power iteration algorithm. When the power iteration algorithm…

Statistics Theory · Mathematics 2020-12-29 Jiaoyang Huang , Daniel Z. Huang , Qing Yang , Guang Cheng

This paper studies the computational and statistical aspects of quantile and pseudo-Huber tensor decomposition. The integrated investigation of computational and statistical issues of robust tensor decomposition poses challenges due to the…

Statistics Theory · Mathematics 2023-09-07 Yinan Shen , Dong Xia

We consider the problem of estimating multiple principal components using the recently-proposed Sparse and Functional Principal Components Analysis (SFPCA) estimator. We first propose an extension of SFPCA which estimates several principal…

Machine Learning · Statistics 2020-12-10 Michael Weylandt

In this note, we consider the highly nonconvex optimization problem associated with computing the rank decomposition of symmetric tensors. We formulate the invariance properties of the loss function and show that critical points detected by…

Optimization and Control · Mathematics 2023-12-29 Yossi Arjevani , Joan Bruna , Michael Field , Joe Kileel , Matthew Trager , Francis Williams

CANDECOMP/PARAFAC (CPD) approximates multiway data by sum of rank-1 tensors. Our recent study has presented a method to rank-1 tensor deflation, i.e. sequential extraction of the rank-1 components. In this paper, we extend the method to…

Numerical Analysis · Computer Science 2015-06-17 Anh-Huy Phan , Petr Tichavsky , Andrzej Cichocki

In this paper, we consider the problem of distributed parameter estimation in sensor networks. Each sensor makes successive observations of an unknown $d$-dimensional parameter, which might be subject to Gaussian random noises. The sensors…

Signal Processing · Electrical Eng. & Systems 2025-01-20 Jiaqi Yan , Hideaki Ishii

In many practical situations, the useful signal is contained in a low-dimensional subspace, drown in noise and interference. Many questions related to the estimation and detection of the useful signal arise. Because of their particular…

Statistics Theory · Mathematics 2014-05-20 Damien Passemier , Abla Kammoun , Mérouane Debbah

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

We study a discrete-in-time data-assimilation algorithm based on nudging through a time-delayed feedback control in which the observational measurements have been contaminated by a Gaussian noise process. In the context of the…

Analysis of PDEs · Mathematics 2023-09-08 Emine Celik , Eric Olson

We study symmetric spiked matrix models with respect to a general class of noise distributions. Given a rank-1 deformation of a random noise matrix, whose entries are independently distributed with zero mean and unit variance, the goal is…

Data Structures and Algorithms · Computer Science 2022-02-22 Jingqiu Ding , Samuel B. Hopkins , David Steurer

We consider the problem of estimating a rank-one perturbation of a Wigner matrix in a setting of low signal-to-noise ratio. This serves as a simple model for principal component analysis in high dimensions. The mutual information per…

Information Theory · Computer Science 2018-09-25 Ahmed El Alaoui , Florent Krzakala

In this paper, we study the problem of a batch of linearly correlated image alignment, where the observed images are deformed by some unknown domain transformations, and corrupted by additive Gaussian noise and sparse noise simultaneously.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Sijia Xia , Duo Qiu , Xiongjun Zhang

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

Tensor-ring decomposition of tensors plays a key role in various applications of tensor network representation in physics as well as in other fields. In most heuristic algorithms for the tensor-ring decomposition, one encounters the problem…

Computational Physics · Physics 2020-04-15 Hyun-Yong Lee , Naoki Kawashima

In this paper we examine a symmetric tensor decomposition problem, the Gramian decomposition, posed as a rank minimization problem. We study the relaxation of the problem and consider cases when the relaxed solution is a solution to the…

Optimization and Control · Mathematics 2017-08-10 Erik Skau , Agnes Szanto

In this paper we generalize the technique of deflation to define two new methods to systematically find many local minima of a nonlinear least squares problem. The methods are based on the Gauss-Newton algorithm, and as such do not require…

Numerical Analysis · Mathematics 2025-06-13 Alban Bloor Riley , Marcus Webb , Michael L Baker

We study the problem of estimating a rank one signal matrix from an observed matrix generated by corrupting the signal with additive rotationally invariant noise. We develop a new class of approximate message-passing algorithms for this…

Statistics Theory · Mathematics 2025-09-09 Rishabh Dudeja , Songbin Liu , Junjie Ma

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang