English
Related papers

Related papers: Tensor estimation with structured priors

200 papers

We study the problem of sparse tensor principal component analysis: given a tensor $\pmb Y = \pmb W + \lambda x^{\otimes p}$ with $\pmb W \in \otimes^p\mathbb{R}^n$ having i.i.d. Gaussian entries, the goal is to recover the $k$-sparse unit…

Machine Learning · Computer Science 2021-11-03 Davin Choo , Tommaso d'Orsi

We study the recovery of multiple high-dimensional signals from two noisy, correlated modalities: a spiked matrix and a spiked tensor sharing a common low-rank structure. This setting generalizes classical spiked matrix and tensor models,…

Machine Learning · Statistics 2025-06-04 Hugo Tabanelli , Pierre Mergny , Lenka Zdeborova , Florent Krzakala

We consider the nonconvex optimization problem associated with the decomposition of a real symmetric tensor into a sum of rank-one terms. Use is made of the rich symmetry structure to construct infinite families of critical points…

Optimization and Control · Mathematics 2025-08-07 Yossi Arjevani , Gal Vinograd

This paper studies the traffic state estimation (TSE) problem using sparse observations from mobile sensors. Most existing TSE methods either rely on well-defined physical traffic flow models or require large amounts of simulation data as…

Machine Learning · Computer Science 2022-06-15 Xudong Wang , Yuankai Wu , Dingyi Zhuang , Lijun Sun

We consider the following signal recovery problem: given a measurement matrix $\Phi\in \mathbb{R}^{n\times p}$ and a noisy observation vector $c\in \mathbb{R}^{n}$ constructed from $c = \Phi\theta^* + \epsilon$ where $\epsilon\in…

Machine Learning · Statistics 2013-07-23 Ji Liu , Lei Yuan , Jieping Ye

The sequential analysis of the problem of joint signal detection and signal-to-noise ratio (SNR) estimation for a linear Gaussian observation model is considered. The problem is posed as an optimization setup where the goal is to minimize…

Information Theory · Computer Science 2017-01-20 M. Fauß , K. G. Nagananda , A. M. Zoubir , H. V. Poor

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

In this paper, we propose a general framework for sparse and low-rank tensor estimation from cubic sketchings. A two-stage non-convex implementation is developed based on sparse tensor decomposition and thresholded gradient descent, which…

Statistics Theory · Mathematics 2020-03-17 Botao Hao , Anru Zhang , Guang Cheng

In this paper, we study the problem of signal estimation from noisy non-linear measurements when the unknown $n$-dimensional signal is in the range of an $L$-Lipschitz continuous generative model with bounded $k$-dimensional inputs. We make…

Machine Learning · Statistics 2020-10-09 Zhaoqiang Liu , Jonathan Scarlett

We introduce a new tensor norm, the average spectrum norm, to study sample complexity of tensor completion problems based on the canonical polyadic decomposition (CPD). Properties of the average spectrum norm and its dual norm are…

Information Theory · Computer Science 2024-06-19 Oscar López , Richard Lehoucq , Carlos Llosa-Vite , Arvind Prasadan , Daniel M. Dunlavy

Currently, the noise level of color images is estimated by many algorithms through separate selection of each page of the third-order tensor using sliding blocks of size ${M_1} \times {M_1}$. The data structure of the tensor is disrupted by…

Optimization and Control · Mathematics 2025-07-29 Hanxin Liu , Yisheng Song

Tensor-valued data benefits greatly from dimension reduction as the reduction in size is exponential in the number of modes. To achieve maximal reduction without loss in information, our objective in this work is to give an automated…

Methodology · Statistics 2022-07-22 Una Radojicic , Niko Lietzen , Klaus Nordhausen , Joni Virta

This chapter discusses the importance of incorporating three-dimensional symmetries in the context of statistical learning models geared towards the interpolation of the tensorial properties of atomic-scale structures. We focus on Gaussian…

Chemical Physics · Physics 2019-04-04 Andrea Grisafi , David M. Wilkins , Michael J. Willatt , Michele Ceriotti

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

We investigate the performance of a Bayesian statistician tasked with recovering a rank-\(k\) signal matrix \(\bS \bS^{\top} \in \mathbb{R}^{n \times n}\), corrupted by element-wise additive Gaussian noise. This problem lies at the core of…

Information Theory · Computer Science 2025-07-17 Panpan Niu , Yuhao Liu , Teng Fu , Jie Fan , Chaowen Deng , Zhongyi Huang

Tensor completion is a natural higher-order generalization of matrix completion where the goal is to recover a low-rank tensor from sparse observations of its entries. Existing algorithms are either heuristic without provable guarantees,…

Data Structures and Algorithms · Computer Science 2023-07-14 Allen Liu , Ankur Moitra

A classical problem that arises in numerous signal processing applications asks for the reconstruction of an unknown, $k$-sparse signal $x_0\in R^n$ from underdetermined, noisy, linear measurements $y=Ax_0+z\in R^m$. One standard approach…

Statistics Theory · Mathematics 2015-02-18 Christos Thrampoulidis , Ashkan Panahi , Daniel Guo , Babak Hassibi

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

Compressed sensing is a signal processing scheme that reconstructs high-dimensional sparse signals from a limited number of observations. In recent years, various problems involving signals with a finite number of discrete values have been…

Statistical Mechanics · Physics 2024-08-20 Mikiya Doi , Masayuki Ohzeki