中文
相关论文

相关论文: Sparse random tensors: Concentration, regularizati…

200 篇论文

We derive Concentration of Measure (CoM) inequalities for randomized Toeplitz matrices. These inequalities show that the norm of a high-dimensional signal mapped by a Toeplitz matrix to a low-dimensional space concentrates around its mean…

信息论 · 计算机科学 2016-11-17 Borhan M. Sanandaji , Tyrone L. Vincent , Michael B. Wakin

This paper tackles the problem of recovering a low-rank signal tensor with possibly correlated components from a random noisy tensor, or so-called spiked tensor model. When the underlying components are orthogonal, they can be recovered…

机器学习 · 统计学 2023-03-20 Mohamed El Amine Seddik , Mohammed Mahfoud , Merouane Debbah

We initiate the study of trade-offs between sparsity and the number of measurements in sparse recovery schemes for generic norms. Specifically, for a norm $\|\cdot\|$, sparsity parameter $k$, approximation factor $K>0$, and probability of…

数据结构与算法 · 计算机科学 2015-04-07 Arturs Backurs , Piotr Indyk , Eric Price , Ilya Razenshteyn , David P. Woodruff

Given the compressed sensing measurements of an unknown vector $z \in \mathbb{R}^n$ using random matrices, we present a simple method to determine $z$ without solving any optimization problem or linear system. Our method uses $\Theta(\log…

信息论 · 计算机科学 2026-01-19 Man Ting Wong , Siu-Wing Cheng

Let $A$ be an $n\times n$ matrix with iid entries where $A_{ij} \sim \mathrm{Ber}(p)$ is a Bernoulli random variable with parameter $p = d/n$. We show that the empirical measure of the eigenvalues converges, in probability, to a…

概率论 · 数学 2025-07-02 Ashwin Sah , Julian Sahasrabudhe , Mehtaab Sawhney

We provide O(1) asymptotics for the average number of deep minima of the (p,k) spiked tensor model. We also derive an explicit formula for the limiting ground state energy on the N-dimensional sphere, similar to the work of…

概率论 · 数学 2022-04-20 Antonio Auffinger , Gerard Ben Arous , Zhehua Li

The task of compressed sensing is to recover a sparse vector from a small number of linear and non-adaptive measurements, and the problem of finding a suitable measurement matrix is very important in this field. While most recent works…

信息论 · 计算机科学 2012-12-18 Yi-Zheng Fan , Tao Huang , Ming Zhu

We develop machinery to design efficiently computable and consistent estimators, achieving estimation error approaching zero as the number of observations grows, when facing an oblivious adversary that may corrupt responses in all but an…

机器学习 · 计算机科学 2021-11-05 Tommaso d'Orsi , Chih-Hung Liu , Rajai Nasser , Gleb Novikov , David Steurer , Stefan Tiegel

Tensor ring (TR) decomposition is a simple but effective tensor network for analyzing and interpreting latent patterns of tensors. In this work, we propose a doubly randomized optimization framework for computing TR decomposition. It can be…

数值分析 · 数学 2023-03-30 Yajie Yu , Hanyu Li , Jingchun Zhou

The theory of Compressed Sensing, the emerging sampling paradigm 'that goes against the common wisdom', asserts that 'one can recover signals in Rn from far fewer samples or measurements, if the signal has a sparse representation in some…

信息论 · 计算机科学 2013-11-01 Ankit Kundu , Pradosh K. Roy

In this paper we derive information theoretic performance bounds to sensing and reconstruction of sparse phenomena from noisy projections. We consider two settings: output noise models where the noise enters after the projection and input…

信息论 · 计算机科学 2011-12-22 Shuchin Aeron , Venkatesh Saligrama , Manqi Zhao

This work introduces an asymptotic study of Hotelling-type tensor deflation in the presence of noise, in the regime of large tensor dimensions. Specifically, we consider a low-rank asymmetric tensor model of the form $\sum_{i=1}^r…

In compressed sensing, in order to recover a sparse or nearly sparse vector from possibly noisy measurements, the most popular approach is $\ell_1$-norm minimization. Upper bounds for the $\ell_2$- norm of the error between the true and…

机器学习 · 统计学 2015-12-31 M. Eren Ahsen , M. Vidyasagar

We present results on the concentration properties of the spectral norm $\|A_p\|$ of the adjacency matrix $A_p$ of an Erd\H{o}s-R\'enyi random graph $G(n,p)$. First we consider the Erd\H{o}s-R\'enyi random graph process and prove that…

概率论 · 数学 2018-11-21 Gábor Lugosi , Shahar Mendelson , Nikita Zhivotovskiy

Abstract. The purpose of this paper is twofold. We introduce the theory of random tensors, which naturally extends the method of random averaging operators in our earlier work arXiv:1910.08492, to study the propagation of randomness under…

偏微分方程分析 · 数学 2020-06-17 Yu Deng , Andrea R. Nahmod , Haitian Yue

Graph sparsification has been studied extensively over the past two decades, culminating in spectral sparsifiers of optimal size (up to constant factors). Spectral hypergraph sparsification is a natural analogue of this problem, for which…

数据结构与算法 · 计算机科学 2021-06-07 Michael Kapralov , Robert Krauthgamer , Jakab Tardos , Yuichi Yoshida

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

机器学习 · 统计学 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

We give oracle inequalities on procedures which combines quantization and variable selection via a weighted Lasso $k$-means type algorithm. The results are derived for a general family of weights, which can be tuned to size the influence of…

统计理论 · 数学 2016-07-07 Clément Levrard

Sparse binary matrices are of great interest in the field of sparse recovery, nonnegative compressed sensing, statistics in networks, and theoretical computer science. This class of matrices makes it possible to perform signal recovery with…

信息论 · 计算机科学 2024-12-09 Pedro Abdalla

The $\ell_{1\text{-}2}$ regularization method has a strong sparsity promoting capability in approaching sparse solutions of linear inverse problems and gained successful applications in various mathematics and applied science fields. This…

最优化与控制 · 数学 2026-03-04 Yaohua Hu , Hao Wang , Xiaoqi Yang