中文
相关论文

相关论文: Sparse random tensors: Concentration, regularizati…

200 篇论文

Spectral hypergraph sparsification, an attempt to extend well-known spectral graph sparsification to hypergraphs, has been extensively studied over the past few years. For undirected hypergraphs, Kapralov, Krauthgamer, Tardos, and…

数据结构与算法 · 计算机科学 2023-05-12 Kazusato Oko , Shinsaku Sakaue , Shin-ichi Tanigawa

We study the limiting spectral distribution of large-dimensional sample covariance matrices associated with symmetric random tensors formed by $\binom{n}{d}$ different products of $d$ variables chosen from $n$ independent standardized…

概率论 · 数学 2021-11-09 Pavel Yaskov

We present a concentration result concerning random weighted projections in high dimensional spaces. As applications, we prove (1) New concentration inequalities for random quadratic forms; (2) The infinity norm of most unit eigenvectors of…

概率论 · 数学 2014-08-19 Van Vu , Ke Wang

We obtain estimates for the Kolmogorov distance to appropriately chosen gaussians, of linear functions \[ \sum_{i\in [n]^d} \theta_i X_i \] of random tensors $\boldsymbol{X}=\langle X_i:i\in [n]^d\rangle$ which are symmetric and…

概率论 · 数学 2023-09-12 Pandelis Dodos , Konstantinos Tyros

In this paper, we investigate the theoretical guarantees of penalized $\lun$ minimization (also called Basis Pursuit Denoising or Lasso) in terms of sparsity pattern recovery (support and sign consistency) from noisy measurements with…

信息论 · 计算机科学 2011-09-13 Charles Dossal , Marie-Line Chabanol , Gabriel Peyré , Jalal Fadili

The convergence rates results in $\ell^1$-regularization when the sparsity assumption is narrowly missed, presented by Burger et al. (2013 Inverse Problems 29 025013), are based on a crucial condition which requires that all basis elements…

数值分析 · 数学 2015-08-05 Stephan W. Anzengruber , Bernd Hofmann , Ronny Ramlau

Many regression and classification procedures fit a parameterized function $f(x;w)$ of predictor variables $x$ to data $\{x_{i},y_{i}\}_1^N$ based on some loss criterion $L(y,f)$. Often, regularization is applied to improve accuracy by…

机器学习 · 计算机科学 2021-07-16 Gilmer Valdes , Wilmer Arbelo , Yannet Interian , Jerome H. Friedman

We give lower bounds for the problem of stable sparse recovery from /adaptive/ linear measurements. In this problem, one would like to estimate a vector $x \in \R^n$ from $m$ linear measurements $A_1x,..., A_mx$. One may choose each vector…

数据结构与算法 · 计算机科学 2012-10-23 Eric Price , David P. Woodruff

We discuss applications of some concepts of Compressed Sensing in the recent work on invertibility of random matrices due to Rudelson and the author. We sketch an argument leading to the optimal bound N^{-1/2} on the median of the smallest…

数值分析 · 数学 2016-12-23 Roman Vershynin

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

机器学习 · 计算机科学 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

We present an incremental, scalable and efficient dimension reduction technique for tensors that is based on sparse random linear coding. Data is stored in a compactified representation with fixed size, which makes memory requirements low…

数据结构与算法 · 计算机科学 2017-03-16 Fredrik Sandin , Blerim Emruli , Magnus Sahlgren

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

信息论 · 计算机科学 2015-03-13 V. Saligrama , M. Zhao

Simultaneous perturbation stochastic approximation (SPSA) has proven to be efficient for recursive optimization. SPSA uses a centered difference approximation to the gradient based on two function evaluations regardless of the dimension of…

统计方法学 · 统计学 2014-05-06 Xumeng Cao

We consider two theorems from the theory of compressive sensing. Mainly a theorem concerning uniform recovery of random sampling matrices, where the number of samples needed in order to recover an $s$-sparse signal from linear measurements…

信息论 · 计算机科学 2013-06-05 Joel Andersson , Jan-Olov Strömberg

Let $A_n$ be an $n\times n$ matrix with iid entries distributed as Bernoulli random variables with parameter $p = p_n$. Rudelson and Tikhomirov, in a beautiful and celebrated paper, show that the distribution of eigenvalues of $A_n \cdot…

概率论 · 数学 2025-01-09 Ashwin Sah , Julian Sahasrabudhe , Mehtaab Sawhney

We study the information-theoretic limits of exactly recovering the support of a sparse signal using noisy projections defined by various classes of measurement matrices. Our analysis is high-dimensional in nature, in which the number of…

统计理论 · 数学 2008-06-04 Wei Wang , Martin J. Wainwright , Kannan Ramchandran

We study a class of non-convex and non-smooth problems with \textit{rank} regularization to promote sparsity in optimal solution. We propose to apply the proximal gradient descent method to solve the problem and accelerate the process with…

最优化与控制 · 数学 2023-07-28 Mengyuan Zhang , Kai Liu

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

机器学习 · 统计学 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Let $P(n,m)$ be a graph chosen uniformly at random from the class of all planar graphs on vertex set $\left\{1, \ldots, n\right\}$ with $m=m(n)$ edges. We show that in the sparse regime, when $\limsup_{n \to \infty} m/n<1$, with high…

组合数学 · 数学 2020-10-29 Mihyun Kang , Michael Missethan

Tensors are often compressed by expressing them in low rank tensor formats. In this paper, we develop three methodologies that bound the compressibility of a tensor: (1) Algebraic structure, (2) Smoothness, and (3) Displacement structure.…

数值分析 · 数学 2020-02-04 Tianyi Shi , Alex Townsend