中文
相关论文

相关论文: Complete Dictionary Recovery over the Sphere

200 篇论文

Randomly initialized first-order optimization algorithms are the method of choice for solving many high-dimensional nonconvex problems in machine learning, yet general theoretical guarantees cannot rule out convergence to critical points of…

最优化与控制 · 数学 2018-09-28 Dar Gilboa , Sam Buchanan , John Wright

In this paper we show how to recover a spectral approximations to broad classes of structured matrices using only a polylogarithmic number of adaptive linear measurements to either the matrix or its inverse. Leveraging this result we obtain…

数据结构与算法 · 计算机科学 2018-12-18 Arun Jambulapati , Kirankumar Shiragur , Aaron Sidford

We consider a structured estimation problem where an observed matrix is assumed to be generated as an $s$-sparse linear combination of $N$ given $n\times n$ positive-semidefinite matrices. Recovering the unknown $N$-dimensional and…

信息论 · 计算机科学 2020-03-27 Fabian Jaensch , Peter Jung

Blind deconvolution is the problem of recovering a convolutional kernel $\boldsymbol a_0$ and an activation signal $\boldsymbol x_0$ from their convolution $\boldsymbol y = \boldsymbol a_0 \circledast \boldsymbol x_0$. This problem is…

计算机视觉与模式识别 · 计算机科学 2019-01-08 Yuqian Zhang , Yenson Lau , Han-Wen Kuo , Sky Cheung , Abhay Pasupathy , John Wright

The problem of signal recovery from the autocorrelation, or equivalently, the magnitudes of the Fourier transform, is of paramount importance in various fields of engineering. In this work, for one-dimensional signals, we give conditions,…

信息论 · 计算机科学 2012-06-08 Kishore Jaganathan , Samet Oymak , Babak Hassibi

We consider the problem of recovering signals from their power spectral density. This is a classical problem referred to in literature as the phase retrieval problem, and is of paramount importance in many fields of applied sciences. In…

信息论 · 计算机科学 2013-11-12 Kishore Jaganathan , Samet Oymak , Babak Hassibi

In this paper we continue to develop the following general approach. We study asymptotic behavior of the errors of sampling recovery not for an individual smoothness class, how it is usually done, but for the collection of classes, which…

数值分析 · 数学 2026-01-14 V. Temlyakov

A dictionary is a database of standard vectors, so that other vectors / signals are expressed as linear combinations of dictionary vectors, and the task of learning a dictionary for a given data is to find a good dictionary so that the…

机器学习 · 计算机科学 2020-07-09 Mohammed Rayyan Sheriff , Debasish Chatterjee

Classical results in sparse recovery guarantee the exact reconstruction of $s$-sparse signals under assumptions on the dictionary that are either too strong or NP-hard to check. Moreover, such results may be pessimistic in practice since…

信息论 · 计算机科学 2019-04-04 Mengnan Zhao , M. Devrim Kaba , René Vidal , Daniel P. Robinson , Enrique Mallada

In the dictionary learning (or sparse coding) problem, we are given a collection of signals (vectors in $\mathbb{R}^d$), and the goal is to find a "basis" in which the signals have a sparse (approximate) representation. The problem has…

机器学习 · 计算机科学 2019-05-30 Aditya Bhaskara , Wai Ming Tai

The matrix recovery (completion) problem, a central problem in data science and theoretical computer science, is to recover a matrix $A$ from a relatively small sample of entries. While such a task is impossible in general, it has been…

统计理论 · 数学 2025-03-06 BaoLinh Tran , Van Vu

The most important purpose of this article is to investigate perfect reconstruction underlying range space of operators in finite dimensional Hilbert spaces by matrix methods. To this end, first we obtain more structures of the canonical…

泛函分析 · 数学 2020-08-12 Fahimeh Arabyani Neyshaburi , Rajab Ali Kamyabi-Gol

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

信号处理 · 电气工程与系统科学 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

Given pointwise samples of an unknown function belonging to a certain model set, one seeks in Optimal Recovery to recover this function in a way that minimizes the worst-case error of the recovery procedure. While it is often known that…

数值分析 · 数学 2023-08-01 Simon Foucart

We study the square root bottleneck in the recovery of sparse vectors from quadratic equations. It is acknowledged that a sparse vector $ \mathbf x_0\in \mathbb{R}^n$, $\| \mathbf x_0\|_0 = k$ can in theory be recovered from as few as…

信息论 · 计算机科学 2024-12-30 Augustin Cosse

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of…

In dictionary learning, also known as sparse coding, the algorithm is given samples of the form $y = Ax$ where $x\in \mathbb{R}^m$ is an unknown random sparse vector and $A$ is an unknown dictionary matrix in $\mathbb{R}^{n\times m}$…

数据结构与算法 · 计算机科学 2014-01-06 Sanjeev Arora , Aditya Bhaskara , Rong Ge , Tengyu Ma

This article treats the problem of learning a dictionary providing sparse representations for a given signal class, via $\ell_1$-minimisation. The problem can also be seen as factorising a $\ddim \times \nsig$ matrix $Y=(y_1 >... y_\nsig),…

信息论 · 计算机科学 2010-03-01 Remi Gribonval , Karin Schnass

Given an overcomplete dictionary $A$ and a signal $b = Ac^*$ for some sparse vector $c^*$ whose nonzero entries correspond to linearly independent columns of $A$, classical sparse signal recovery theory considers the problem of whether…

机器学习 · 计算机科学 2020-01-01 Daniel P. Robinson , Rene Vidal , Chong You

We consider the recovery of a continuous domain piecewise constant image from its non-uniform Fourier samples using a convex matrix completion algorithm. We assume the discontinuities/edges of the image are localized to the zero levelset of…

信息论 · 计算机科学 2018-02-14 Greg Ongie , Sampurna Biswas , Mathews Jacob