中文
相关论文

相关论文: Robust spectral compressive sensing via vanilla gr…

200 篇论文

A field known as Compressive Sensing (CS) has recently emerged to help address the growing challenges of capturing and processing high-dimensional signals and data sets. CS exploits the surprising fact that the information contained in a…

机器学习 · 统计学 2010-02-08 Michael B. Wakin

This paper develops theoretical results regarding noisy 1-bit compressed sensing and sparse binomial regression. We show that a single convex program gives an accurate estimate of the signal, or coefficient vector, for both of these models.…

信息论 · 计算机科学 2012-07-20 Yaniv Plan , Roman Vershynin

Significant recent work has studied the ability of gradient descent to recover a hidden planted direction $\theta^\star \in S^{d-1}$ in different high-dimensional settings, including tensor PCA and single-index models. The key quantity that…

机器学习 · 计算机科学 2026-03-09 Stanley Wei , Alex Damian , Jason D. Lee

In deep learning it is common to overparameterize neural networks, that is, to use more parameters than training samples. Quite surprisingly training the neural network via (stochastic) gradient descent leads to models that generalize very…

最优化与控制 · 数学 2025-01-30 Hung-Hsu Chou , Johannes Maly , Holger Rauhut

We investigate non-negative least squares (NNLS) for the recovery of sparse non-negative vectors from noisy linear and biased measurements. We build upon recent results from [1] showing that for matrices whose row-span intersects the…

信息论 · 计算机科学 2019-12-30 Yonatan Shadmi , Peter Jung , Giuseppe Caire

We propose a generic framework based on a new stochastic variance-reduced gradient descent algorithm for accelerating nonconvex low-rank matrix recovery. Starting from an appropriate initial estimator, our proposed algorithm performs…

机器学习 · 统计学 2017-01-20 Lingxiao Wang , Xiao Zhang , Quanquan Gu

This paper considers compressed sensing and affine rank minimization in both noiseless and noisy cases and establishes sharp restricted isometry conditions for sparse signal and low-rank matrix recovery. The analysis relies on a key…

信息论 · 计算机科学 2013-10-23 T. Tony Cai , Anru Zhang

The goal of phaseless compressed sensing is to recover an unknown sparse or approximately sparse signal from the magnitude of its measurements. However, it does not take advantage of any support information of the original signal.…

信息论 · 计算机科学 2022-05-18 Haiye Huo

We present a statistical learning framework for robust identification of partial differential equations from noisy spatiotemporal data. Extending previous sparse regression approaches for inferring PDE models from simulated data, we address…

Compressed sensing provided a data-acquisition paradigm for sparse signals. Remarkably, it has been shown that practical algorithms provide robust recovery from noisy linear measurements acquired at a near optimal sampling rate. In many…

信息论 · 计算机科学 2017-08-03 Kiryung Lee , Yanjun Li , Kyong Hwan Jin , Jong Chul Ye

Deep generative models have emerged as a powerful class of priors for signals in various inverse problems such as compressed sensing, phase retrieval and super-resolution. Here, we assume an unknown signal to lie in the range of some…

机器学习 · 统计学 2021-02-26 Thanh V. Nguyen , Gauri Jagatap , Chinmay Hegde

In the problem of learning mixtures of linear regressions, the goal is to learn a collection of signal vectors from a sequence of (possibly noisy) linear measurements, where each measurement is evaluated on an unknown signal drawn uniformly…

机器学习 · 计算机科学 2019-11-01 Akshay Krishnamurthy , Arya Mazumdar , Andrew McGregor , Soumyabrata Pal

The performance of existing approaches to the recovery of frequency-sparse signals from compressed measurements is limited by the coherence of required sparsity dictionaries and the discretization of frequency parameter space. In this…

信息论 · 计算机科学 2014-07-15 Zhenqi Lu , Rendong Ying , Sumxin Jiang , Zenghui Zhang , Peilin Liu , Wenxian Yu

Recently, diffusion models (DMs) have been increasingly used in audio processing tasks, including speech super-resolution (SR), which aims to restore high-frequency content given low-resolution speech utterances. This is commonly achieved…

音频与语音处理 · 电气工程与系统科学 2024-10-22 Chin-Yun Yu , Sung-Lin Yeh , György Fazekas , Hao Tang

Noisy particle gradient descent (NPGD) is an algorithm to minimize convex functions over the space of measures that include an entropy term. In the many-particle limit, this algorithm is described by a Mean-Field Langevin dynamics - a…

最优化与控制 · 数学 2022-08-12 Lénaïc Chizat

Random sinusoidal features are a popular approach for speeding up kernel-based inference in large datasets. Prior to the inference stage, the approach suggests performing dimensionality reduction by first multiplying each data vector by a…

机器学习 · 统计学 2017-07-12 Mohammadreza Soltani , Chinmay Hegde

Natural signals and images are well-known to be approximately sparse in transform domains such as Wavelets and DCT. This property has been heavily exploited in various applications in image processing and medical imaging. Compressed sensing…

机器学习 · 计算机科学 2015-10-26 Saiprasad Ravishankar , Yoram Bresler

Signals sparse in a transformation domain can be recovered from a reduced set of randomly positioned samples by using compressive sensing algorithms. Simple re- construction algorithms are presented in the first part of the paper. The…

信息论 · 计算机科学 2015-12-08 Ljubisa Stankovic , Isidora Stankovic

Motivated by applications in unsourced random access, this paper develops a novel scheme for the problem of compressed sensing of binary signals. In this problem, the goal is to design a sensing matrix $A$ and a recovery algorithm, such…

信息论 · 计算机科学 2021-09-21 Elad Romanov , Or Ordentlich

Differentially private stochastic gradient descent (DP-SGD) is the gold standard for training machine learning models with formal differential privacy guarantees. Several recent extensions improve its accuracy by introducing correlated…

机器学习 · 计算机科学 2026-05-13 Nikita P. Kalinin , Ryan McKenna , Rasmus Pagh , Christoph H. Lampert