中文
相关论文

相关论文: Computing one-bit compressive sensing via zero-nor…

200 篇论文

We study the problem of jointly sparse support recovery with 1-bit compressive measurements in a sensor network. Sensors are assumed to observe sparse signals having the same but unknown sparse support. Each sensor quantizes its measurement…

信息论 · 计算机科学 2015-06-02 Vipul Gupta , Bhavya Kailkhura , Thakshila Wimalajeewa , Pramod K. Varshney

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

机器学习 · 统计学 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

We introduce a recursive algorithm for performing compressed sensing on streaming data. The approach consists of a) recursive encoding, where we sample the input stream via overlapping windowing and make use of the previous measurement in…

机器学习 · 统计学 2013-12-18 Nikolaos M. Freris , Orhan Öçal , Martin Vetterli

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

统计理论 · 数学 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

We present a unified theorem for the convergence analysis of stochastic gradient algorithms for minimizing a smooth and convex loss plus a convex regularizer. We do this by extending the unified analysis of Gorbunov, Hanzely \& Richt\'arik…

机器学习 · 计算机科学 2020-06-23 Ahmed Khaled , Othmane Sebbouh , Nicolas Loizou , Robert M. Gower , Peter Richtárik

Compressed sensing (CS) is a promising tool for reducing sampling costs. Current deep neural network (NN)-based CS methods face the challenges of collecting labeled measurement-ground truth (GT) data and generalizing to real applications.…

信号处理 · 电气工程与系统科学 2024-08-15 Bin Chen , Xuanyu Zhang , Shuai Liu , Yongbing Zhang , Jian Zhang

Lossy gradient compression, with either unbiased or biased compressors, has become a key tool to avoid the communication bottleneck in centrally coordinated distributed training of machine learning models. We analyze the performance of two…

机器学习 · 计算机科学 2020-12-23 Sebastian U. Stich

Difference-of-convex (DC) optimization problems are shown to be equivalent to the minimization of a Lipschitz-differentiable "envelope". A gradient method on this surrogate function yields a novel (sub)gradient-free proximal algorithm which…

最优化与控制 · 数学 2024-04-17 Andreas Themelis , Ben Hermans , Panagiotis Patrinos

In this paper we are interested in the solution of Compressed Sensing (CS) problems where the signals to be recovered are sparse in coherent and redundant dictionaries. CS problems of this type are convex with non-smooth and non-separable…

最优化与控制 · 数学 2014-06-02 Ioannis Dassios , Kimon Fountoulakis , Jacek Gondzio

We study the use of very sparse random projections for compressed sensing (sparse signal recovery) when the signal entries can be either positive or negative. In our setting, the entries of a Gaussian design matrix are randomly sparsified…

统计方法学 · 统计学 2014-08-12 Ping Li , Cun-Hui Zhang

Recent studies have demonstrated that gradient matching-based dataset synthesis, or dataset condensation (DC), methods can achieve state-of-the-art performance when applied to data-efficient learning tasks. However, in this study, we prove…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Saehyung Lee , Sanghyuk Chun , Sangwon Jung , Sangdoo Yun , Sungroh Yoon

This paper studies a compressed momentum-based single-point zeroth-order algorithm for stochastic distributed nonconvex optimization, aiming to alleviate communication overhead and address the unavailability of explicit gradient…

最优化与控制 · 数学 2026-05-12 Linjing Chen , Antai Xie , Xinlei Yi , Xiaoqiang Ren , Xiaofan Wang

This letter proposes a dictionary learning algorithm for blind one bit compressed sensing. In the blind one bit compressed sensing framework, the original signal to be reconstructed from one bit linear random measurements is sparse in an…

机器学习 · 统计学 2016-01-20 Hadi Zayyani , Mehdi Korki , Farrokh Marvasti

The abundant spatial and angular information from light fields has allowed the development of multiple disparity estimation approaches. However, the acquisition of light fields requires high storage and processing cost, limiting the use of…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Emmanuel Martinez , Edwin Vargas , Henry Arguello

We present optimal sample complexity estimates for one-bit compressed sensing problems in a realistic scenario: the procedure uses a structured matrix (a randomly sub-sampled circulant matrix) and is robust to analog pre-quantization noise…

信息论 · 计算机科学 2018-12-18 Sjoerd Dirksen , Shahar Mendelson

We propose a novel deformation corrected compressed sensing (DC-CS) framework to recover dynamic magnetic resonance images from undersampled measurements. We introduce a generalized formulation that is capable of handling a wide class of…

计算机视觉与模式识别 · 计算机科学 2014-09-04 Sajan Goud Lingala , Edward DiBella , Mathews Jacob

Can compression algorithms be employed for recovering signals from their underdetermined set of linear measurements? Addressing this question is the first step towards applying compression algorithms for compressed sensing (CS). In this…

信息论 · 计算机科学 2013-07-11 Shirin Jalali , Arian Maleki

We present a smooth probabilistic reformulation of $\ell_0$ regularized regression that does not require Monte Carlo sampling and allows for the computation of exact gradients, facilitating rapid convergence to local optima of the best…

机器学习 · 计算机科学 2025-09-19 Lukas Silvester Barth , Paulo von Petersenn

Accurate signal recovery or image reconstruction from indirect and possibly undersampled data is a topic of considerable interest; for example, the literature in the recent field of compressed sensing is already quite immense. Inspired by…

最优化与控制 · 数学 2011-04-15 Stephen Becker , Jerome Bobin , Emmanuel Candes

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

最优化与控制 · 数学 2020-07-15 Jineng Ren , Jarvis Haupt