English
Related papers

Related papers: The Generalized Lasso for Sub-gaussian Measurement…

200 papers

Deep learning image reconstruction algorithms often suffer from model mismatches when the acquisition scheme differs significantly from the forward model used during training. We introduce a Generalized Stein's Unbiased Risk Estimate…

Machine Learning · Computer Science 2022-01-02 Hemant Kumar Aggarwal , Mathews Jacob

In many applications we seek to recover signals from linear measurements far fewer than the ambient dimension, given the signals have exploitable structures such as sparse vectors or low rank matrices. In this paper we work in a general…

Information Theory · Computer Science 2023-11-14 Xuemei Chen

Compressed sensing (CS) is a signal acquisition paradigm to simultaneously acquire and reduce dimension of signals that admit sparse representations. When such a signal is acquired according to the principles of CS, the measurements still…

Information Theory · Computer Science 2019-11-19 Arman Arian , Ozgur Yilmaz

A theoretical analysis, aimed at characterizing the degradation induced by the resampling and requantization processes applied to band-limited Gaussian signals with flat power spectrum, available through their digitized samples, is…

Information Theory · Computer Science 2009-08-19 Marco Lanucara , Riccardo Borghi

Divergence measures play a central role and become increasingly essential in deep learning, yet efficient measures for multiple (more than two) distributions are rarely explored. This becomes particularly crucial in areas where the…

Machine Learning · Computer Science 2024-06-07 Mingfei Lu , Chenxu Li , Shujian Yu , Robert Jenssen , Badong Chen

Quantizing weights and activations of deep neural networks results in significant improvement in inference efficiency at the cost of lower accuracy. A source of the accuracy gap between full precision and quantized models is the…

Machine Learning · Computer Science 2020-06-16 Hadi Pouransari , Zhucheng Tu , Oncel Tuzel

We consider the problem of robustifying high-dimensional structured estimation. Robust techniques are key in real-world applications which often involve outliers and data corruption. We focus on trimmed versions of structurally regularized…

Machine Learning · Statistics 2017-08-22 Eunho Yang , Aurelie Lozano , Aleksandr Aravkin

A host of problems involve the recovery of structured signals from a dimensionality reduced representation such as a random projection; examples include sparse signals (compressive sensing) and low-rank matrices (matrix completion). Given…

Information Theory · Computer Science 2012-05-22 Shirin Jalali , Arian Maleki , Richard Baraniuk

De-biased lasso has emerged as a popular tool to draw statistical inference for high-dimensional regression models. However, simulations indicate that for generalized linear models (GLMs), de-biased lasso inadequately removes biases and…

Methodology · Statistics 2020-06-24 Lu Xia , Bin Nan , Yi Li

We have developed an approximate signal recovery algorithm with low computational cost for compressed sensing on the basis of randomly constructed sparse measurement matrices. The law of large numbers and the central limit theorem suggest…

Information Theory · Computer Science 2011-02-21 Yoshiyuki Kabashima , Tadashi Wadayama

In this paper, quantizer design for weak-signal detection under arbitrary binary channel in generalized Gaussian noise is studied. Since the performances of the generalized likelihood ratio test (GLRT) and Rao test are asymptotically…

Signal Processing · Electrical Eng. & Systems 2018-05-09 Guanyu Wang , Jiang Zhu , Zhiwei Xu

This paper proposes Quantizable DNNs, a special type of DNNs that can flexibly quantize its bit-width (denoted as `bit modes' thereafter) during execution without further re-training. To simultaneously optimize for all bit modes, a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Kunyuan Du , Ya Zhang , Haibing Guan

Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled measurements, thereby reducing scan time. Recently, deep learning has shown great potential for reconstructing high-fidelity images from highly…

Image and Video Processing · Electrical Eng. & Systems 2025-04-07 Armeet Singh Jatyani , Jiayun Wang , Aditi Chandrashekar , Zihui Wu , Miguel Liu-Schiaffini , Bahareh Tolooshams , Anima Anandkumar

Given an unknown signal $\mathbf{x}_0\in\mathbb{R}^n$ and linear noisy measurements $\mathbf{y}=\mathbf{A}\mathbf{x}_0+\sigma\mathbf{v}\in\mathbb{R}^m$, the generalized $\ell_2^2$-LASSO solves…

Statistics Theory · Mathematics 2015-02-24 Christos Thrampoulidis , Ashkan Panahi , Babak Hassibi

In 1-bit compressed sensing, the aim is to estimate a $k$-sparse unit vector $x\in S^{n-1}$ within an $\epsilon$ error (in $\ell_2$) from minimal number of linear measurements that are quantized to just their signs, i.e., from measurements…

Information Theory · Computer Science 2023-10-13 Namiko Matsumoto , Arya Mazumdar

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

Statistics Theory · Mathematics 2019-09-12 Martin Genzel , Gitta Kutyniok

The goal of standard 1-bit compressive sensing is to accurately recover an unknown sparse vector from binary-valued measurements, each indicating the sign of a linear function of the vector. Motivated by recent advances in compressive…

Machine Learning · Statistics 2020-06-23 Zhaoqiang Liu , Selwyn Gomes , Avtansh Tiwari , Jonathan Scarlett

The Convex Gaussian Min-Max Theorem (CGMT) has emerged as a prominent theoretical tool for analyzing the precise stochastic behavior of various statistical estimators in the so-called high dimensional proportional regime, where the sample…

Statistics Theory · Mathematics 2022-06-28 Qiyang Han , Yandi Shen

Fundamental machine learning theory shows that different samples contribute unequally both in learning and testing processes. Contemporary studies on DNN imply that such sample difference is rooted on the distribution of intrinsic pattern…

Machine Learning · Computer Science 2021-08-19 Chi Zhang , Xiaoning Ma , Yu Liu , Le Wang , Yuanqi Su , Yuehu Liu

Group-Lasso (gLasso) identifies important explanatory factors in predicting the response variable by considering the grouping structure over input variables. However, most existing algorithms for gLasso are not scalable to deal with…

Machine Learning · Computer Science 2016-12-08 Binghong Chen , Jun Zhu
‹ Prev 1 8 9 10 Next ›