English
Related papers

Related papers: NBIHT: An Efficient Algorithm for 1-bit Compressed…

200 papers

In this letter, a binary sparse Bayesian learning (BSBL) algorithm is proposed to slove the one-bit compressed sensing (CS) problem in both single measurement vector (SMV) and multiple measurement vectors (MMVs). By utilising the…

Information Theory · Computer Science 2018-05-09 Jiang Zhu , Lin Han , Xiangming Meng , Zhiwei Xu

The JPEG algorithm is a defacto standard for image compression. We investigate whether adaptive mesh refinement can be used to optimize the compression ratio and propose a new adaptive image compression algorithm. We prove that it produces…

Numerical Analysis · Mathematics 2023-04-05 Michael Feischl , Hubert Hackl

We explore the impact of coarse quantization on matrix completion in the extreme scenario of dithered one-bit sensing, where the matrix entries are compared with time-varying threshold levels. In particular, instead of observing a subset of…

Information Theory · Computer Science 2024-02-16 Arian Eamaz , Farhang Yeganegi , Mojtaba Soltanalian

In this paper, we propose a density estimation algorithm called \textit{Gradient Boosting Histogram Transform} (GBHT), where we adopt the \textit{Negative Log Likelihood} as the loss function to make the boosting procedure available for the…

Machine Learning · Statistics 2021-06-11 Jingyi Cui , Hanyuan Hang , Yisen Wang , Zhouchen Lin

Sparse optimization receives increasing attention in many applications such as compressed sensing, variable selection in regression problems, and recently neural network compression in machine learning. For example, the problem of…

Optimization and Control · Mathematics 2022-09-29 Saeed Damadi , Jinglai Shen

We study the robust one-bit compressed sensing problem whose goal is to design an algorithm that faithfully recovers any sparse target vector $\theta_0\in\mathbb{R}^d$ \textit{uniformly} via $m$ quantized noisy measurements. Specifically,…

Statistics Theory · Mathematics 2020-08-25 Shuang Qiu , Xiaohan Wei , Zhuoran Yang

We investigate a class of constrained sparse regression problem with cardinality penalty, where the feasible set is defined by box constraint, and the loss function is convex, but not necessarily smooth. First, we put forward a smoothing…

Optimization and Control · Mathematics 2021-04-28 Fan Wu , Wei Bian , Xiaoping Xue

The goal of standard 1-bit compressive sensing is to accurately recover an unknown sparse vector from binary-valued measurements, each indicating the sign of a linear function of the vector. Motivated by recent advances in compressive…

Machine Learning · Statistics 2020-06-23 Zhaoqiang Liu , Selwyn Gomes , Avtansh Tiwari , Jonathan Scarlett

Compressed sensing is a promising technique that attempts to faithfully recover sparse signal with as few linear and nonadaptive measurements as possible. Its performance is largely determined by the characteristic of sensing matrix.…

Information Theory · Computer Science 2013-10-03 Weizhi Lu , Weiyu Li , Kidiyo Kpalma , Joseph Ronsin

Is it possible to obliviously construct a set of hyperplanes H such that you can approximate a unit vector x when you are given the side on which the vector lies with respect to every h in H? In the sparse recovery literature, where x is…

Information Theory · Computer Science 2019-01-15 Vasileios Nakos

We consider the problem of noisy 1-bit matrix completion under an exact rank constraint on the true underlying matrix $M^*$. Instead of observing a subset of the noisy continuous-valued entries of a matrix $M^*$, we observe a subset of…

Machine Learning · Statistics 2015-02-25 Sonia Bhaskar , Adel Javanmard

One-bit compressive sensing gains its popularity in signal processing and communications due to its low storage costs and low hardware complexity. However, it has been a challenging task to recover the signal only by exploiting the one-bit…

Optimization and Control · Mathematics 2022-04-20 Shenglong Zhou , Ziyan Luo , Naihua Xiu , Geoffrey Ye Li

In this article we study the problem of signal recovery for group models. More precisely for a given set of groups, each containing a small subset of indices, and for given linear sketches of the true signal vector which is known to be…

Optimization and Control · Mathematics 2020-02-28 Bubacarr Bah , Jannis Kurtz , Oliver Schaudt

Quadratic regression involves modeling the response as a (generalized) linear function of not only the features $x^{j_1}$ but also of quadratic terms $x^{j_1}x^{j_2}$. The inclusion of such higher-order "interaction terms" in regression…

Machine Learning · Computer Science 2019-11-11 Shuo Yang , Yanyao Shen , Sujay Sanghavi

Compressed sensing is a signal processing method that acquires data directly in a compressed form. This allows one to make less measurements than what was considered necessary to record a signal, enabling faster or more precise measurement…

Statistical Mechanics · Physics 2012-08-20 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

Thresholding based iterative algorithms have the trade-off between effectiveness and optimality. Some are effective but involving sub-matrix inversions in every step of iterations. For systems of large sizes, such algorithms can be…

Information Theory · Computer Science 2017-11-08 Zhanjie Song , Shidong Li , Ningning Han

Sparse signals can be possibly reconstructed by an algorithm which merges a traditional nonlinear optimization method and a certain thresholding technique. Different from existing thresholding methods, a novel thresholding technique…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Nan Meng , Yun-Bin Zhao

A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many…

Information Theory · Computer Science 2010-04-13 Jeffrey D. Blanchard , Coralia Cartis , Jared Tanner , Andrew Thompson

In this paper, we present the first structural binarization method for LLM compression to less than 1-bit precision. Although LLMs have achieved remarkable performance, their memory-bound nature during the inference stage hinders the…

Machine Learning · Computer Science 2024-10-10 Peijie Dong , Lujun Li , Yuedong Zhong , Dayou Du , Ruibo Fan , Yuhan Chen , Zhenheng Tang , Qiang Wang , Wei Xue , Yike Guo , Xiaowen Chu

An accelerated class of adaptive scheme of iterative thresholding algorithms is studied analytically and empirically. They are based on the feedback mechanism of the null space tuning techniques (NST+HT+FB). The main contribution of this…

Information Theory · Computer Science 2020-05-15 Ningning Han , Shidong Li , Zhanjie Song
‹ Prev 1 3 4 5 6 7 10 Next ›