English
Related papers

Related papers: Adaptive sensing using deterministic partial Hadam…

200 papers

Hadamard single-pixel imaging (HSI) is an appealing imaging technique due to its features of low hardware complexity and industrial cost. To improve imaging efficiency, many studies have focused on sorting Hadamard patterns to obtain…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Yan Cai , Shijian Li , Wei Zhang , Hao Wu , Xu-ri Yao , Qing Zhao

Recently, we have classified Hermitian random matrix ensembles that are invariant under the conjugate action of the unitary group and stable with respect to matrix addition. Apart from a scaling and a shift, the whole information of such an…

Probability · Mathematics 2023-03-13 Mario Kieburg , Jiyuan Zhang

Kaczmarz's alternating projection method has been widely used for solving a consistent (mostly over-determined) linear system of equations Ax=b. Because of its simple iterative nature with light computation, this method was successfully…

Numerical Analysis · Computer Science 2014-07-22 Tim Wallace , Ali Sekmen

In this paper we show that for the purposes of dimensionality reduction certain class of structured random matrices behave similarly to random Gaussian matrices. This class includes several matrices for which matrix-vector multiply can be…

Information Theory · Computer Science 2015-10-08 Samet Oymak , Benjamin Recht , Mahdi Soltanolkotabi

Probabilistic models with discrete latent variables naturally capture datasets composed of discrete classes. However, they are difficult to train efficiently, since backpropagation through discrete variables is generally not possible. We…

Machine Learning · Statistics 2017-04-25 Jason Tyler Rolfe

A combinatorial approach to compressive sensing based on a deterministic column replacement technique is proposed. Informally, it takes as input a pattern matrix and ingredient measurement matrices, and results in a larger measurement…

Information Theory · Computer Science 2014-03-10 Charles J. Colbourn , Daniel Horsley , Violet R. Syrotiuk

A new recursive construction of $N$-ary error-correcting output code (ECOC) matrices for ensemble classification methods is presented, generalizing the classic doubling construction for binary Hadamard matrices. Given any prime integer $N$,…

Machine Learning · Computer Science 2021-10-06 Hieu D. Nguyen , Lucas J. Lavalva , Shen-Shyang Ho , Mohammed Sarosh Khan , Nicholas Kaegi

We consider the demixing problem of two (or more) high-dimensional vectors from nonlinear observations when the number of such observations is far less than the ambient dimension of the underlying vectors. Specifically, we demonstrate an…

Machine Learning · Statistics 2017-01-25 Mohammadreza Soltani , Chinmay Hegde

Binary deterministic sensing matrices are highly desirable for sampling sparse signals, as they require only a small number of sum-operations to generate the measurement vector. Furthermore, sparse sensing matrices enable the use of…

Signal Processing · Electrical Eng. & Systems 2025-02-20 Mohamad Mahdi Mohades , Hossein Mohades , S. Fatemeh Zamanian

Convergence is a crucial issue in iterative algorithms. Damping is commonly employed to ensure the convergence of iterative algorithms. The conventional ways of damping are scalar-wise, and either heuristic or empirical. Recently, an…

Signal Processing · Electrical Eng. & Systems 2023-11-16 Shunqi Huang , Lei Liu , Brian M. Kurkoski

Current discrete randomness and information conservation inequalities are over total recursive functions, i.e. restricted to deterministic processing. This restriction implies that an algorithm can break algorithmic randomness conservation…

Computational Complexity · Computer Science 2013-10-15 Samuel Epstein

Randomized Hadamard Transforms (RHTs) have emerged as a computationally efficient alternative to the use of dense unstructured random matrices across a range of domains in computer science and machine learning. For several applications such…

Machine Learning · Computer Science 2022-03-04 Yeshwanth Cherapanamjeri , Jelani Nelson

Sampling is a fundamental aspect of any implementation of compressive sensing. Typically, the choice of sampling method is guided by the reconstruction basis. However, this approach can be problematic with respect to certain hardware…

Signal Processing · Electrical Eng. & Systems 2019-06-24 Elin Farnell , Henry Kvinge , John P. Dixon , Julia R. Dupuis , Michael Kirby , Chris Peterson , Elizabeth C. Schundler , Christian W. Smith

In this paper we study the robustness properties of dimensionality reduction with Gaussian random matrices having arbitrarily erased rows. We first study the robustness property against erasure for the almost norm preservation property of…

Information Theory · Computer Science 2015-01-09 Bin Han , Zhiqiang Xu

Compressive sensing involves the inversion of a mapping $SD \in \mathbb{R}^{m \times n}$, where $m < n$, $S$ is a sensing matrix, and $D$ is a sparisfying dictionary. The restricted isometry property is a powerful sufficient condition for…

Information Theory · Computer Science 2022-07-13 Jinn Ho , Wen-Liang Hwang

This article extends the concept of compressed sensing to signals that are not sparse in an orthonormal basis but rather in a redundant dictionary. It is shown that a matrix, which is a composition of a random matrix of certain type and a…

Probability · Mathematics 2010-11-10 Holger Rauhut , Karin Schnass , Pierre Vandergheynst

We present a general class of compressed sensing matrices which are then demonstrated to have associated sublinear-time sparse approximation algorithms. We then develop methods for constructing specialized matrices from this class which are…

Numerical Analysis · Mathematics 2011-06-01 J. Bailey , M. A. Iwen , C. V. Spencer

The field of compressed sensing has shown that a sparse but otherwise arbitrary vector can be recovered exactly from a small number of randomly constructed linear projections (or samples). The question addressed in this paper is whether an…

Information Theory · Computer Science 2010-01-26 Galen Reeves , Michael Gastpar

We revisit the probabilistic construction of sparse random matrices where each column has a fixed number of nonzeros whose row indices are drawn uniformly at random with replacement. These matrices have a one-to-one correspondence with the…

Information Theory · Computer Science 2013-07-16 Bubacarr Bah , Jared Tanner

This paper considers compressed sensing matrices and neighborliness of a centrally symmetric convex polytope generated by vectors $\pm X_1,...,\pm X_N\in\R^n$, ($N\ge n$). We introduce a class of random sampling matrices and show that they…

Probability · Mathematics 2009-05-01 Radosław Adamczak , Alexander E. Litvak , Alain Pajor , Nicole Tomczak-Jaegermann