English
Related papers

Related papers: Model-based Sketching and Recovery with Expanders

200 papers

In this paper we present a new algorithm for compressive sensing that makes use of binary measurement matrices and achieves exact recovery of ultra sparse vectors, in a single pass and without any iterations. Due to its noniterative nature,…

Information Theory · Computer Science 2018-05-22 Mahsa Lotfi , Mathukumalli Vidyasagar

We introduce a new sub-linear space sketch---the Weight-Median Sketch---for learning compressed linear classifiers over data streams while supporting the efficient recovery of large-magnitude weights in the model. This enables…

Machine Learning · Computer Science 2018-04-10 Kai Sheng Tai , Vatsal Sharan , Peter Bailis , Gregory Valiant

We consider structure discovery of undirected graphical models from observational data. Inferring likely structures from few examples is a complex task often requiring the formulation of priors and sophisticated inference procedures.…

Machine Learning · Statistics 2017-08-04 Eugene Belilovsky , Kyle Kastner , Gaël Varoquaux , Matthew Blaschko

We consider multichannel sparse recovery problem where the objective is to find good recovery of jointly sparse unknown signal vectors from the given multiple measurement vectors which are different linear combinations of the same known…

Information Theory · Computer Science 2015-06-11 Esa Ollila

In this paper, {the goal is to design deterministic sampling patterns on the sphere and the rotation group} and, thereby, construct sensing matrices for sparse recovery of band-limited functions. It is first shown that random sensing…

Information Theory · Computer Science 2020-04-22 Arya Bangun , Arash Behboodi , Rudolf Mathar

Projection-based iterative methods for solving large over-determined linear systems are well-known for their simplicity and computational efficiency. It is also known that the correct choice of a sketching procedure (i.e., preprocessing…

Numerical Analysis · Mathematics 2019-12-03 Elizaveta Rebrova , Deanna Needell

We propose iterative projection methods for solving square or rectangular consistent linear systems Ax = b. Existing projection methods use sketching matrices (possibly randomized) to generate a sequence of small projected subproblems, but…

Numerical Analysis · Mathematics 2023-12-13 Johannes J. Brust , Michael A. Saunders

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

Linear regression is a fundamental and primitive problem in supervised machine learning, with applications ranging from epidemiology to finance. In this work, we propose methods for speeding up distributed linear regression. We do so by…

Information Theory · Computer Science 2024-04-02 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

Sampling of signals belonging to a low-dimensional subspace has well-documented merits for dimensionality reduction, limited memory storage, and online processing of streaming network data. When the subspace is known, these signals can be…

Information Theory · Computer Science 2019-11-26 Fernando Gama , Antonio G. Marques , Gonzalo Mateos , Alejandro Ribeiro

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

Information Theory · Computer Science 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

In recent years, spectral graph sparsification techniques that can compute ultra-sparse graph proxies have been extensively studied for accelerating various numerical and graph-related applications. Prior nearly-linear-time spectral…

Data Structures and Algorithms · Computer Science 2018-04-10 Zhuo Feng

This paper studies the problem of Kronecker-structured sparse vector recovery from an underdetermined linear system with a Kronecker-structured dictionary. Such a problem arises in many real-world applications such as the sparse channel…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Yanbin He , Geethu Joseph

Sparse recovery is widely applied in many fields, since many signals or vectors can be sparsely represented under some frames or dictionaries. Most of fast algorithms at present are based on solving $l^0$ or $l^1$ minimization problems and…

Numerical Analysis · Mathematics 2019-03-06 Chong-Jun Li , Yi-Jun Zhong

Sketching enables many exciting applications, notably, image retrieval. The fear-to-sketch problem (i.e., "I can't sketch") has however proven to be fatal for its widespread adoption. This paper tackles this "fear" head on, and for the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ayan Kumar Bhunia , Subhadeep Koley , Abdullah Faiz Ur Rahman Khilji , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Randomized Stepped Frequency Radar (RSFR) is very attractive for tasks under complex electromagnetic environment. Due to the synthetic high range resolution in RSRFs, a target usually occupies a series of range cells and is called an…

Signal Processing · Electrical Eng. & Systems 2021-10-05 Lei Wang , Tianyao Huang , Yimin Liu

Training large, deep neural networks to convergence can be prohibitively expensive. As a result, often only a small selection of popular, dense models are reused across different contexts and tasks. Increasingly, sparsely activated models,…

Sparse mapping has been a key methodology in many high-dimensional scientific problems. When multiple tasks share the set of relevant features, learning them jointly in a group drastically improves the quality of relevant feature selection.…

Machine Learning · Statistics 2017-09-18 Meghana Kshirsagar , Eunho Yang , Aurélie C. Lozano