English
Related papers

Related papers: Dantzig Selector with an Approximately Optimal Den…

200 papers

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

The Minimum Description Length (MDL) principle states that the optimal model for a given data set is that which compresses it best. Due to practial limitations the model can be restricted to a class such as linear regression models, which…

Machine Learning · Statistics 2015-03-13 Florin Popescu , Daniel Renz

We have developed an approximate signal recovery algorithm with low computational cost for compressed sensing on the basis of randomly constructed sparse measurement matrices. The law of large numbers and the central limit theorem suggest…

Information Theory · Computer Science 2011-02-21 Yoshiyuki Kabashima , Tadashi Wadayama

Learning predictive models from observations using deep neural networks (DNNs) is a promising new approach to many real-world planning and control problems. However, common DNNs are too unstructured for effective planning, and current…

Robotics · Computer Science 2023-12-21 Ziang Liu , Genggeng Zhou , Jeff He , Tobia Marcucci , Li Fei-Fei , Jiajun Wu , Yunzhu Li

We study the Compressed Sensing (CS) problem, which is the problem of finding the most sparse vector that satisfies a set of linear measurements up to some numerical tolerance. We introduce an $\ell_2$ regularized formulation of CS which we…

Signal Processing · Electrical Eng. & Systems 2024-07-15 Dimitris Bertsimas , Nicholas A. G. Johnson

Sparse dictionary learning is a popular method for representing signals as linear combinations of a few elements from a dictionary that is learned from the data. In the classical setting, signals are represented as vectors and the…

Optimization and Control · Mathematics 2019-09-20 Evan Schwab , Benjamin D. Haeffele , René Vidal , Nicolas Charon

Limitations on bandwidth and power consumption impose strict bounds on data rates of diagnostic imaging systems. Consequently, the design of suitable (i.e. task- and data-aware) compression and reconstruction techniques has attracted…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Kees Janse , Massimo Mischi , Ruud J. G. van Sloun

Deep representation learning has become one of the most widely adopted approaches for visual search, recommendation, and identification. Retrieval of such representations from a large database is however computationally challenging.…

Machine Learning · Computer Science 2020-04-14 Biswajit Paria , Chih-Kuan Yeh , Ian E. H. Yen , Ning Xu , Pradeep Ravikumar , Barnabás Póczos

Discriminative features extracted from the sparse coding model have been shown to perform well for classification. Recent deep learning architectures have further improved reconstruction in inverse problems by considering new dense priors…

Information Theory · Computer Science 2026-03-27 Abiy Tasissa , Emmanouil Theodosis , Bahareh Tolooshams , Demba Ba

Our proposal is on a new stochastic optimizer for non-convex and possibly non-smooth objective functions typically defined over large dimensional design spaces. Towards this, we have tried to bridge noise-assisted global search and faster…

Machine Learning · Computer Science 2025-03-03 Uttam Suman , Mariya Mamajiwala , Mukul Saxena , Ankit Tyagi , Debasish Roy

We discuss two new methods of recovery of sparse signals from noisy observation based on $\ell_1$- minimization. They are closely related to the well-known techniques such as Lasso and Dantzig Selector. However, these estimators come with…

Statistics Theory · Mathematics 2014-04-11 Anatoli Iouditski , Arkadii S. Nemirovski

Traditional supervised denoising networks learn network weights through "black box" (pixel-oriented) training, which requires clean training labels. The uninterpretability nature of such denoising networks in addition to the requirement for…

Geophysics · Physics 2023-08-08 Sixiu Liu , Shijun Cheng , Tariq Alkhalifah

Diversity optimization seeks to discover a set of solutions that elicit diverse features. Prior work has proposed Novelty Search (NS), which, given a current set of solutions, seeks to expand the set by finding points in areas of low…

Machine Learning · Computer Science 2024-05-31 David H. Lee , Anishalakshmi V. Palaparthi , Matthew C. Fontaine , Bryon Tjanaka , Stefanos Nikolaidis

Dynamic mode decomposition (DMD) is an efficient tool for decomposing spatio-temporal data into a set of low-dimensional modes, yielding the oscillation frequencies and the growth rates of physically significant modes. In this paper, we…

Dynamical Systems · Mathematics 2023-02-21 Minwoo Lee , Jongho Park

Regularized methods have been widely applied to system identification problems without known model structures. This paper proposes an infinite-dimensional sparse learning algorithm based on atomic norm regularization. Atomic norm…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mingzhou Yin , Mehmet Tolga Akan , Andrea Iannelli , Roy S. Smith

A denoising algorithm seeks to remove noise, errors, or perturbations from a signal. Extensive research has been devoted to this arena over the last several decades, and as a result, today's denoisers can effectively remove large amounts of…

Information Theory · Computer Science 2016-04-19 Christopher A. Metzler , Arian Maleki , Richard G. Baraniuk

The dynamic mode decomposition (DMD) is a data-driven approach that extracts the dominant features from spatiotemporal data. In this work, we introduce sparse-mode DMD, a new variant of the optimized DMD framework that specifically…

Machine Learning · Statistics 2025-07-29 Sara M. Ichinaga , Steven L. Brunton , Aleksandr Y. Aravkin , J. Nathan Kutz

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi

Compressed sensing is a novel technique where one can recover sparse signals from the undersampled measurements. In this paper, a $K \times N$ measurement matrix for compressed sensing is deterministically constructed via multiplicative…

Information Theory · Computer Science 2010-11-12 Nam Yul Yu
‹ Prev 1 3 4 5 6 7 10 Next ›