English
Related papers

Related papers: Sparse approximation of multivariate functions fro…

200 papers

Greedy Sampling Methods (GSMs) are widely used to construct approximate solutions of Configuration Optimization Problems (COPs), where a loss functional is minimized over finite configurations of points in a compact domain. While effective…

Optimization and Control · Mathematics 2026-01-09 Evie Nielen , Oliver Tse

In this paper, we propose a novel sparse recovery method based on the generalized error function. The penalty function introduced involves both the shape and the scale parameters, making it very flexible. The theoretical analysis results in…

Numerical Analysis · Mathematics 2021-06-04 Zhiyong Zhou

The recovery of sparse data is at the core of many applications in machine learning and signal processing. While such problems can be tackled using $\ell_1$-regularization as in the LASSO estimator and in the Basis Pursuit approach,…

Optimization and Control · Mathematics 2021-11-15 Christian Kümmerle , Claudio Mayrink Verdun , Dominik Stöger

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

The non-negative solution to an underdetermined linear system can be uniquely recovered sometimes, even without imposing any additional sparsity constraints. In this paper, we derive conditions under which a unique non-negative solution for…

Numerical Analysis · Mathematics 2013-09-24 Karthikeyan Natesan Ramamurthy , Jayaraman J. Thiagarajan , Andreas Spanias

We study the problem of recovering the sparsity pattern of block-sparse signals from noise-corrupted measurements. A simple, efficient recovery method, namely, a block-version of the orthogonal matching pursuit (OMP) method, is considered…

Information Theory · Computer Science 2011-09-27 Jun Fang , Hongbin Li

This paper addresses compressive sensing for multi-channel ECG. Compared to the traditional sparse signal recovery approach which decomposes the signal into the product of a dictionary and a sparse vector, the recently developed cosparse…

Information Theory · Computer Science 2013-11-21 Yurrit Avonds , Yipeng Liu , Sabine Van Huffel

Sparsity learning with known grouping structure has received considerable attention due to wide modern applications in high-dimensional data analysis. Although advantages of using group information have been well-studied by shrinkage-based…

Machine Learning · Statistics 2018-09-28 Wei Qian , Wending Li , Yasuhiro Sogawa , Ryohei Fujimaki , Xitong Yang , Ji Liu

Maximum weight matching is one of the most fundamental combinatorial optimization problems with a wide range of applications in data mining and bioinformatics. Developing distributed weighted matching algorithms is challenging due to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-06 Sepehr Assadi , MohammadHossein Bateni , Vahab Mirrokni

Sparse decision trees are one of the most common forms of interpretable models. While recent advances have produced algorithms that fully optimize sparse decision trees for prediction, that work does not address policy design, because the…

Machine Learning · Computer Science 2022-10-27 Ali Behrouz , Mathias Lecuyer , Cynthia Rudin , Margo Seltzer

Greedy sparse recovery has become a popular tool in many applications, although its complexity is still prohibitive when large sparsifying dictionaries or sensing matrices have to be exploited. In this paper, we formulate first a new class…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Joan Palacios , Nuria González-Prelcic

We present an information-theoretic framework for sequential adaptive compressed sensing, Info-Greedy Sensing, where measurements are chosen to maximize the extracted information conditioned on the previous measurements. We show that the…

Information Theory · Computer Science 2023-07-19 Gabor Braun , Sebastian Pokutta , Yao Xie

Many models for sparse regression typically assume that the covariates are known completely, and without noise. Particularly in high-dimensional applications, this is often not the case. This paper develops efficient OMP-like algorithms to…

Statistics Theory · Mathematics 2015-03-31 Yudong Chen , Constantine Caramanis

Compressed sensing deals with the recovery of sparse signals from linear measurements. Without any additional information, it is possible to recover an $s$-sparse signal using $m \gtrsim s \log(d/s)$ measurements in a robust and stable way.…

Functional Analysis · Mathematics 2016-05-25 Axel Flinth

Hard-thresholding-based algorithms have seen various advantages for sparse optimization in controlling the sparsity and allowing for fast computation. Recent research shows that when techniques of the Newton-type methods are integrated,…

Optimization and Control · Mathematics 2022-11-11 Shenglong Zhou

We study verifiable sufficient conditions and computable performance bounds for sparse recovery algorithms such as the Basis Pursuit, the Dantzig selector and the Lasso estimator, in terms of a newly defined family of quality measures for…

Information Theory · Computer Science 2018-01-22 Zhiyong Zhou , Jun Yu

Motivated by sequential budgeted allocation problems, we investigate online matching problems where connections between vertices are not i.i.d., but they have fixed degree distributions -- the so-called configuration model. We estimate the…

Data Structures and Algorithms · Computer Science 2021-07-05 Nathan Noiry , Flore Sentenac , Vianney Perchet

Detection of a signal under noise is a classical signal processing problem. When monitoring spatial phenomena under a fixed budget, i.e., either physical, economical or computational constraints, the selection of a subset of available…

Signal Processing · Electrical Eng. & Systems 2018-08-01 Mario Coutino , Sundeep Prabhakar Chepuri , Geert Leus

Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic…

Machine Learning · Statistics 2016-03-23 Sohail Bahmani , Petros T. Boufounos , Bhiksha Raj

Consider a regression model with fixed design and Gaussian noise where the regression function can potentially be well approximated by a function that admits a sparse representation in a given dictionary. This paper resorts to exponential…

Statistics Theory · Mathematics 2013-01-08 Philippe Rigollet , Alexandre B. Tsybakov