English
Related papers

Related papers: Computation of sparse low degree interpolating pol…

200 papers

Intensively growing approach in signal processing and acquisition, the Compressive Sensing approach, allows sparse signals to be recovered from small number of randomly acquired signal coefficients. This paper analyses some of the commonly…

Signal Processing · Electrical Eng. & Systems 2018-02-21 Tamara Koljensic , Caslav Labudovic

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

We study the Inexact Restoration framework with random models for minimizing functions whose evaluation is subject to errors. We propose a constrained formulation that includes well-known stochastic problems and an algorithm applicable when…

Optimization and Control · Mathematics 2026-02-24 Benedetta Morini , Simone Rebegoldi

In this paper, we present modifications of the iterative hard thresholding (IHT) method for recovery of jointly row-sparse and low-rank matrices. In particular a Riemannian version of IHT is considered which significantly reduces…

Optimization and Control · Mathematics 2022-10-03 Henrik Eisenmann , Felix Krahmer , Max Pfeffer , André Uschmajew

The effectiveness of using model sparsity as a priori information when solving linear inverse problems is studied. We investigate the reconstruction quality of such a method in the non-idealized case and compute some typical recovery errors…

Numerical Analysis · Mathematics 2010-07-19 Ignace Loris , Caroline Verhoeven

Functions of interest are often smooth and sparse in some sense, and both priors should be taken into account when interpolating sampled data. Classical linear interpolation methods are effective under strong regularity assumptions, but…

Functional Analysis · Mathematics 2015-03-27 Holger Rauhut , Rachel Ward

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

Machine Learning · Computer Science 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

We investigate the reconstruction of multivariate functions from samples using sparse recovery techniques. For Square Root Lasso, Orthogonal Matching Pursuit, and Compressive Sampling Matching Pursuit, we demonstrate both theoretically and…

Numerical Analysis · Mathematics 2026-01-21 Moritz Moeller , Sebastian Neumayer , Kateryna Pozharska , Tizian Sommerfeld , Tino Ullrich

Recovering jointly sparse signals in the multiple measurement vectors (MMV) setting is a fundamental problem in machine learning, but traditional methods often require careful parameter tuning or prior knowledge of the sparsity of the…

Machine Learning · Computer Science 2026-02-02 Lakshmi Jayalal , Sheetal Kalyani

Sparse reconstruction approaches using the re-weighted l1-penalty have been shown, both empirically and theoretically, to provide a significant improvement in recovering sparse signals in comparison to the l1-relaxation. However, numerical…

Machine Learning · Statistics 2013-12-06 Dmitry Malioutov , Aleksandr Aravkin

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

In this work, we present a trust-region optimization framework that employs Hermite kernel surrogate models. The method targets optimization problems with computationally demanding objective functions, for which direct optimization is often…

Numerical Analysis · Mathematics 2025-07-03 Sven Ullmann , Tobias Ehring , Robin Herkert , Bernard Haasdonk

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

Information Theory · Computer Science 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi

Sparsity-constrained optimization has wide applicability in machine learning, statistics, and signal processing problems such as feature selection and compressive Sensing. A vast body of work has studied the sparsity-constrained…

Machine Learning · Statistics 2013-07-17 Sohail Bahmani , Bhiksha Raj , Petros Boufounos

Exact recovery of a sparse solution for an underdetermined system of linear equations implies full search among all possible subsets of the dictionary, which is computationally intractable, while l1 minimization will do the job when a…

Information Theory · Computer Science 2014-12-22 Mohsen Joneidi , Mahdi Barzegar Khalilsarai , Alireza Zaeemzadeh , Nazanin Rahnavard

Recovery of low-rank matrices has recently seen significant activity in many areas of science and engineering, motivated by recent theoretical results for exact reconstruction guarantees and interesting practical applications. A number of…

Machine Learning · Statistics 2011-09-12 S. Derin Babacan , Martin Luessi , Rafael Molina , Aggelos K. Katsaggelos

We consider the problem of learning a graph modeling the statistical relations of the $d$ variables from a dataset with $n$ samples $X \in \mathbb{R}^{n \times d}$. Standard approaches amount to searching for a precision matrix $\Theta$…

Machine Learning · Statistics 2023-12-13 Titouan Vayer , Etienne Lasalle , Rémi Gribonval , Paulo Gonçalves

In this paper we show the use of the focal underdetermined system solver to recover sparse empirical quadrature rules for parametrized integrals from existing data, consisting of the values of given parametric functions sampled on a…

Numerical Analysis · Mathematics 2021-06-24 Mattia Manucci , Jose Vicente Aguado , Domenico Borzacchiello

We consider the problem of recovering polynomials that are sparse with respect to the basis of Legendre polynomials from a small number of random samples. In particular, we show that a Legendre s-sparse polynomial of maximal degree N can be…

Numerical Analysis · Mathematics 2011-04-05 Holger Rauhut , Rachel Ward

In this letter, we propose an algorithm for recovery of sparse and low rank components of matrices using an iterative method with adaptive thresholding. In each iteration, the low rank and sparse components are obtained using a thresholding…

Numerical Analysis · Computer Science 2017-04-13 Nematollah Zarmehi , Farokh Marvasti