English
Related papers

Related papers: Effective regions and kernels in continuous sparse…

200 papers

Compressive Sensing (CS) exploits the surprising fact that the information contained in a sparse signal can be preserved in a small number of compressive, often random linear measurements of that signal. Strong theoretical guarantees have…

Information Theory · Computer Science 2014-05-02 Armin Eftekhari , Michael B. Wakin

We consider the following signal recovery problem: given a measurement matrix $\Phi\in \mathbb{R}^{n\times p}$ and a noisy observation vector $c\in \mathbb{R}^{n}$ constructed from $c = \Phi\theta^* + \epsilon$ where $\epsilon\in…

Machine Learning · Statistics 2013-07-23 Ji Liu , Lei Yuan , Jieping Ye

A field known as Compressive Sensing (CS) has recently emerged to help address the growing challenges of capturing and processing high-dimensional signals and data sets. CS exploits the surprising fact that the information contained in a…

Machine Learning · Statistics 2010-02-08 Michael B. Wakin

The reconstruction of an unknown quantity from noisy measurements is a mathematical problem relevant in most applied sciences, for example, in medical imaging, radar inverse scattering, or astronomy. This underlying mathematical problem is…

Optimization and Control · Mathematics 2025-10-14 Nina M. Gottschling , David Iagaru , Jakob Gawlikowski , Ioannis Sgouralis

This paper determines to within a single measurement the minimum number of measurements required to successfully reconstruct a signal drawn from a Gaussian mixture model in the low-noise regime. The method is to develop upper and lower…

Information Theory · Computer Science 2015-06-16 Francesco Renna , Robert Calderbank , Lawrence Carin , Miguel R. D. Rodrigues

The sparse signal recovery in the standard compressed sensing (CS) problem requires that the sensing matrix be known a priori. Such an ideal assumption may not be met in practical applications where various errors and fluctuations exist in…

Information Theory · Computer Science 2015-06-03 Zai Yang , Cishen Zhang , Lihua Xie

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

Methodology · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Manifold learning is a central task in modern statistics and data science. Many datasets (cells, documents, images, molecules) can be represented as point clouds embedded in a high dimensional ambient space, however the degrees of freedom…

Machine Learning · Statistics 2025-02-18 Stephen Zhang , Gilles Mordant , Tetsuya Matsumoto , Geoffrey Schiebinger

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

Machine Learning · Computer Science 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright

We consider the problem of recovering an unknown effectively $(s_1,s_2)$-sparse low-rank-$R$ matrix $X$ with possibly non-orthogonal rank-$1$ decomposition from incomplete and inaccurate linear measurements of the form $y = \mathcal A (X) +…

Numerical Analysis · Mathematics 2020-07-29 Massimo Fornasier , Johannes Maly , Valeriya Naumova

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili

Nonparametric estimation of copula density functions using kernel estimators presents significant challenges. One issue is the potential unboundedness of certain copula density functions at the corners of the unit square. Another is the…

Methodology · Statistics 2025-02-11 Mathias N. Muia , Olivia Atutey , Mahmud Hasan

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or…

Machine Learning · Computer Science 2019-08-06 Balázs Csanád Csáji , Krisztián Balázs Kis

We discuss a general notion of "sparsity structure" and associated recoveries of a sparse signal from its linear image of reduced dimension possibly corrupted with noise. Our approach allows for unified treatment of (a) the "usual sparsity"…

Optimization and Control · Mathematics 2016-11-26 Anatoli Juditsky , Fatma Kilinc Karzan , Arkadi Nemirovski

Cellwise contamination remains a challenging problem for data scientists, particularly in research fields that require the selection of sparse features. Traditional robust methods may not be feasible nor efficient in dealing with such…

Methodology · Statistics 2024-03-04 Peng Su , Garth Tarr , Samuel Muller , Suojin Wang

We analyze the noise in macro-particle methods used in plasma physics and fluid dynamics, leading to approaches for minimizing the total error, focusing on electrostatic models in one dimension. We describe kernel density estimation for…

Plasma Physics · Physics 2021-06-30 E. G. Evstatiev , J. M. Finn , B. A. Shadwick , N. Hengartner

We introduce a general framework to handle structured models (sparse and block-sparse with possibly overlapping blocks). We discuss new methods for their recovery from incomplete observation, corrupted with deterministic and stochastic…

Statistics Theory · Mathematics 2013-02-28 Anatoli Juditsky , Fatma Kılınç Karzan , Arkadi Nemirovski , Boris Polyak

This paper introduces a novel framework and corresponding methods for sampling and reconstruction of sparse signals in shift-invariant (SI) spaces. We reinterpret the random demodulator, a system that acquires sparse bandlimited signals, as…

Signal Processing · Electrical Eng. & Systems 2022-01-24 Tin Vlašić , Damir Seršić

Label noise is a common issue in real-world datasets that inevitably impacts the generalization of models. This study focuses on robust classification tasks where the label noise is instance-dependent. Estimating the transition matrix…

Machine Learning · Computer Science 2024-04-09 Yukun Yang , Naihao Wang , Haixin Yang , Ruirui Li

A spectral mixture (SM) kernel is a flexible kernel used to model any stationary covariance function. Although it is useful in modeling data, the learning of the SM kernel is generally difficult because optimizing a large number of…

Machine Learning · Statistics 2020-06-15 Yohan Jung , Kyungwoo Song , Jinkyoo Park