English
Related papers

Related papers: Sparse Recovery With Non-Linear Fourier Features

200 papers

In this paper, we propose a fast surrogate leverage weighted sampling strategy to generate refined random Fourier features for kernel approximation. Compared to the current state-of-the-art method that uses the leverage weighted scheme…

Machine Learning · Computer Science 2019-11-22 Fanghui Liu , Xiaolin Huang , Yudong Chen , Jie Yang , Johan A. K. Suykens

Much of the existing literature in sparse recovery is concerned with the following question: given a sparsity pattern and a corresponding regularizer, derive conditions on the dictionary under which exact recovery is possible. In this…

Signal Processing · Electrical Eng. & Systems 2020-07-24 Mustafa D. Kaba , Mengnan Zhao , Rene Vidal , Daniel P. Robinson , Enrique Mallada

Several recent works have empirically observed that Convolutional Neural Nets (CNNs) are (approximately) invertible. To understand this approximate invertibility phenomenon and how to leverage it more effectively, we focus on a theoretical…

Machine Learning · Statistics 2017-05-25 Anna C. Gilbert , Yi Zhang , Kibok Lee , Yuting Zhang , Honglak Lee

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

This paper considers (partial) identification of a variety of counterfactual parameters in binary response models with possibly endogenous regressors. Our framework allows for nonseparable index functions with multi-dimensional latent…

Econometrics · Economics 2022-07-26 Jiaying Gu , Thomas M. Russell

We consider the problem of phase retrieval, namely, recovery of a signal from the magnitude of its Fourier transform, or of any other linear transform. Due to the loss of the Fourier phase information, this problem is ill-posed. Therefore,…

Information Theory · Computer Science 2023-07-19 Yoav Shechtman , Amir Beck , Yonina C. Eldar

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

Sparse recovery is among the most well-studied problems in learning theory and high-dimensional statistics. In this work, we investigate the statistical and computational landscapes of sparse recovery with $\ell_\infty$ error guarantees.…

Statistics Theory · Mathematics 2026-02-19 Ziyun Chen , Jerry Li , Kevin Tian , Yusong Zhu

Linear sketching and recovery of sparse vectors with randomly constructed sparse matrices has numerous applications in several areas, including compressive sensing, data stream computing, graph sketching, and combinatorial group testing.…

Numerical Analysis · Mathematics 2014-02-07 Bubacarr Bah , Luca Baldassarre , Volkan Cevher

We consider the problem of exact support recovery of sparse signals via noisy measurements. The main focus is the sufficient and necessary conditions on the number of measurements for support recovery to be reliable. By drawing an analogy…

Information Theory · Computer Science 2010-03-04 Yuzhe Jin , Young-Han Kim , Bhaskar D. Rao

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

We propose an extensive framework for additive regression models for correlated functional responses, allowing for multiple partially nested or crossed functional random effects with flexible correlation structures for, e.g., spatial,…

Methodology · Statistics 2013-11-26 Fabian Scheipl , Ana-Maria Staicu , Sonja Greven

Sparse signal reconstruction algorithms have attracted research attention due to their wide applications in various fields. In this paper, we present a simple Bayesian approach that utilizes the sparsity constraint and a priori statistical…

Statistics Theory · Mathematics 2015-06-05 Ahmed A. Quadeer , Tareq Y. Al-Naffouri

We introduce a continuous domain framework for the recovery of a planar curve from a few samples. We model the curve as the zero level set of a trigonometric polynomial. We show that the exponential feature maps of the points on the curve…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Qing Zou , Sunrita Poddar , Mathews Jacob

Tensor decomposition is a powerful tool for extracting physically meaningful latent factors from multi-dimensional nonnegative data, and has been an increasing interest in a variety of fields such as image processing, machine learning, and…

Machine Learning · Computer Science 2024-12-03 Xiongjun Zhang , Michael K. Ng

Information about microscopic objects with features smaller than the diffraction limit is almost entirely lost in a far-field diffraction image but could be partly recovered with data completition techniques. Any such approach critically…

Optics · Physics 2020-11-17 Maria Bancerek , Krzysztof M. Czajkowski , Rafal Kotynski

Weak lensing convergence maps - upon which higher order statistics can be calculated - can be recovered from observations of the shear field by solving the lensing inverse problem. For typical surveys this inverse problem is ill-posed…

Cosmology and Nongalactic Astrophysics · Physics 2021-02-08 Matthew A. Price , Xiaohao Cai , Jason D. McEwen , Thomas D. Kitching

Rahimi and Recht (2007) introduced the idea of decomposing positive definite shift-invariant kernels by randomly sampling from their spectral distribution for machine learning applications. This famous technique, known as Random Fourier…

Machine Learning · Computer Science 2026-02-24 Nicolas Langrené , Xavier Warin , Pierre Gruet

We propose a Fourier-based learning algorithm for highly nonlinear multiclass classification. The algorithm is based on a smoothing technique to calculate the probability distribution of all classes. To obtain the probability distribution,…

Machine Learning · Computer Science 2022-11-17 Soheil Mehrabkhani
‹ Prev 1 8 9 10 Next ›