English
Related papers

Related papers: Convergence of a data-driven time-frequency analys…

200 papers

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

In this paper, the joint support recovery of several sparse signals whose supports present similarities is examined. Each sparse signal is acquired using the same noisy linear measurement process, which returns fewer observations than the…

Information Theory · Computer Science 2017-02-20 Jean-François Determe , Jérôme Louveaux , Laurent Jacques , François Horlin

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

Methodology · Statistics 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Orthogonal matching pursuit (OMP) is a greedy algorithm popularly being used for the recovery of sparse signals. In this paper, we study the performance of OMP for support recovery of sparse signal under noise. Our analysis shows that under…

Information Theory · Computer Science 2020-12-14 Hengkuan Lu , Jian Wang

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

Information Theory · Computer Science 2015-03-13 V. Saligrama , M. Zhao

We address the problem of recovering signals from samples taken at their rate of innovation. Our only assumption is that the sampling system is such that the parameters defining the signal can be stably determined from the samples, a…

Information Theory · Computer Science 2015-05-28 Tomer Michaeli , Yonina C. Eldar

This study investigates the use of continuous-time dynamical systems for sparse signal recovery. The proposed dynamical system is in the form of a nonlinear ordinary differential equation (ODE) derived from the gradient flow of the Lasso…

Information Theory · Computer Science 2023-03-30 Tadashi Wadayama , Ayano Nakai-Kasai

We propose a sparse regression method capable of discovering the governing partial differential equation(s) of a given system by time series measurements in the spatial domain. The regression framework relies on sparsity promoting…

Pattern Formation and Solitons · Physics 2016-09-22 Samuel H. Rudy , Steven L. Brunton , Joshua L. Proctor , J. Nathan Kutz

We study unconstrained optimization problems with nonsmooth and convex objective function in the form of a mathematical expectation. The proposed method approximates the expected objective function with a sample average function using…

Optimization and Control · Mathematics 2022-11-03 Natasa Krejic , Natasa Krklec Jerinkic , Tijana Ostojic

This paper addresses the problem of sparse phase retrieval, a fundamental inverse problem in applied mathematics, physics, and engineering, where a signal need to be reconstructed using only the magnitude of its transformation while phase…

Machine Learning · Statistics 2025-04-15 The Tien Mai

The non-negative solution to an underdetermined linear system can be uniquely recovered sometimes, even without imposing any additional sparsity constraints. In this paper, we derive conditions under which a unique non-negative solution for…

Numerical Analysis · Mathematics 2013-09-24 Karthikeyan Natesan Ramamurthy , Jayaraman J. Thiagarajan , Andreas Spanias

Sparse signal recovery from a small number of random measurements is a well known NP-hard to solve combinatorial optimization problem, with important applications in signal and image processing. The standard approach to the sparse signal…

Data Analysis, Statistics and Probability · Physics 2013-04-09 M. Andrecut

Conventional sparse phase retrieval schemes can recover sparse signals from the magnitude of linear measurements only up to a global phase ambiguity. This work proposes a novel approach that instead utilizes the magnitude of affine…

Information Theory · Computer Science 2021-05-25 Ming-Hsun Yang , Y. -W. Peter Hong , Jwo-Yuh Wu

The Lasso has become a benchmark data analysis procedure, and numerous variants have been proposed in the literature. Although the Lasso formulations are stated so that overall prediction error is optimized, no full control over the…

We discuss two new methods of recovery of sparse signals from noisy observation based on $\ell_1$- minimization. They are closely related to the well-known techniques such as Lasso and Dantzig Selector. However, these estimators come with…

Statistics Theory · Mathematics 2014-04-11 Anatoli Iouditski , Arkadii S. Nemirovski

In many practical settings one can sequentially and adaptively guide the collection of future data, based on information extracted from data collected previously. These sequential data collection procedures are known by different names,…

Statistics Theory · Mathematics 2013-11-28 Ervin Tánczos , Rui M. Castro

Heterogeneity is often natural in many contemporary applications involving massive data. While posing new challenges to effective learning, it can play a crucial role in powering meaningful scientific discoveries through the understanding…

Methodology · Statistics 2016-06-14 Zhao Ren , Yongjian Kang , Yingying Fan , Jinchi Lv

We present a new method to obtain spatio-temporal information from aggregated data of stationary traffic detectors, the ``adaptive smoothing method''. In essential, a nonlinear spatio-temporal lowpass filter is applied to the input detector…

Statistical Mechanics · Physics 2007-05-23 Martin Treiber , Dirk Helbing

The goal of compressed sensing is to reconstruct a sparse signal under a few linear measurements far less than the dimension of the ambient space of the signal. However, many real-life applications in physics and biomedical sciences carry…

Optimization and Control · Mathematics 2017-08-29 Angang Cui , Jigen Peng , Haiyang Li

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia