English
Related papers

Related papers: Discrete and Continuous-time Soft-Thresholding wit…

200 papers

Compressed sensing is a recent set of mathematical results showing that sparse signals can be exactly reconstructed from a small number of linear measurements. Interestingly, for ideal sparse signals with no measurement noise, random…

Information Theory · Computer Science 2009-01-28 Hyun Sung Chang , Yair Weiss , William T. Freeman

In the machine learning era, sparsity continues to attract significant interest due to the benefits it provides to learning models. Algorithms aiming to optimise the \(\ell_0\)- and \(\ell_1\)-norm are the common choices to achieve…

Image and Video Processing · Electrical Eng. & Systems 2020-11-25 Perla Mayo , Robin Holmes , Alin Achim

We study computational-statistical gaps for improper learning in sparse linear regression. More specifically, given $n$ samples from a $k$-sparse linear model in dimension $d$, we ask what is the minimum sample complexity to efficiently (in…

Machine Learning · Computer Science 2024-06-26 Rares-Darius Buhai , Jingqiu Ding , Stefan Tiegel

This paper investigates the sparse phase retrieval problem, which aims to recover a sparse signal from a system of quadratic measurements. In this work, we propose a novel non-convex algorithm, termed Gradient Hard Thresholding Pursuit…

Numerical Analysis · Mathematics 2025-02-18 Licheng Dai , Xiliang Lu , Juntao You

We address the problem of recovering signals from samples taken at their rate of innovation. Our only assumption is that the sampling system is such that the parameters defining the signal can be stably determined from the samples, a…

Information Theory · Computer Science 2015-05-28 Tomer Michaeli , Yonina C. Eldar

With the aim of developing a fast yet accurate algorithm for compressive sensing (CS) reconstruction of natural images, we combine in this paper the merits of two existing categories of CS methods: the structure insights of traditional…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Jian Zhang , Bernard Ghanem

Previous works have shown that the small-scale information of incompressible homogeneous isotropic turbulence (HIT) is fully recoverable as long as sufficient large-scale structures are continuously enforced through temporally continuous…

Fluid Dynamics · Physics 2022-06-22 Yunpeng Wang , Zelong Yuan , Chenyue Xie , Jianchun Wang

An important receiver operation is to detect the presence specific preamble signals with unknown delays in the presence of scattering, Doppler effects and carrier offsets. This task, referred to as "link acquisition", is typically a…

Information Theory · Computer Science 2015-06-11 Xiao Li , Andrea Rueetschi , Anna Scaglione , Yonina C. Eldar

This paper studies computationally efficient methods and their minimax optimality for high-dimensional clustering and signal recovery under block signal structures. We propose two sets of methods, cross-block feature aggregation PCA…

Methodology · Statistics 2025-04-14 Wu Su , Yumou Qiu

Finding sparse solutions of underdetermined systems of linear equations is a fundamental problem in signal processing and statistics which has become a subject of interest in recent years. In general, these systems have infinitely many…

Machine Learning · Statistics 2010-09-21 Arash Ali Amini , Massoud Babaie-Zadeh , Christian Jutten

In this paper, we establish a connection between the recently developed data-driven time-frequency analysis \cite{HS11,HS13-1} and the classical second order differential equations. The main idea of the data-driven time-frequency analysis…

Information Theory · Computer Science 2013-12-03 T. Y. Hou , Z. Shi , P. Tavallali

A class of distributed optimization problem with a globally coupled equality constraint and local constrained sets is studied in this paper. For its special case where local constrained sets are absent, an augmented primal-dual gradient…

Optimization and Control · Mathematics 2024-10-10 Jingwang Li , Housheng Su

We propose a novel convolutional neural network (CNN), called $\Psi$DONet, designed for learning pseudodifferential operators ($\Psi$DOs) in the context of linear inverse problems. Our starting point is the Iterative Soft Thresholding…

Optimization and Control · Mathematics 2020-06-03 Tatiana A. Bubba , Mathilde Galinier , Matti Lassas , Marco Prato , Luca Ratti , Samuli Siltanen

The choice of the sensing matrix is crucial in compressed sensing. Random Gaussian sensing matrices satisfy the restricted isometry property, which is crucial for solving the sparse recovery problem using convex optimization techniques.…

Signal Processing · Electrical Eng. & Systems 2023-12-29 Kartheek Kumar Reddy Nareddy , Abijith Jagannath Kamath , Chandra Sekhar Seelamantula

Modern compression algorithms exploit complex structures that are present in signals to describe them very efficiently. On the other hand, the field of compressed sensing is built upon the observation that "structured" signals can be…

Information Theory · Computer Science 2016-01-08 Farideh Ebrahim Rezagah , Shirin Jalali , Elza Erkip , H. Vincent Poor

We consider the extensively studied problem of $\ell_2/\ell_2$ compressed sensing. The main contribution of our work is an improvement over [Gilbert, Li, Porat and Strauss, STOC 2010] with faster decoding time and significantly smaller…

Data Structures and Algorithms · Computer Science 2019-03-08 Vasileios Nakos , Zhao Song

The linear inverse problem emerges from various real-world applications such as Image deblurring, inpainting, etc., which are still thrust research areas for image quality improvement. In this paper, we have introduced a new algorithm…

Signal Processing · Electrical Eng. & Systems 2022-11-29 Avinash Kumar , Sujit Kumar Sahoo

This short note studies a variation of the Compressed Sensing paradigm introduced recently by Vaswani et al., i.e. the recovery of sparse signals from a certain number of linear measurements when the signal support is partially known. The…

Information Theory · Computer Science 2010-02-21 Laurent Jacques

Time-frequency distributions (TFDs) play a vital role in providing descriptive analysis of non-stationary signals involved in realistic scenarios. It is well known that low time-frequency (TF) resolution and the emergency of cross-terms…

Signal Processing · Electrical Eng. & Systems 2020-05-01 Lei Jiang , Haijian Zhang , Lei Yu

High order momentum-based parameter update algorithms have seen widespread applications in training machine learning models. Recently, connections with variational approaches have led to the derivation of new learning algorithms with…

Optimization and Control · Mathematics 2021-06-08 Joseph E. Gaudio , Anuradha M. Annaswamy , José M. Moreu , Michael A. Bolender , Travis E. Gibson