English
Related papers

Related papers: Analysis vs. synthesis sparsity for $\alpha$-shear…

200 papers

Many classification approaches first represent a test sample using the training samples of all the classes. This collaborative representation is then used to label the test sample. It was a common belief that sparseness of the…

Computer Vision and Pattern Recognition · Computer Science 2015-12-01 Naveed Akhtar , Faisal Shafait , Ajmal Mian

In this work, we propose an adaptive sparse learning algorithm that can be applied to learn the physical processes and obtain a sparse representation of the solution given a large snapshot space. Assume that there is a rich class of…

Machine Learning · Computer Science 2022-07-26 Yating Wang , Wing Tat Leung , Guang Lin

A polynomial matrix inequality is a formula asserting that a polynomial matrix is positive semidefinite. Polynomial matrix optimization concerns minimizing the smallest eigenvalue of a symmetric polynomial matrix subject to a tuple of…

Optimization and Control · Mathematics 2025-06-06 Jared Miller , Jie Wang , Feng Guo

Sparse linear (or generalized linear) models combine a standard likelihood function with a sparse prior on the unknown coefficients. These priors can conveniently be expressed as a maximization over zero-mean Gaussians with different…

Machine Learning · Statistics 2012-07-11 David Wipf , Yi Wu

We discuss a novel sparsity prior for compressive imaging in the context of the theory of compressed sensing with coherent redundant dictionaries, based on the observation that natural images exhibit strong average sparsity over multiple…

Information Theory · Computer Science 2013-05-03 Rafael E. Carrillo , Jason D. McEwen , Dimitri Van De Ville , Jean-Philippe Thiran , Yves Wiaux

We consider the problem of estimating the support of a vector $\beta^* \in \mathbb{R}^{p}$ based on observations contaminated by noise. A significant body of work has studied behavior of $\ell_1$-relaxations when applied to measurement…

Machine Learning · Statistics 2008-05-21 Dapo Omidiran , Martin J. Wainwright

Dataset condensation aims at reducing the network training effort through condensing a cumbersome training set into a compact synthetic one. State-of-the-art approaches largely rely on learning the synthetic data by matching the gradients…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Kai Wang , Bo Zhao , Xiangyu Peng , Zheng Zhu , Shuo Yang , Shuo Wang , Guan Huang , Hakan Bilen , Xinchao Wang , Yang You

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

Sparsity is a fundamental modeling principle in statistics, signal processing, and data science. However, optimization with sparsity constraints is notoriously difficult. We introduce a new convex relaxation framework for {sparse…

Optimization and Control · Mathematics 2026-03-20 Diego Cifuentes , Zhuorui Li

Compressive Sensing (CS) is a new technique for the efficient acquisition of signals, images, and other data that have a sparse representation in some basis, frame, or dictionary. By sparse we mean that the N-dimensional basis…

Information Theory · Computer Science 2015-05-18 Chinmay Hegde , Richard G. Baraniuk

The theory of compressive sensing (CS) asserts that an unknown signal $\mathbf{x} \in \mathbb{C}^N$ can be accurately recovered from $m$ measurements with $m\ll N$ provided that $\mathbf{x}$ is sparse. Most of the recovery algorithms need…

Methodology · Statistics 2017-10-12 Jianfeng Wang , Zhiyong Zhou , Anders Garpebring , Jun Yu

Given fruitful works in the image monitoring, there is a lack of data-driven tools guiding the practitioners to select proper monitoring procedures. The potential model mismatch caused by the arbitrary selection could deviate the empirical…

Methodology · Statistics 2023-10-03 Tingnan Gong

A new line of research uses compression methods to measure the similarity between signals. Two signals are considered similar if one can be compressed significantly when the information of the other is known. The existing compression-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Tanaya Guha , Rabab K. Ward

High-dimensional real-world systems can often be well characterized by a small number of simultaneous low-complexity interactions. The analysis of variance (ANOVA) decomposition and the anchored decomposition are typical techniques to find…

Numerical Analysis · Mathematics 2024-03-29 Fatima Antarou Ba , Oleh Melnyk , Christian Wald , Gabriele Steidl

It has been long known that sparsity is an effective inductive bias for learning efficient representation of data in vectors with fixed dimensionality, and it has been explored in many areas of representation learning. Of particular…

Computation and Language · Computer Science 2021-04-20 Victor Prokhorov , Yingzhen Li , Ehsan Shareghi , Nigel Collier

The state of the art in audio declipping has currently been achieved by SPADE (SParse Audio DEclipper) algorithm by Kiti\'c et al. Until now, the synthesis/sparse variant, S-SPADE, has been considered significantly slower than its…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Pavel Záviška , Pavel Rajmic , Zdeněk Průša , Vítězslav Veselý

In this work we are interested in the problems of supervised learning and variable selection when the input-output dependence is described by a nonlinear function depending on a few variables. Our goal is to consider a sparse nonparametric…

Machine Learning · Statistics 2012-08-14 Lorenzo Rosasco , Silvia Villa , Sofia Mosci , Matteo Santoro , Alessandro verri

Sparse arrays have emerged as a popular alternative to the conventional uniform linear array (ULA) due to the enhanced degrees of freedom (DOF) and superior resolution offered by them. In the passive setting, these advantages are realized…

Signal Processing · Electrical Eng. & Systems 2023-01-05 Pulak Sarangi , Mehmet Can Hucumenoglu , Robin Rajamaki , Piya Pal

We present the experimental reconstruction of sub-wavelength features from the far-field intensity of sparse optical objects: sparsity-based sub-wavelength imaging combined with phase-retrieval. As examples, we demonstrate the recovery of…

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao