English
Related papers

Related papers: Discrete Optimization Methods for Group Model Sele…

200 papers

Motivated by the question of optimal functional approximation via compressed sensing, we propose generalizations of the Iterative Hard Thresholding and the Compressive Sampling Matching Pursuit algorithms able to promote sparse in levels…

Information Theory · Computer Science 2021-11-01 Ben Adcock , Simone Brugiapaglia , Matthew King-Roskamp

We study convergence of the iterative projected gradient (IPG) algorithm for arbitrary (possibly nonconvex) sets and when both the gradient and projection oracles are computed approximately. We consider different notions of approximation of…

Information Theory · Computer Science 2017-06-02 Mohammad Golbabaee , Mike E. Davies

We propose an image restoration algorithm that can control the perceptual quality and/or the mean square error (MSE) of any pre-trained model, trading one over the other at test time. Our algorithm is few-shot: Given about a dozen images…

Artificial Intelligence · Computer Science 2024-08-13 Theo Adrai , Guy Ohayon , Tomer Michaeli , Michael Elad

This article aims to seek a selection and estimation procedure for a class of tensor regression problems with multivariate covariates and matrix responses, which can provide theoretical guarantees for model selection in finite samples.…

Statistics Theory · Mathematics 2023-10-10 Yang Chen , Ziyan Luo

Image recovery from compressive measurements requires a signal prior for the images being reconstructed. Recent work has explored the use of deep generative models with low latent dimension as signal priors for such problems. However, their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Niklas Smedemark-Margulies , Jung Yeon Park , Max Daniels , Rose Yu , Jan-Willem van de Meent , Paul Hand

Low-rank recovery builds upon ideas from the theory of compressive sensing, which predicts that sparse signals can be accurately reconstructed from incomplete measurements. Iterative thresholding-type algorithms-particularly the normalized…

Machine Learning · Computer Science 2025-07-08 Li Li , Yuneng Liang , Kaijie Zheng , Jian Lu

We consider the problem of sampling from a posterior distribution arising in Bayesian inverse problems in science, engineering, and imaging. Our method belongs to the family of independence Metropolis-Hastings (IMH) sampling algorithms,…

Machine Learning · Computer Science 2026-05-19 Youguang Chen , George Biros

In this work, we explore the problems of detecting the number of narrow-band, far-field targets and estimating their corresponding directions from single snapshot measurements. The principles of sparse signal recovery (SSR) are used for the…

Applications · Statistics 2017-05-23 Rakshith Jagannath

The standard approach to compressive sampling considers recovering an unknown deterministic signal with certain known structure, and designing the sub-sampling pattern and recovery algorithm based on the known structure. This approach…

Information Theory · Computer Science 2016-02-03 Yen-Huan Li , Volkan Cevher

Compressive sensing (CS) allows for acquisition of sparse signals at sampling rates significantly lower than the Nyquist rate required for bandlimited signals. Recovery guarantees for CS are generally derived based on the assumption that…

Information Theory · Computer Science 2014-10-22 Adam C. Polak , Marco F. Duarte , Dennis L. Goeckel

Compressive sensing is a technique to sample signals well below the Nyquist rate using linear measurement operators. In this paper we present an algorithm for signal reconstruction given such a set of measurements. This algorithm…

Information Theory · Computer Science 2009-06-08 Graeme Pope

Compressed Sensing aims to capture attributes of $k$-sparse signals using very few measurements. In the standard Compressed Sensing paradigm, the $\m\times \n$ measurement matrix $\A$ is required to act as a near isometry on the set of all…

Information Theory · Computer Science 2015-05-14 Robert Calderbank , Stephen Howard , Sina Jafarpour

Sparsity-constrained optimization underlies many problems in signal processing, statistics, and machine learning. State-of-the-art hard-thresholding (HT) algorithms rely on an appropriately selected continuous step-size parameter to ensure…

Machine Learning · Statistics 2026-05-13 Jin Zhu , Junxian Zhu , Zezhi Wang , Borui Tang , Hongmei Lin , Xueqin Wang

The estimation problem in a high regression model with structured sparsity is investigated. An algorithm using a two steps block thresholding procedure called GR-LOL is provided. Convergence rates are produced: they depend on simple…

Statistics Theory · Mathematics 2012-07-10 Mathilde Mougeot , Dominique Picard , Karine Tribouley

Compressive sensing is a signal acquisition framework based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable recovery. In this paper we introduce a new theory for…

Information Theory · Computer Science 2009-01-23 Dror Baron , Marco F. Duarte , Michael B. Wakin , Shriram Sarvotham , Richard G. Baraniuk

Various alignment problems arising in cryo-electron microscopy, community detection, time synchronization, computer vision, and other fields fall into a common framework of synchronization problems over compact groups such as Z/L, U(1), or…

Information Theory · Computer Science 2018-09-14 Amelia Perry , Alexander S. Wein , Afonso S. Bandeira , Ankur Moitra

The community detection problem for graphs asks one to partition the n vertices V of a graph G into k communities, or clusters, such that there are many intracluster edges and few intercluster edges. Of course this is equivalent to finding…

Information Theory · Computer Science 2018-08-21 Ming-Jun Lai , Daniel Mckenzie

This paper considers unconstrained convex optimization problems with time-varying objective functions. We propose algorithms with a discrete time-sampling scheme to find and track the solution trajectory based on prediction and correction…

Information Theory · Computer Science 2017-09-18 Andrea Simonetto , Aryan Mokhtari , Alec Koppel , Geert Leus , Alejandro Ribeiro

We consider the problem of compressed sensing and of (real-valued) phase retrieval with random measurement matrix. We derive sharp asymptotics for the information-theoretically optimal performance and for the best known polynomial algorithm…

Statistics Theory · Mathematics 2020-09-04 Benjamin Aubin , Bruno Loureiro , Antoine Baker , Florent Krzakala , Lenka Zdeborová

Community detection and orthogonal group synchronization are both fundamental problems with a variety of important applications in science and engineering. In this work, we consider the joint problem of community detection and orthogonal…

Machine Learning · Statistics 2022-09-19 Yifeng Fan , Yuehaw Khoo , Zhizhen Zhao