English
Related papers

Related papers: Constructing test instances for Basis Pursuit Deno…

200 papers

This thesis presents two similarity-based approaches to sparse data problems. The first approach is to build soft, hierarchical clusters: soft, because each event belongs to each cluster with some probability; hierarchical, because cluster…

cmp-lg · Computer Science 2008-02-03 Lillian Lee

The sparsity constrained rank-one matrix approximation problem is a difficult mathematical optimization problem which arises in a wide array of useful applications in engineering, machine learning and statistics, and the design of…

Optimization and Control · Mathematics 2012-06-27 Ronny Luss , Marc Teboulle

Regularization is used in many different areas of optimization when solutions are sought which not only minimize a given function, but also possess a certain degree of regularity. Popular applications are image denoising, sparse regression…

Optimization and Control · Mathematics 2021-11-15 Bennet Gebken , Katharina Bieker , Sebastian Peitz

In this paper, we discuss application of iterative Stochastic Optimization routines to the problem of sparse signal recovery from noisy observation. Using Stochastic Mirror Descent algorithm as a building block, we develop a multistage…

Machine Learning · Statistics 2022-03-31 Anatoli Juditsky , Andrei Kulunchakov , Hlib Tsyntseus

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

Learning-based denoising algorithms achieve state-of-the-art performance across various denoising tasks. However, training such models relies on access to large training datasets consisting of clean and noisy image pairs. On the other hand,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Ali Zafari , Xi Chen , Shirin Jalali

This work treats the recovery of sparse, binary signals through box-constrained basis pursuit using biased measurement matrices. Using a probabilistic model, we provide conditions under which the recovery of both sparse and saturated binary…

Numerical Analysis · Mathematics 2018-01-11 Axel Flinth , Sandra Keiper

Sparse modeling is a powerful framework for data analysis and processing. Traditionally, encoding in this framework is performed by solving an L1-regularized linear regression problem, commonly referred to as Lasso or Basis Pursuit. In this…

Machine Learning · Statistics 2015-05-19 Pablo Sprechmann , Ignacio Ramírez , Guillermo Sapiro , Yonina Eldar

Supervised training for real-world denoising presents challenges due to the difficulty of collecting large datasets of paired noisy and clean images. Recent methods have attempted to address this by utilizing unpaired datasets of clean and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

The sparse group Lasso is a widely used statistical model which encourages the sparsity both on a group and within the group level. In this paper, we develop an efficient augmented Lagrangian method for large-scale non-overlapping sparse…

Optimization and Control · Mathematics 2020-10-23 Yangjing Zhang , Ning Zhang , Defeng Sun , Kim-Chuan Toh

We study the problem of recovering the latent ground truth labeling of a structured instance with categorical random variables in the presence of noisy observations. We present a new approximate algorithm for graphs with categorical…

Machine Learning · Computer Science 2019-07-09 Alireza Heidari , Ihab F. Ilyas , Theodoros Rekatsinas

Parsimonious representations are ubiquitous in modeling and processing information. Motivated by the recent Multi-Layer Convolutional Sparse Coding (ML-CSC) model, we herein generalize the traditional Basis Pursuit problem to a multi-layer…

Machine Learning · Computer Science 2018-11-22 Jeremias Sulam , Aviad Aberdam , Amir Beck , Michael Elad

We develop a (nearly) unbiased particle filtering algorithm for a specific class of continuous-time state-space models, such that (a) the latent process $X_t$ is a linear Gaussian diffusion; and (b) the observations arise from a Poisson…

Computation · Statistics 2023-11-07 Ruiyang Jin , Sumeetpal S. Singh , Nicolas Chopin

Regularization by the sum of singular values, also referred to as the trace norm, is a popular technique for estimating low rank rectangular matrices. In this paper, we extend some of the consistency results of the Lasso to provide…

Machine Learning · Computer Science 2007-10-16 Francis Bach

This paper adapts a popular image quality measure called structural similarity for high precision registration based tracking while also introducing a simpler and faster variant of the same. Further, these are evaluated comprehensively…

Computer Vision and Pattern Recognition · Computer Science 2017-01-31 Abhineet Singh , Mennatullah Siam , Martin Jagersand

Enhancing the visibility in extreme low-light environments is a challenging task. Under nearly lightless condition, existing image denoising methods could easily break down due to significantly low SNR. In this paper, we systematically…

Image and Video Processing · Electrical Eng. & Systems 2021-08-05 Kaixuan Wei , Ying Fu , Yinqiang Zheng , Jiaolong Yang

This paper addresses the problem of identifying sparse linear time-invariant (LTI) systems from a single sample trajectory generated by the system dynamics. We introduce a Lasso-like estimator for the parameters of the system, taking into…

Systems and Control · Computer Science 2019-04-23 Salar Fattahi , Nikolai Matni , Somayeh Sojoudi

Imitation learning has emerged as a promising approach for addressing sequential decision-making problems, with the assumption that expert demonstrations are optimal. However, in real-world scenarios, most demonstrations are often…

Machine Learning · Computer Science 2024-08-07 Yunke Wang , Minjing Dong , Yukun Zhao , Bo Du , Chang Xu

We formulate the sparse classification problem of $n$ samples with $p$ features as a binary convex optimization problem and propose a cutting-plane algorithm to solve it exactly. For sparse logistic regression and sparse SVM, our algorithm…

Optimization and Control · Mathematics 2025-01-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

The success of diffusion models has driven interest in performing conditional sampling via training-free guidance of the denoising process to solve image restoration and other inverse problems. A popular class of methods, based on Diffusion…

Machine Learning · Statistics 2025-06-17 Gregory Bellchambers