English
Related papers

Related papers: A Decoupled Approach for Composite Sparse-plus-Smo…

200 papers

The L1 norm regularized least squares method is often used for finding sparse approximate solutions and is widely used in 1-D signal restoration. Basis pursuit denoising (BPD) performs noise reduction in this way. However, the shortcoming…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Nantheera Anantrasirichai , Rencheng Zheng , Ivan Selesnick , Alin Achim

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

Finding an informative subset of a large collection of data points or models is at the center of many problems in computer vision, recommender systems, bio/health informatics as well as image and natural language processing. Given pairwise…

Machine Learning · Computer Science 2016-04-12 Ehsan Elhamifar , Guillermo Sapiro , S. Shankar Sastry

In imaging modalities recording diffraction data, the original image can be reconstructed assuming known phases. When phases are unknown, oversampling and a constraint on the support region in the original object can be used to solve a…

Signal Processing · Electrical Eng. & Systems 2018-10-17 Alberto Pietrini , Carl Nettelblad

This work addresses the recovery and demixing problem of signals that are sparse in some general dictionary. Involved applications include source separation, image inpainting, super-resolution, and restoration of signals corrupted by…

Information Theory · Computer Science 2017-03-24 Fei Wen , Lasith Adhikari , Ling Pei , Roummel F. Marcia , Peilin Liu , Robert C. Qiu

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

Numerical Analysis · Mathematics 2016-12-30 Sergey Voronin , Ingrid Daubechies

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

Renormalized homotopy continuation on toric varieties is introduced as a tool for solving sparse systems of polynomial equations, or sparse systems of exponential sums. The cost of continuation depends on a renormalized condition length,…

Numerical Analysis · Mathematics 2025-06-23 Gregorio Malajovich

The task of finding a sparse signal decomposition in an overcomplete dictionary is made more complicated when the signal undergoes an unknown modulation (or convolution in the complementary Fourier domain). Such simultaneous sparse recovery…

Information Theory · Computer Science 2019-10-02 Youye Xie , Michael B. Wakin , Gongguo Tang

With the availability of extraordinarily huge data sets, solving the problems of distributed statistical methodology and computing for such data sets has become increasingly crucial in the big data area. In this paper, we focus on the…

Machine Learning · Statistics 2023-10-24 Yue Chao , Lei Huang , Xuejun Ma

A fruitful approach for solving signal deconvolution problems consists of resorting to a frame-based convex variational formulation. In this context, parallel proximal algorithms and related alternating direction methods of multipliers have…

Other Computer Science · Computer Science 2015-05-28 Nelly Pustelnik , Jean-Christophe Pesquet , Caroline Chaux

The sparse generalized eigenvalue problem arises in a number of standard and modern statistical learning models, including sparse principal component analysis, sparse Fisher discriminant analysis, and sparse canonical correlation analysis.…

Numerical Analysis · Computer Science 2019-03-05 Ganzhao Yuan , Li Shen , Wei-Shi Zheng

This paper develops a general framework for solving a variety of convex cone problems that frequently arise in signal processing, machine learning, statistics, and other fields. The approach works as follows: first, determine a conic…

Optimization and Control · Mathematics 2011-12-20 Stephen R. Becker , Emmanuel J. Candès , Michael Grant

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

This paper studies distributed convex optimization with both affine equality and nonlinear inequality couplings through the duality analysis. We first formulate the dual of the coupling-constraint problem and reformulate it as a consensus…

Optimization and Control · Mathematics 2025-12-05 Chenyang Qiu , Yangyang Qian , Zongli Lin , Yacov A. Shamash

We consider the constrained Linear Inverse Problem (LIP), where a certain atomic norm (like the $\ell_1 $ norm) is minimized subject to a quadratic constraint. Typically, such cost functions are non-differentiable, which makes them not…

Optimization and Control · Mathematics 2025-07-08 Mohammed Rayyan Sheriff , Floor Fenne Redel , Peyman Mohajerin Esfahani

Within the statistical and machine learning literature, regularization techniques are often used to construct sparse (predictive) models. Most regularization strategies only work for data where all predictors are treated identically, such…

Computation · Statistics 2020-12-16 Sander Devriendt , Katrien Antonio , Tom Reynkens , Roel Verbelen

Sparse matrices are favorable objects in machine learning and optimization. When such matrices are used, in place of dense ones, the overall complexity requirements in optimization can be significantly reduced in practice, both in terms of…

Information Theory · Computer Science 2016-04-05 Anastasios Kyrillidis , Bubacarr Bah , Rouzbeh Hasheminezhad , Quoc Tran-Dinh , Luca Baldassarre , Volkan Cevher

We consider mixed-integer optimal control problems with combinatorial constraints that couple over time such as minimum dwell times. We analyze a lifting and decomposition approach into a mixed-integer optimal control problem without…

Optimization and Control · Mathematics 2021-04-21 Simone Göttlich , Falk M. Hante , Andreas Potschka , Lars Schewe

We propose a new decomposition framework for continuous nonlinear constrained two-stage optimization, where both first- and second-stage problems can be nonconvex. A smoothing technique based on an interior-point formulation renders the…

Optimization and Control · Mathematics 2026-03-02 Yuchen Lou , Xinyi Luo , Andreas Wächter , Ermin Wei