English
Related papers

Related papers: An Efficient and Globally Convergent Algorithm for…

200 papers

Recent advances in stochastic optimization have yielded the interacting particle Langevin algorithm (IPLA), which leverages the notion of interacting particle systems (IPS) to efficiently sample from approximate posterior densities. This…

Probability · Mathematics 2025-06-04 Tim Johnston , Nikolaos Makras , Sotirios Sabanis

In this paper we consider under-determined systems of linear equations that have sparse solutions. This subject attracted enormous amount of interest in recent years primarily due to influential works \cite{CRT,DonohoPol}. In a statistical…

Information Theory · Computer Science 2013-04-01 Mihailo Stojnic

In genomic analysis, biomarker discovery, image recognition, and other systems involving machine learning, input variables can often be organized into different groups by their source or semantic category. Eliminating some groups of…

Machine Learning · Computer Science 2019-12-02 Beibin Li , Nicholas Nuechterlein , Erin Barney , Caitlin Hudac , Pamela Ventola , Linda Shapiro , Frederick Shic

We apply the OSCAR (octagonal selection and clustering algorithms for regression) in recovering group-sparse matrices (two-dimensional---2D---arrays) from compressive measurements. We propose a 2D version of OSCAR (2OSCAR) consisting of the…

Machine Learning · Computer Science 2014-02-21 Xiangrong Zeng , Mário A. T. Figueiredo

Sparse graphs built by sparse representation has been demonstrated to be effective in clustering high-dimensional data. Albeit the compelling empirical performance, the vanilla sparse graph ignores the geometric information of the data by…

Machine Learning · Computer Science 2024-09-26 Dongfang Sun , Yingzhen Yang

We introduce and study the Group Square-Root Lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty…

Statistics Theory · Mathematics 2013-08-01 Florentina Bunea , Johannes Lederer , Yiyuan She

We show that the $A$-optimal design optimization problem over $m$ design points in $\mathbb{R}^n$ is equivalent to minimizing a quadratic function plus a group lasso sparsity inducing term over $n\times m$ real matrices. This observation…

Optimization and Control · Mathematics 2018-09-07 Guillaume Sagnol , Edouard Pauwels

Sparse representation is considered as a viable solution to visual tracking. In this paper, we propose a structured group local sparse tracker (SGLST), which exploits local patches inside target candidates in the particle filter framework.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Mohammadreza Javanmardi , Xiaojun Qi

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

The Group-Lasso is a well-known tool for joint regularization in machine learning methods. While the l_{1,2} and the l_{1,\infty} version have been studied in detail and efficient algorithms exist, there are still open questions regarding…

Machine Learning · Computer Science 2012-06-22 Julia Vogt , Volker Roth

We study sparsity in the max-plus algebraic setting. We seek both exact and approximate solutions of the max-plus linear equation with minimum cardinality of support. In the former case, the sparsest solution problem is shown to be…

Optimization and Control · Mathematics 2019-06-05 Anastasios Tsiamis , Petros Maragos

In $\ell^1$-regularization, which is an important tool in signal and image processing, one usually is concerned with signals and images having a sparse representation in some suitable basis, e.g. in a wavelet basis. Many results on…

Optimization and Control · Mathematics 2018-09-28 Jens Flemming , Bernd Hofmann , Ivan Veselic

There is a recent surge of interest in developing algorithms for finding sparse solutions of underdetermined systems of linear equations $y = \Phi x$. In many applications, extremely large problem sizes are envisioned, with at least tens of…

Information Theory · Computer Science 2009-04-08 Arian Maleki

Iteratively reweighted least square (IRLS) is a popular approach to solve sparsity-enforcing regression problems in machine learning. State of the art approaches are more efficient but typically rely on specific coordinate pruning schemes.…

Machine Learning · Statistics 2022-10-03 Clarice Poon , Gabriel Peyré

Polynomial optimization problems are infinite-dimensional, nonconvex, NP-hard, and are often handled in practice with the moment-sums of squares hierarchy of semidefinite programming bounds. We consider problems where the objective function…

Optimization and Control · Mathematics 2025-11-25 Igor Klep , Victor Magron , Tobias Metzlaff , Jie Wang

Group sparse representation has shown promising results in image debulrring and image inpainting in GSR [3] , the main reason that lead to the success is by exploiting Sparsity and Nonlocal self-similarity (NSS) between patches on natural…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Luoyu Chen , Fei Wu

This article introduces the sparse group fused lasso (SGFL) as a statistical framework for segmenting sparse regression models with multivariate time series. To compute solutions of the SGFL, a nonsmooth and nonseparable convex program, we…

Computation · Statistics 2020-10-09 David Degras

This paper introduces new solvers for efficiently computing solutions to large-scale inverse problems with group sparsity regularization, including both non-overlapping and overlapping groups. Group sparsity regularization refers to a type…

Numerical Analysis · Mathematics 2023-06-16 Julianne Chung , Malena Sabaté Landman

We show convergence rates for a sparse grid approximation of the distribution of solutions of the stochastic Landau-Lifshitz-Gilbert equation. Beyond being a frequently studied equation in engineering and physics, the stochastic…

Numerical Analysis · Mathematics 2025-06-02 Xin An , Josef Dick , Michael Feischl , Andrea Scaglioni , Thanh Tran

Sparse Partial Least Squares (sPLS) is a common dimensionality reduction technique for data fusion, which projects data samples from two views by seeking linear combinations with a small number of variables with the maximum variance.…

Machine Learning · Computer Science 2023-08-15 Wenwen Min , Taosheng Xu , Chris Ding