English
Related papers

Related papers: Upper-bounding $\ell_1$-optimization sectional thr…

200 papers

We know that compressive sensing can establish stable sparse recovery results from highly undersampled data under a restricted isometry property condition. In reality, however, numerous problems are coherent, and vast majority conventional…

Optimization and Control · Mathematics 2021-11-25 Yanyun Ding , Haibin Zhang , Peili Li , Yunhai Xiao

$\ell_1$ regularization has been used for logistic regression to circumvent the overfitting and use the estimated sparse coefficient for feature selection. However, the challenge of such a regularization is that the $\ell_1$ norm is not…

Machine Learning · Computer Science 2021-05-13 Majid Mohammadi , Amir Ahooye Atashin , Damian A. Tamburri

We consider a numerical framework tailored to identifying optimal parameters in the context of modelling disease propagation. Our focus is on understanding the behaviour of optimisation algorithms for such problems, where the dynamics are…

Optimization and Control · Mathematics 2025-02-13 Andrés Miniguano-Trujillo , John W. Pearson , Benjamin D. Goddard

We present a general method for obtaining strong bounds for discrete optimization problems that is based on a concept of branching duality. It can be applied when no useful integer programming model is available, and we illustrate this with…

Data Structures and Algorithms · Computer Science 2019-08-22 J. G. Benade , J. N. Hooker

In the classical many normal means with different variances, we consider the situation when the observer is allowed to allocate the available measurement budget over the coordinates of the parameter of interest. The benchmark is the minimax…

Statistics Theory · Mathematics 2019-04-01 Eduard Belitser

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

The purpose of this paper is to prove local upper and lower bounds for weak solutions of semilinear elliptic equations of the form $-\Delta u= c u^p$, with $0<p<p_s=(d+2)/(d-2)$, defined on bounded domains of $\RR^d$, $d\ge 3$, without…

Analysis of PDEs · Mathematics 2012-01-30 Matteo Bonforte , Gabriele Grillo , Juan Luis Vazquez

We develop a highly scalable optimization method called "hierarchical group-thresholding" for solving a multi-task regression model with complex structured sparsity constraints on both input and output spaces. Despite the recent emergence…

Machine Learning · Statistics 2012-08-16 Seunghak Lee , Eric P. Xing

In this paper we propose a second--order method for solving \emph{linear composite sparse optimization problems} consisting of minimizing the sum of a differentiable (possibly nonconvex function) and a nondifferentiable convex term. The…

Optimization and Control · Mathematics 2021-02-15 Pedro Merino , Juan Carlos De Los Reyes

In this paper, we introduce a new nonlinear evolution partial differential equation for sparse deconvolution problems. The proposed PDE has the form of continuity equation that arises in various research areas, e.g. fluid dynamics and…

Optimization and Control · Mathematics 2011-04-04 Yu Mao , Bin Dong , Stanley Osher

We consider the problem of recovering a partially sparse solution of an underdetermined system of linear equations by minimizing the $\ell_1$-norm of the part of the solution vector which is known to be sparse. Such a problem is closely…

Information Theory · Computer Science 2013-04-11 Afonso S. Bandeira , Katya Scheinberg , Luis Nunes Vicente

Signomial programs (SPs) are optimization problems specified in terms of signomials, which are weighted sums of exponentials composed with linear functionals of a decision variable. SPs are non-convex optimization problems in general, and…

Optimization and Control · Mathematics 2014-09-29 Venkat Chandrasekaran , Parikshit Shah

We introduce a conceptual framework for numerically solving linear elliptic, parabolic, and hyperbolic PDEs on bounded, polytopal domains in euclidean spaces by deep neural networks. The PDEs are recast as minimization of a least-squares…

Numerical Analysis · Mathematics 2024-10-01 Joost A. A. Opschoor , Philipp C. Petersen , Christoph Schwab

Stochastic optimization algorithms update models with cheap per-iteration costs sequentially, which makes them amenable for large-scale data analysis. Such algorithms have been widely studied for structured sparse models where the sparsity…

Machine Learning · Computer Science 2019-05-10 Baojian Zhou , Feng Chen , Yiming Ying

We consider a class of $\ell_0$-regularized linear-quadratic (LQ) optimal control problems. This class of problems is obtained by augmenting a penalizing sparsity measure to the cost objective of the standard linear-quadratic regulator…

Optimization and Control · Mathematics 2015-07-31 MirSaleh Bahavarnia

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

Many uncertainty sets encountered in control systems analysis and design can be expressed in terms of semialgebraic sets, that is as the intersection of sets described by means of polynomial inequalities. Important examples are for instance…

Optimization and Control · Mathematics 2015-09-15 Fabrizio Dabbene , Didier Henrion , Constantino Lagoa

In sparse optimization, enforcing hard constraints using the $\ell_0$ pseudo-norm offers advantages like controlled sparsity compared to convex relaxations. However, many real-world applications demand not only sparsity constraints but also…

Optimization and Control · Mathematics 2025-06-12 William de Vazelhes , Xiao-Tong Yuan , Bin Gu

This paper investigates the problem of certifying optimality for sparse generalized linear models (GLMs), where sparsity is enforced through an $\ell_0$ cardinality constraint. While branch-and-bound (BnB) frameworks can certify optimality…

Machine Learning · Computer Science 2025-06-12 Jiachang Liu , Soroosh Shafiee , Andrea Lodi

The $\ell_1$-penalized method, or the Lasso, has emerged as an important tool for the analysis of large data sets. Many important results have been obtained for the Lasso in linear regression which have led to a deeper understanding of…

Machine Learning · Statistics 2011-12-30 Jian Huang , Cun-Hui Zhang