English
Related papers

Related papers: Orbital minimization method with $\ell^1$ regulari…

200 papers

The transformed $l_1$ penalty (TL1) functions are a one parameter family of bilinear transformations composed with the absolute value function. When acting on vectors, the TL1 penalty interpolates $l_0$ and $l_1$ similar to $l_p$ norm ($p…

Information Theory · Computer Science 2016-10-19 Shuai Zhang , Jack Xin

This paper considers the minimization of a continuously differentiable function over a cardinality constraint. We focus on smooth and relatively smooth functions. These smoothness criteria result in new descent lemmas. Based on the new…

Optimization and Control · Mathematics 2024-09-26 Fatih Selim Aktas , Mustafa Celebi Pinar

Compressed sensing aims at reconstructing sparse signals from significantly reduced number of samples, and a popular reconstruction approach is $\ell_1$-norm minimization. In this correspondence, a method called orthonormal expansion is…

Information Theory · Computer Science 2015-05-30 Zai Yang , Cishen Zhang , Jun Deng , Wenmiao Lu

We investigate the numerical approximation of an elliptic optimal control problem which involves a nonconvex local regularization of the $L^q$-quasinorm penalization (with $q\in(0,1)$) in the cost function. Our approach is based on the…

Optimization and Control · Mathematics 2022-09-26 Pedro Merino , Alexander Nenjer

We study the robustness properties of $\ell_1$ norm minimization for the classical linear regression problem with a given design matrix and contamination restricted to the dependent variable. We perform a fine error analysis of the $\ell_1$…

Optimization and Control · Mathematics 2014-02-26 Salvador Flores , Luis M. Briceno-Arias

We consider the nonconvex minimization problem, with quartic objective function, that arises in the exact recovery of a configuration matrix $P\in \R^{nd}$ of $n$ points when a Euclidean distance matrix, \EDMp, is given with embedding…

Optimization and Control · Mathematics 2025-07-29 Mengmeng Song , Douglas Goncalves , Woosuk L. Jung , Carlile Lavor , Antonio Mucherino , Henry Wolkowicz

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

We consider minimization of functions that are compositions of convex or prox-regular functions (possibly extended-valued) with smooth vector functions. A wide variety of important optimization problems fall into this framework. We describe…

Optimization and Control · Mathematics 2015-04-24 A. S. Lewis , S. J. Wright

The de-facto standard approach of promoting sparsity by means of $\ell_1$-regularization becomes ineffective in the presence of simplex constraints, i.e.,~the target is known to have non-negative entries summing up to a given constant. The…

Methodology · Statistics 2016-05-04 Ping Li , Syama Sundar Rangapuram , Martin Slawski

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

We propose an iterative algorithm for the minimization of a $\ell_1$-norm penalized least squares functional, under additional linear constraints. The algorithm is fully explicit: it uses only matrix multiplications with the three matrices…

Numerical Analysis · Mathematics 2012-02-16 Ignace Loris , Caroline Verhoeven

Let $\Omega\in\mathbb{R}^n$ be the region occupied by a body and let $\mathbf{x}_0$ be a flaw point in $\Omega$. Let $E(\cdot)$ be an energy functional (defined on some appropriate admissible set of deformations of $\Omega$). For $V>0$…

Numerical Analysis · Mathematics 2016-03-23 Pablo V. Negrón-Marrero , Jeyabal Sivaloganathan

We consider the optimization problem of minimizing $\int_{\Omega}G(|\nabla u|) dx$ in the class of functions $W^{1,G}(\Omega)$, with a constrain on the volume of $\{u>0\}$. The conditions on the function $G$ allow for a different behavior…

Analysis of PDEs · Mathematics 2015-05-13 Sandra Martinez

This paper studies smoothing properties of the local fractional maximal operator, which is defined in a proper subdomain of the Euclidean space. We prove new pointwise estimates for the weak gradient of the maximal function, which imply…

Functional Analysis · Mathematics 2015-06-17 Toni Heikkinen , Juha Kinnunen , Janne Korvenpää , Heli Tuominen

A new algorithm is presented for solving the soft-margin Support Vector Machine (SVM) optimization problem with an $\ell^{1}$ penalty. This algorithm is designed to require a modest number of passes over the data, which is an important…

Optimization and Control · Mathematics 2018-08-23 Jeffrey Hajewski , Suely Oliveira , David E. Stewart

A new algorithm for one-dimensional minimization is described in detail and the results of some tests on practical cases are reported and illustrated. The method requires only punctual computation of the function, and is suitable to be…

Optimization and Control · Mathematics 2017-08-24 Glauco Masotti

This paper presents a particle-based optimization method designed for addressing minimization problems with equality constraints, particularly in cases where the loss function exhibits non-differentiability or non-convexity. The proposed…

Optimization and Control · Mathematics 2026-03-31 José A. Carrillo , Shi Jin , Haoyu Zhang , Yuhua Zhu

An adaptive regularization algorithm using inexact function and derivatives evaluations is proposed for the solution of composite nonsmooth nonconvex optimization. It is shown that this algorithm needs at most…

Optimization and Control · Mathematics 2019-02-28 S. Gratton , E. Simon , Ph. L. Toint

The full-dimensional (metric, Euclidean, least squares) multidimensional scaling stress loss function is combined with a quadratic external penalty function term. The trajectory of minimizers of stress for increasing values of the penalty…

Computation · Statistics 2024-07-24 Jan de Leeuw