English
Related papers

Related papers: Restricted normal cones and sparsity optimization …

200 papers

The method of alternating projections (MAP) is a common method for solving feasibility problems. While employed traditionally to subspaces or to convex sets, little was known about the behavior of the MAP in the nonconvex case until 2009,…

Functional Analysis · Mathematics 2012-05-03 Heinz H. Bauschke , D. Russell Luke , Hung M. Phan , Xianfu Wang

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

Optimization and Control · Mathematics 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

The Method of Alternating Projections (MAP), a classical algorithm for solving feasibility prob- lems, has recently been intensely studied for nonconvex sets. However, intrinsically available are only local convergence results: convergence…

Optimization and Control · Mathematics 2013-05-21 Heinz H. Bauschke , Hung M. Phan , Xianfu Wang

This paper considers the problem of recovering either a low rank matrix or a sparse vector from observations of linear combinations of the vector or matrix elements. Recent methods replace the non-convex regularization with $\ell_1$ or…

Optimization and Control · Mathematics 2017-03-22 Carl Olsson , Marcus Carlsson , Fredrik Andersson , Viktor Larsson

We consider projection algorithms for solving (nonconvex) feasibility problems in Euclidean spaces. Of special interest are the Method of Alternating Projections (MAP) and the Douglas-Rachford or Averaged Alternating Reflection Algorithm…

Optimization and Control · Mathematics 2014-03-17 Robert Hesse , D. Russell Luke

For the general problem of minimizing a convex function over a compact convex domain, we will investigate a simple iterative approximation algorithm based on the method by Frank & Wolfe 1956, that does not need projection steps in order to…

Optimization and Control · Mathematics 2011-12-30 Martin Jaggi

The affine rank minimization problem consists of finding a matrix of minimum rank that satisfies a given system of linear equality constraints. Such problems have appeared in the literature of a diverse set of fields including system…

Optimization and Control · Mathematics 2010-08-09 Benjamin Recht , Maryam Fazel , Pablo A. Parrilo

The problem of finding the sparsest vector (direction) in a low dimensional subspace can be considered as a homogeneous variant of the sparse recovery problem, which finds applications in robust subspace recovery, dictionary learning,…

Machine Learning · Computer Science 2020-01-22 Qing Qu , Zhihui Zhu , Xiao Li , Manolis C. Tsakiris , John Wright , René Vidal

We present an analysis of sets of matrices with rank less than or equal to a specified number $s$. We provide a simple formula for the normal cone to such sets, and use this to show that these sets are prox-regular at all points with rank…

Optimization and Control · Mathematics 2018-09-24 D. Russell Luke

Many practical applications such as gene expression analysis, multi-task learning, image recognition, signal processing, and medical data analysis pursue a sparse solution for the feature selection purpose and particularly favor the…

Machine Learning · Statistics 2015-10-28 Yijun Huang , Ji Liu

We propose a framework for modeling and solving low-rank optimization problems to certifiable optimality. We introduce symmetric projection matrices that satisfy $Y^2=Y$, the matrix analog of binary variables that satisfy $z^2=z$, to model…

Optimization and Control · Mathematics 2021-12-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

In this paper, we propose a convergent parallel best-response algorithm with the exact line search for the nondifferentiable nonconvex sparsity-regularized rank minimization problem. On the one hand, it exhibits a faster convergence than…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-15 Yang Yang , Marius Pesavento

The goal of Sparse Convex Optimization is to optimize a convex function $f$ under a sparsity constraint $s\leq s^*\gamma$, where $s^*$ is the target number of non-zero entries in a feasible solution (sparsity) and $\gamma\geq 1$ is an…

Machine Learning · Computer Science 2020-06-26 Kyriakos Axiotis , Maxim Sviridenko

Nonconvex sparse models have received significant attention in high-dimensional machine learning. In this paper, we study a new model consisting of a general convex or nonconvex objectives and a variety of continuous nonconvex…

Optimization and Control · Mathematics 2020-10-26 Digvijay Boob , Qi Deng , Guanghui Lan , Yilin Wang

In many safety-critical settings, probabilistic ML systems have to make predictions subject to algebraic constraints, e.g., predicting the most likely trajectory that does not cross obstacles. These real-world constraints are rarely convex,…

Machine Learning · Computer Science 2026-02-11 Leander Kurscheidt , Gabriele Masina , Roberto Sebastiani , Antonio Vergari

In this paper, we consider the optimization problem of minimizing a continuously differentiable function subject to both convex constraints and sparsity constraints. By exploiting a mixed-integer reformulation from the literature, we define…

Optimization and Control · Mathematics 2021-04-28 M. Lapucci , T. Levato , F. Rinaldi , M. Sciandrone

A geometric nonconvex conic optimization problem (COP) was recently proposed by Kim, Kojima and Toh as a unified framework for convex conic reformulation of a class of quadratic optimization problems and polynomial optimization problems.…

Optimization and Control · Mathematics 2024-09-11 Naohiko Arima , Sunyoung Kim , Masakazu Kojima

Motivated by modern regression applications, in this paper, we study the convexification of a class of convex optimization problems with indicator variables and combinatorial constraints on the indicators. Unlike most of the previous work…

Optimization and Control · Mathematics 2021-06-17 Linchuan Wei , Andres Gomez , Simge Kucukyavuz

This paper combines two ingredients in order to get a rather surprising result on one of the most studied, elegant and powerful tools for solving convex feasibility problems, the method of alternating projections (MAP). Going back to names…

Optimization and Control · Mathematics 2021-11-11 Roger Behling , Yunier Bello-Cruz , Luiz-Rafael Santos

We focus on finding sparse and least-$\ell_1$-norm solutions for unconstrained nonlinear optimal control problems. Such optimization problems are non-convex and non-smooth, nevertheless recent versions of Newton method for under-determined…

Optimization and Control · Mathematics 2019-08-28 Boris Polyak , Andrey Tremba
‹ Prev 1 2 3 10 Next ›