English
Related papers

Related papers: A Fully Sparse Implementation of a Primal-Dual Int…

200 papers

In contrast with many other convex optimization classes, state-of-the-art semidefinite programming solvers are yet unable to efficiently solve large scale instances. This work aims to reduce this scalability gap by proposing a novel…

Optimization and Control · Mathematics 2018-12-20 Mario Souto , Joaquim D. Garcia , Alvaro Veiga

We introduce a randomly extrapolated primal-dual coordinate descent method that adapts to sparsity of the data matrix and the favorable structures of the objective function. Our method updates only a subset of primal and dual variables with…

Optimization and Control · Mathematics 2020-07-14 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

This paper proposes a sparse regression strategy for discovery of ordinary differential equations from incomplete and noisy data. Inference is performed over both equation parameters and state variables using a statistically motivated…

Dynamical Systems · Mathematics 2026-02-18 Teddy Meissner , Karl Glasner

We consider primal-dual pairs of semidefinite programs and assume that they are ill-posed, i.e., both primal and dual are either weakly feasible or weakly infeasible. Under such circumstances, strong duality may break down and the primal…

Optimization and Control · Mathematics 2022-10-25 Takashi Tsuchiya , Bruno F. Lourenco , Masakazu Muramatsu , Takayuki Okuno

Sparse principal component analysis addresses the problem of finding a linear combination of the variables in a given data set with a sparse coefficients vector that maximizes the variability of the data. This model enhances the ability to…

Optimization and Control · Mathematics 2017-03-09 Amir Beck , Yakov Vaisbourd

We propose an efficient optimization algorithm for selecting a subset of training data to induce sparsity for Gaussian process regression. The algorithm estimates an inducing set and the hyperparameters using a single objective, either the…

Machine Learning · Computer Science 2013-11-12 Yanshuai Cao , Marcus A. Brubaker , David J. Fleet , Aaron Hertzmann

Solving semidefinite programs (SDP) in a short time is the key to managing various mathematical optimization problems. The matrix-completion primal-dual interior-point method (MC-PDIPM) extracts a sparse structure of input SDP by…

Optimization and Control · Mathematics 2014-05-27 Makoto Yamashita , Kazuhide Nakata

Random projection, a dimensionality reduction technique, has been found useful in recent years for reducing the size of optimization problems. In this paper, we explore the use of sparse sub-gaussian random projections to approximate…

Optimization and Control · Mathematics 2024-06-21 Monse Guedes-Ayala , Pierre-Louis Poirion , Lars Schewe , Akiko Takeda

A new relaxed variant of interior point method for low-rank semidefinite programming problems is proposed in this paper. The method is a step outside of the usual interior point framework. In anticipation to converging to a low-rank primal…

Numerical Analysis · Mathematics 2021-03-26 Stefania Bellavia , Jacek Gondzio , Margherita Porcelli

In this paper we develop a new approach to sparse principal component analysis (sparse PCA). We propose two single-unit and two block optimization formulations of the sparse PCA problem, aimed at extracting a single sparse dominant…

Optimization and Control · Mathematics 2008-12-01 Michel Journée , Yurii Nesterov , Peter Richtárik , Rodolphe Sepulchre

This paper develops a new storage-optimal algorithm that provably solves generic semidefinite programs (SDPs) in standard form. This method is particularly effective for weakly constrained SDPs. The key idea is to formulate an approximate…

Optimization and Control · Mathematics 2020-06-19 Lijun Ding , Alp Yurtsever , Volkan Cevher , Joel A. Tropp , Madeleine Udell

We propose a new algorithm for recovery of sparse signals from their compressively sensed samples. The proposed algorithm benefits from the strategy of gradual movement to estimate the positions of non-zero samples of sparse signal. We…

Information Theory · Computer Science 2012-04-04 Seyed Hossein Hosseini , Mahrokh G. Shayesteh

In this paper, we consider optimizing a smooth, convex, lower semicontinuous function in Riemannian space with constraints. To solve the problem, we first convert it to a dual problem and then propose a general primal-dual algorithm to…

Machine Learning · Computer Science 2020-05-20 Shijun Wang , Baocheng Zhu , Lintao Ma , Yuan Qi

We propose an efficient algorithm for sparse signal reconstruction problems. The proposed algorithm is an augmented Lagrangian method based on the dual sparse reconstruction problem. It is efficient when the number of unknown variables is…

Machine Learning · Statistics 2010-10-06 Ryota Tomioka , Masashi Sugiyama

We consider a convex relaxation of sparse principal component analysis proposed by d'Aspremont et al. in (d'Aspremont et al. SIAM Rev 49:434-448, 2007). This convex relaxation is a nonsmooth semidefinite programming problem in which the…

Optimization and Control · Mathematics 2011-11-30 Shiqian Ma

This paper deals with supervised classification and feature selection in high dimensional space. A classical approach is to project data on a low dimensional space and classify by minimizing an appropriate quadratic cost. A strict control…

Machine Learning · Computer Science 2019-12-02 Michel Barlaud , Antonin Chambolle , Jean-Baptiste Caillau

Given a sample covariance matrix, we examine the problem of maximizing the variance explained by a linear combination of the input variables while constraining the number of nonzero coefficients in this combination. This is known as sparse…

Artificial Intelligence · Computer Science 2011-11-10 Alexandre d'Aspremont , Francis Bach , Laurent El Ghaoui

A polynomial matrix inequality is a formula asserting that a polynomial matrix is positive semidefinite. Polynomial matrix optimization concerns minimizing the smallest eigenvalue of a symmetric polynomial matrix subject to a tuple of…

Optimization and Control · Mathematics 2025-06-06 Jared Miller , Jie Wang , Feng Guo

We propose a novel approximation hierarchy for cardinality-constrained, convex quadratic programs that exploits the rank-dominating eigenvectors of the quadratic matrix. Each level of approximation admits a min-max characterization whose…

Optimization and Control · Mathematics 2021-05-26 Robbie Vreugdenhil , Viet Anh Nguyen , Armin Eftekhari , Peyman Mohajerin Esfahani

This paper treats the problem of minimizing a general continuously differentiable function subject to sparsity constraints. We present and analyze several different optimality criteria which are based on the notions of stationarity and…

Information Theory · Computer Science 2012-03-22 Amir Beck , Yonina C. Eldar
‹ Prev 1 2 3 10 Next ›