English
Related papers

Related papers: Sparse Cuts for the Positive Semidefinite Cone

200 papers

Semidefinite programming is an indispensable tool in computer vision, but general-purpose solvers for semidefinite programs are often too slow and memory intensive for large-scale problems. We propose a general framework to approximately…

Computer Vision and Pattern Recognition · Computer Science 2016-08-10 Sohil Shah , Abhay Kumar , Carlos Castillo , David Jacobs , Christoph Studer , Tom Goldstein

Estimating the leading principal components of data, assuming they are sparse, is a central task in modern high-dimensional statistics. Many algorithms were developed for this sparse PCA problem, from simple diagonal thresholding to…

Statistics Theory · Mathematics 2015-06-04 Robert Krauthgamer , Boaz Nadler , Dan Vilenchik

We explore some connections between association schemes and the analyses of the semidefinite programming (SDP) based convex relaxations of combinatorial optimization problems in the Lov\'{a}sz--Schrijver lift-and-project hierarchy. Our…

Combinatorics · Mathematics 2025-08-22 Yu Hin Au , Nathan Lindzey , Levent Tunçel

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

We propose a DC proximal Newton algorithm for solving nonconvex regularized sparse learning problems in high dimensions. Our proposed algorithm integrates the proximal Newton algorithm with multi-stage convex relaxation based on the…

Machine Learning · Statistics 2018-02-16 Xingguo Li , Lin F. Yang , Jason Ge , Jarvis Haupt , Tong Zhang , Tuo Zhao

The problem of sparse approximation and the closely related compressed sensing have received tremendous attention in the past decade. Primarily studied from the viewpoint of applied harmonic analysis and signal processing, there have been…

Information Theory · Computer Science 2018-10-23 Ali Çivril

We consider semidefinite programs (SDPs) of size n with equality constraints. In order to overcome scalability issues, Burer and Monteiro proposed a factorized approach based on optimizing over a matrix Y of size $n$ by $k$ such that $X =…

Machine Learning · Statistics 2018-11-29 Thomas Pumir , Samy Jelassi , Nicolas Boumal

Globally optimizing a nonconvex quadratic over the intersection of $m$ balls in $\mathbb{R}^n$ is known to be polynomial-time solvable for fixed $m$. Moreover, when $m=1$, the standard semidefinite relaxation is exact. When $m=2$, it has…

Optimization and Control · Mathematics 2023-10-31 Samuel Burer

The benefits of cutting planes based on the perspective function are well known for many specific classes of mixed-integer nonlinear programs with on/off structures. However, we are not aware of any empirical studies that evaluate their…

Optimization and Control · Mathematics 2021-03-18 Ksenia Bestuzheva , Ambros Gleixner , Stefan Vigerske

Most learning methods with rank or sparsity constraints use convex relaxations, which lead to optimization with the nuclear norm or the $\ell_1$-norm. However, several important learning applications cannot benefit from this approach as…

Machine Learning · Computer Science 2013-04-11 Anastasios Kyrillidis , Stephen Becker , Volkan Cevher and , Christoph Koch

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

We propose a method for low-rank semidefinite programming in application to the semidefinite relaxation of unconstrained binary quadratic problems. The method improves an existing solution of the semidefinite programming relaxation to…

Optimization and Control · Mathematics 2021-12-07 Roman Pogodin , Mikhail Krechetov , Yury Maximov

We introduce an innovative numerical technique based on convex optimization to solve a range of infinite dimensional variational problems arising from the application of the background method to fluid flows. In contrast to most existing…

Fluid Dynamics · Physics 2016-04-13 G. Fantuzzi , A. Wynn

This paper considers state-of-the-art convex relaxations for the AC power flow equations and introduces new valid cuts based on convex envelopes and lifted nonlinear constraints. These valid linear inequalities strengthen existing…

Optimization and Control · Mathematics 2016-01-06 Carleton Coffrin , Hassan Hijazi , Pascal Van Hentenryck

Let $\rm{Box}_n = \{x \in \mathbb{R}^n : 0 \leq x \leq e \}$, and let $\rm{QPB}_n$ denote the convex hull of $\{(1, x')'(1, x') : x \in \rm{Box}_n\}$. The quadratic programming problem $\min\{x'Q x + q'x : x \in \rm{Box}_n\}$ where $Q$ is…

Optimization and Control · Mathematics 2025-01-17 Kurt M. Anstreicher , Diane Puges

Semidefinite relaxations are a powerful tool for approximately solving combinatorial optimization problems such as MAX-CUT and the Grothendieck problem. By exploiting a bounded rank property of extreme points in the semidefinite cone, we…

Data Structures and Algorithms · Computer Science 2014-08-12 Roy Frostig , Sida I. Wang

We use convex relaxation techniques to produce lower bounds on the optimal value of subset selection problems and generate good approximate solutions. We then explicitly bound the quality of these relaxations by studying the approximation…

Optimization and Control · Mathematics 2010-06-21 Francis Bach , Selin Damla Ahipasaoglu , Alexandre d'Aspremont

We show {\it semidefinite programming} (SDP) feasibility problem is equivalent to solving a {\it convex hull relaxation} (CHR) for a finite system of quadratic equations. On the one hand, this offers a simple description of SDP. On the…

Optimization and Control · Mathematics 2020-08-18 Bahman Kalantari

Sparse additive modeling is a class of effective methods for performing high-dimensional nonparametric regression. In this work we show how shape constraints such as convexity/concavity and their extensions, can be integrated into additive…

Machine Learning · Computer Science 2017-05-03 Junming Yin , Yaoliang Yu

In this paper, we propose two algorithms for nonlinear semi-infinite semi-definite programs with infinitely many convex inequality constraints, called SISDP for short. A straightforward approach to the SISDP is to use classical methods for…

Optimization and Control · Mathematics 2018-10-02 Takayuki Okuno , Masao Fukushima