English
Related papers

Related papers: Using the Eigenvalue Relaxation for Binary Least-S…

200 papers

A sparse linear programming (SLP) problem is a linear programming problem equipped with a sparsity (or cardinality) constraint, which is nonconvex and discontinuous theoretically and generally NP-hard computationally due to the…

Optimization and Control · Mathematics 2018-06-05 Chen Zhao , Ziyan Luo , Weiyue Li , Houduo Qi , Naihua Xiu

A major challenge in single particle reconstruction from cryo-electron microscopy is to establish a reliable ab-initio three-dimensional model using two-dimensional projection images with unknown orientations. Common-lines based methods…

Machine Learning · Computer Science 2013-04-11 Lanhui Wang , Amit Singer , Zaiwen Wen

Low-rank tensor approximation techniques attempt to mitigate the overwhelming complexity of linear algebra tasks arising from high-dimensional applications. In this work, we study the low-rank approximability of solutions to linear systems…

Numerical Analysis · Mathematics 2016-01-08 Daniel Kressner , André Uschmajew

A standard quadratic program is an optimization problem that consists of minimizing a (nonconvex) quadratic form over the unit simplex. We focus on reformulating a standard quadratic program as a mixed integer linear programming problem. We…

Optimization and Control · Mathematics 2018-10-05 Jacek Gondzio , E. Alper Yildirim

In this paper we explore the role of duality principles within the problem of rotation averaging, a fundamental task in a wide range of computer vision applications. In its conventional form, rotation averaging is stated as a minimization…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Anders Eriksson , Carl Olsson , Fredrik Kahl , Tat-Jun Chin

We consider a non-convex constrained Lagrangian formulation of a fundamental bi-criteria optimization problem for variable selection in statistical learning; the two criteria are a smooth (possibly) nonconvex loss function, measuring the…

Optimization and Control · Mathematics 2016-11-22 Ying Sun , Gesualdo Scutari

We propose a new bundle-based augmented Lagrangian framework for solving constrained convex problems. Unlike the classical (inexact) augmented Lagrangian method (ALM) that has a nested double-loop structure, our framework features a…

Optimization and Control · Mathematics 2025-02-14 Feng-Yi Liao , Yang Zheng

We consider a convex relaxation of sparse principal component analysis proposed by d'Aspremont et al. in (d'Aspremont et al. SIAM Rev 49:434-448, 2007). This convex relaxation is a nonsmooth semidefinite programming problem in which the…

Optimization and Control · Mathematics 2011-11-30 Shiqian Ma

Current bundle adjustment solvers such as the Levenberg-Marquardt (LM) algorithm are limited by the bottleneck in solving the Reduced Camera System (RCS) whose dimension is proportional to the camera number. When the problem is scaled up,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Lei Zhou , Zixin Luo , Mingmin Zhen , Tianwei Shen , Shiwei Li , Zhuofei Huang , Tian Fang , Long Quan

In this paper we provide a detailed analysis of the iteration complexity of dual first order methods for solving conic convex problems. When it is difficult to project on the primal feasible set described by convex constraints, we use the…

Optimization and Control · Mathematics 2015-03-16 Ion Necoara , Andrei Patrascu

We propose a novel spatially continuous framework for convex relaxations based on functional lifting. Our method can be interpreted as a sublabel-accurate solution to multilabel problems. We show that previously proposed functional lifting…

Computer Vision and Pattern Recognition · Computer Science 2015-12-07 Thomas Möllenhoff , Emanuel Laude , Michael Moeller , Jan Lellmann , Daniel Cremers

In this work, we focus on separable convex optimization problems with linear and box constraints and compute the solution in closed-form as a function of some Lagrange multipliers that can be easily computed in a finite number of…

Information Theory · Computer Science 2014-03-25 Antonio A. D'Amico , Luca Sanguinetti , Daniel P. Palomar

Nonlinear eigenvalue problems for pairs of homogeneous convex functions are particular nonlinear constrained optimization problems that arise in a variety of settings, including graph mining, machine learning, and network science. By…

Optimization and Control · Mathematics 2022-09-15 Francesco Tudisco , Dong Zhang

Due to its linear complexity, naive Bayes classification remains an attractive supervised learning method, especially in very large-scale settings. We propose a sparse version of naive Bayes, which can be used for feature selection. This…

Machine Learning · Computer Science 2025-03-13 Armin Askari , Alexandre d'Aspremont , Laurent El Ghaoui

With the widespread adoption of machine learning systems, the need to curtail their behavior has become increasingly apparent. This is evidenced by recent advancements towards developing models that satisfy robustness, safety, and fairness…

Machine Learning · Computer Science 2024-03-19 Juan Elenter , Luiz F. O. Chamon , Alejandro Ribeiro

Lagrangian Relaxation (LR) is a powerful technique for solving large-scale Mixed Integer Linear Programming (MILP), particularly those with decomposable structures, such as vehicle routing or unit commitment problems. By relaxing the…

Machine Learning · Statistics 2026-05-27 Tung Quoc Le , Anh Tuan Nguyen , Viet Anh Nguyen

The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity…

Optimization and Control · Mathematics 2025-01-10 Kaixiang Hu , Caixia Kou , Jianhua Yuan

The matrix low-rank approximation problem with additional convex constraints can find many applications and has been extensively studied before. However, this problem is shown to be nonconvex and NP-hard; most of the existing solutions are…

Numerical Analysis · Computer Science 2015-12-08 Ying Zhang

We focus on the minimization of the least square loss function either under a $k$-sparse constraint or with a sparse penalty term. Based on recent results, we reformulate the $\ell_0$ pseudo-norm exactly as a convex minimization problem by…

Optimization and Control · Mathematics 2019-03-07 Arne Bechensteen , Laure Blanc-Féraud , Gilles Aubert

Lagrangian relaxation has been used extensively in the design of approximation algorithms. This paper studies its strengths and limitations when applied to Partial Cover.

Data Structures and Algorithms · Computer Science 2007-12-27 Julián Mestre