English
Related papers

Related papers: Using the Eigenvalue Relaxation for Binary Least-S…

200 papers

A wide array of image recovery problems can be abstracted into the problem of minimizing a sum of composite convex functions in a Hilbert space. To solve such problems, primal-dual proximal approaches have been developed which provide…

Optimization and Control · Mathematics 2014-06-23 Patrick L. Combettes , Laurent Condat , Jean-Christophe Pesquet , Bang Cong Vu

An earlier work [18] proposes a method for solving the Lagrangian dual of a constrained binary quadratic programming problem via quantum adiabatic evolution using an outer approximation method. This should be an efficient prescription for…

Optimization and Control · Mathematics 2019-01-07 Sahar Karimi , Pooya Ronagh

This paper presents the Lagrangian duality theory for mixed-integer semidefinite programming (MISDP). We derive the Lagrangian dual problem and prove that the resulting Lagrangian dual bound dominates the bound obtained from the continuous…

Optimization and Control · Mathematics 2025-07-10 Frank de Meijer , Renata Sotirov

In this paper, we study the extended trust region subproblem (eTRS) in which the trust region intersects the unit ball with a single linear inequality constraint. By reformulating the Lagrangian dual of eTRS as a two-parameter linear…

Optimization and Control · Mathematics 2015-10-29 Maziar Salahi , Akram Taati

A new algorithm for solving large-scale convex optimization problems with a separable objective function is proposed. The basic idea is to combine three techniques: Lagrangian dual decomposition, excessive gap and smoothing. The main…

Optimization and Control · Mathematics 2011-12-01 Tran Dinh Quoc , Carlo Savorgnan , Moritz Diehl

Hyperbolic spaces have increasingly been recognized for their outstanding performance in handling data with inherent hierarchical structures compared to their Euclidean counterparts. However, learning in hyperbolic spaces poses significant…

Machine Learning · Computer Science 2024-05-28 Sheng Yang , Peihan Liu , Cengiz Pehlevan

Most recently, He and Yuan [arXiv:2108.08554, 2021] have proposed a balanced augmented Lagrangian method (ALM) for the canonical convex programming problem with linear constraints, which advances the original ALM by balancing its…

Optimization and Control · Mathematics 2021-12-30 Shengjie Xu

In two-phase image segmentation, convex relaxation has allowed global minimisers to be computed for a variety of data fitting terms. Many efficient approaches exist to compute a solution quickly. However, we consider whether the nature of…

Numerical Analysis · Mathematics 2018-08-01 Jack Spencer

This paper considers smooth convex optimization problems with many functional constraints. To solve this general class of problems we propose a new stochastic perturbed augmented Lagrangian method, called SGDPA, where a perturbation is…

Optimization and Control · Mathematics 2025-04-01 Nitesh Kumar Singh , Ion Necoara

Many high dimensional sparse learning problems are formulated as nonconvex optimization. A popular approach to solve these nonconvex optimization problems is through convex relaxations such as linear and semidefinite programming. In this…

Machine Learning · Statistics 2015-03-17 Zhaoran Wang , Quanquan Gu , Han Liu

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

Non-convex functional constrained optimization problems have gained substantial attention in machine learning and data science, addressing broad requirements that typically go beyond the often performance-centric objectives. An influential…

Optimization and Control · Mathematics 2025-10-29 Sang Bin Moon , Jong Gwang Kim , Ashish Chandra , Christopher Brinton , Abolfazl Hashemi

In this paper we analyze and solve eigenvalue programs, which consist of the task of minimizing a function subject to constraints on the "eigenvalues" of the decision variable. Here, by making use of the FTvN systems framework introduced by…

Optimization and Control · Mathematics 2024-07-19 Masaru Ito , Bruno F. Lourenço

We consider the global optimization of nonconvex mixed-integer quadratic programs with linear equality constraints. In particular, we present a new class of convex quadratic relaxations which are derived via quadratic cuts. To construct…

Optimization and Control · Mathematics 2021-06-28 Carlos J. Nohra , Arvind U. Raghunathan , Nikolaos V. Sahinidis

In this paper, we propose novel algorithms for inferring the Maximum a Posteriori (MAP) solution of discrete pairwise random field models under multiple constraints. We show how this constrained discrete optimization problem can be…

Machine Learning · Computer Science 2013-08-02 Yongsub Lim , Kyomin Jung , Pushmeet Kohli

The technique of semidefinite programming (SDP) relaxation can be used to obtain a nontrivial bound on the optimal value of a nonconvex quadratically constrained quadratic program (QCQP). We explore concave quadratic inequalities that hold…

Optimization and Control · Mathematics 2016-09-30 Jaehyun Park , Stephen Boyd

We consider regularized cutting-plane methods to minimize a convex function that is the sum of a large number of component functions. One important example is the dual problem obtained from Lagrangian relaxation on a decomposable problem.…

Optimization and Control · Mathematics 2021-10-26 Nagisa Sugishita , Andreas Grothey , Ken McKinnon

In this paper, an equivalent smooth minimization for the L1 regularized least square problem is proposed. The proposed problem is a convex box-constrained smooth minimization which allows applying fast optimization methods to find its…

Optimization and Control · Mathematics 2021-10-22 Majid Mohammadi , Wout Hofman , Yaohua Tan , S. Hamid Mousavi

We present a method for finding lower bounds on the global infima of integral variational problems, wherein $\int_\Omega f(x,u(x),\nabla u(x)){\rm d}x$ is minimized over functions $u\colon\Omega\subset\mathbb{R}^n\to\mathbb{R}^m$ satisfying…

Optimization and Control · Mathematics 2023-08-15 Alexander Chernyavsky , Jason J. Bramburger , Giovanni Fantuzzi , David Goluskin

In this paper, we study the problem of fair sparse regression on a biased dataset where bias depends upon a hidden binary attribute. The presence of a hidden attribute adds an extra layer of complexity to the problem by combining sparse…

Machine Learning · Computer Science 2022-09-12 Adarsh Barik , Jean Honorio