English
Related papers

Related papers: Revisiting Spectral Bundle Methods: Primal-dual (S…

200 papers

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas T. Yang

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and…

Optimization and Control · Mathematics 2022-06-23 Ahmet Alacaoglu , Olivier Fercoq , Volkan Cevher

Solving large scale convex semidefinite programming (SDP) problems has long been a challenging task numerically. Fortunately, several powerful solvers including SDPNAL, SDPNAL+ and QSDPNAL have recently been developed to solve linear and…

Optimization and Control · Mathematics 2016-10-05 Ying Cui , Defeng Sun , Kim-Chuan Toh

We consider the solution of nonlinear programs with nonlinear semidefiniteness constraints. The need for an efficient exploitation of the cone of positive semidefinite matrices makes the solution of such nonlinear semidefinite programs more…

Optimization and Control · Mathematics 2007-05-23 Roland W. Freund , Florian Jarre , Christoph Vogelbusch

We propose a homogeneous primal-dual interior-point method to solve sum-of-squares optimization problems by combining non-symmetric conic optimization techniques and polynomial interpolation. The approach optimizes directly over the…

Optimization and Control · Mathematics 2018-12-24 Dávid Papp , Sercan Yıldız

A new approach to solving a class of rankconstrained semi-definite programming (SDP) problems, which appear in many signal processing applications such as transmit beamspace design in multiple-input multiple-output (MIMO) radar, downlink…

Information Theory · Computer Science 2016-10-10 Matthew W. Morency , Sergiy A. Vorobyov

We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions…

Optimization and Control · Mathematics 2023-02-07 Junhyung Lyle Kim , JA Lara Benitez , Mohammad Taha Toghani , Cameron Wolfe , Zhiwei Zhang , Anastasios Kyrillidis

The aim of structured optimization is to assemble a solution, using a given set of (possibly uncountably infinite) atoms, to fit a model to data. A two-stage algorithm based on gauge duality and bundle method is proposed. The first stage…

Optimization and Control · Mathematics 2019-11-05 Zhenan Fan , Yifan Sun , Michael P. Friedlander

This paper studies the performance of the spectral method in the estimation and uncertainty quantification of the unobserved preference scores of compared entities in a general and more realistic setup. Specifically, the comparison graph…

Methodology · Statistics 2024-03-04 Jianqing Fan , Zhipeng Lou , Weichen Wang , Mengxin Yu

Many common methods for data analysis rely on linear algebra. We provide new results connecting data analysis error to numerical accuracy, which leads to the first meaningful stopping criterion for two way spectral partitioning. More…

Numerical Analysis · Computer Science 2016-02-03 James P. Fairbanks , Geoffrey D. Sanders , David A. Bader

In semidefinite programming a proposed optimal solution may be quite poor in spite of having sufficiently small residual in the optimality conditions. This issue may be framed in terms of the discrepancy between forward error (the…

Optimization and Control · Mathematics 2019-08-14 Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

Spectral clustering is a novel clustering method which can detect complex shapes of data clusters. However, it requires the eigen decomposition of the graph Laplacian matrix, which is proportion to $O(n^3)$ and thus is not suitable for…

Machine Learning · Computer Science 2013-07-02 Nguyen Lu Dang Khoa , Sanjay Chawla

The proximal bundle method (PBM) is a powerful and widely used approach for minimizing nonsmooth convex functions. However, for smooth objectives, its best-known convergence rate remains suboptimal, and whether PBM can be accelerated…

Optimization and Control · Mathematics 2026-04-28 Feng-Yi Liao , Thomas Madden , Yang Zheng

Dual first-order methods are powerful techniques for large-scale convex optimization. Although an extensive research effort has been devoted to studying their convergence properties, explicit convergence rates for the primal iterates have…

Optimization and Control · Mathematics 2015-02-24 Jie Lu , Mikael Johansson

We extend the result on the spectral projected gradient method by Birgin et al. in 2000 to a log-determinant semidefinite problem (SDP) with linear constraints and propose a spectral projected gradient method for the dual problem. Our…

Optimization and Control · Mathematics 2018-12-04 Takashi Nakagaki , Mituhiro Fukuda , Sunyoung Kim , Makoto Yamashita

Semidefinite programming (SDP) is a powerful framework from convex optimization that has striking potential for data science applications. This paper develops a provably correct randomized algorithm for solving large, weakly constrained SDP…

Optimization and Control · Mathematics 2021-03-26 Alp Yurtsever , Joel A. Tropp , Olivier Fercoq , Madeleine Udell , Volkan Cevher

We develop a practical semidefinite programming (SDP) facial reduction procedure that utilizes computationally efficient approximations of the positive semidefinite cone. The proposed method simplifies SDPs with no strictly feasible…

Optimization and Control · Mathematics 2017-11-30 Frank Permenter , Pablo Parrilo

The proximal bundle method (PBM) is a fundamental and computationally effective algorithm for solving nonsmooth optimization problems. In this paper, we present the first variant of the PBM for smooth objectives, achieving an accelerated…

Optimization and Control · Mathematics 2025-04-30 David Fersztand , Xu Andy Sun

In this paper we propose and analyze two dual methods based on inexact gradient information and averaging that generate approximate primal solutions for smooth convex optimization problems. The complicating constraints are moved into the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu

Spectral variability is one of the major issue when conducting hyperspectral unmixing. Within a given image composed of some elementary materials (herein referred to as endmember classes), the spectral signature characterizing these classes…

Image and Video Processing · Electrical Eng. & Systems 2019-06-26 Tatsumi Uezato , Mathieu Fauvel , Nicolas Dobigeon