English
Related papers

Related papers: Revisiting Spectral Bundle Methods: Primal-dual (S…

200 papers

Superlinear convergence has been an elusive goal for black-box nonsmooth optimization. Even in the convex case, the subgradient method is very slow, and while some cutting plane algorithms, including traditional bundle methods, are popular…

Optimization and Control · Mathematics 2019-07-30 Adrian Lewis , Calvin Wylie

We propose an efficient approach to semidefinite spectral clustering (SSC), which addresses the Frobenius normalization with the positive semidefinite (p.s.d.) constraint for spectral clustering. Compared with the original Frobenius norm…

Machine Learning · Computer Science 2014-02-25 Yan Yan , Chunhua Shen , Hanzi Wang

Semidefinite programming (SDP) is a central topic in mathematical optimization with extensive studies on its efficient solvers. In this paper, we present a proof-of-principle sublinear-time algorithm for solving SDPs with low-rank…

Data Structures and Algorithms · Computer Science 2020-08-07 Nai-Hui Chia , Tongyang Li , Han-Hsuan Lin , Chunhao Wang

We present algorithm MIQCR-CB that is an advancement of method MIQCR~(Billionnet, Elloumi and Lambert, 2012). MIQCR is a method for solving mixed-integer quadratic programs and works in two phases: the first phase determines an equivalent…

Optimization and Control · Mathematics 2020-07-13 Alain Billionnet , Sourour Elloumi , Amélie Lambert , Angelika Wiegele

A DualTPD method is proposed for solving nonlinear partial differential equations. The method is characterized by three main features. First, decoupling via Fenchel--Rockafellar duality is achieved, so that nonlinear terms are discretized…

Numerical Analysis · Mathematics 2025-10-20 Long Chen , Ruchi Guo , Jingrong Wei , Jun Zou

In this paper we propose a distributed dual gradient algorithm for minimizing linearly constrained separable convex problems and analyze its rate of convergence. In particular, we prove that under the assumption of strong convexity and…

Optimization and Control · Mathematics 2014-10-01 Ion Necoara , Valentin Nedelcu

We introduce the convex bundle method to solve convex, non-smooth optimization problems on Riemannian manifolds of bounded sectional curvature. Each step of our method is based on a model that involves the convex hull of previously…

Optimization and Control · Mathematics 2025-07-21 Ronny Bergmann , Roland Herzog , Hajg Jasa

Spectral clustering methods have gained widespread recognition for their effectiveness in clustering high-dimensional data. Among these techniques, constrained spectral clustering has emerged as a prominent approach, demonstrating enhanced…

Machine Learning · Computer Science 2024-04-05 Swarup Ranjan Behera , Vijaya V. Saradhi

We present a solution to scale spectral algorithms for learning sequence functions. We are interested in the case where these functions are sparse (that is, for most sequences they return 0). Spectral algorithms reduce the learning problem…

Machine Learning · Computer Science 2017-06-12 Ariadna Quattoni , Xavier Carreras , Matthias Gallé

The main goal of this paper is to develop uniformly optimal first-order methods for convex programming (CP). By uniform optimality we mean that the first-order methods themselves do not require the input of any problem parameters, but can…

Optimization and Control · Mathematics 2013-09-24 Guanghui Lan

Precise continuum normalisation of merged \'{e}chelle spectra is a demanding task necessary for various detailed spectroscopic analyses. Automatic methods have limited effectiveness due to the variety of features present in the spectra of…

Instrumentation and Methods for Astrophysics · Physics 2022-03-30 Tomasz Różański , Ewa Niemczura , Jakub Lemiesz , Natalia Posiłek , Paweł Różański

Optimization on Hadamard manifolds -- the natural Riemannian setting for globally geodesically convex problems -- relies on exponential maps to retract tangent vectors and parallel transport to connect tangent spaces across the manifold.…

Optimization and Control · Mathematics 2026-05-01 Mateo Díaz , Benjamin Grimmer , Ian McPherson

Semidefinite programs (SDPs) and their solvers are powerful tools with many applications in machine learning and data science. Designing scalable SDP solvers is challenging because by standard the positive semidefinite decision variable is…

Optimization and Control · Mathematics 2024-08-09 Yufan Huang , David F. Gleich

Recently there is a line of research work proposing to employ Spectral Clustering (SC) to segment (group){Throughout the paper, we use segmentation, clustering, and grouping, and their verb forms, interchangeably.} high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2010-10-11 Yuzhao Ni , Ju Sun , Xiaotong Yuan , Shuicheng Yan , Loong-Fah Cheong

We develop a spectral method for solving univariate singular integral equations over unions of intervals by utilizing Chebyshev and ultraspherical polynomials to reformulate the equations as almost-banded infinite-dimensional systems. This…

Numerical Analysis · Mathematics 2016-12-12 Richard Mikael Slevinsky , Sheehan Olver

In this paper, we introduce a primal-dual algorithmic framework for solving Symmetric Cone Programs (SCPs), a versatile optimization model that unifies and extends Linear, Second-Order Cone (SOCP), and Semidefinite Programming (SDP). Our…

Optimization and Control · Mathematics 2024-05-16 Jiaqi Zheng , Antonios Varvitsiotis , Tiow-Seng Tan , Wayne Lin

We study robust convex quadratic programs where the uncertain problem parameters can contain both continuous and integer components. Under the natural boundedness assumption on the uncertainty set, we show that the generic problems are…

Optimization and Control · Mathematics 2018-12-19 Areesh Mittal , Can Gokalp , Grani A. Hanasusanto

We consider a generic convex optimization problem associated with regularized empirical risk minimization of linear predictors. The problem structure allows us to reformulate it as a convex-concave saddle point problem. We propose a…

Optimization and Control · Mathematics 2015-09-10 Yuchen Zhang , Lin Xiao

We propose a new method for simplifying semidefinite programs (SDP) inspired by symmetry reduction. Specifically, we show if an orthogonal projection map satisfies certain invariance conditions, restricting to its range yields an equivalent…

Optimization and Control · Mathematics 2023-03-09 Frank Permenter , Pablo A. Parrilo

Spectral clustering is one of the most effective clustering approaches that capture hidden cluster structures in the data. However, it does not scale well to large-scale problems due to its quadratic complexity in constructing similarity…

Machine Learning · Computer Science 2019-11-26 Lingfei Wu , Pin-Yu Chen , Ian En-Hsu Yen , Fangli Xu , Yinglong Xia , Charu Aggarwal