English
Related papers

Related papers: Revisiting Spectral Bundle Methods: Primal-dual (S…

200 papers

We propose an efficient first-order method, based on the alternating direction method of multipliers (ADMM), to solve the homogeneous self-dual embedding problem for a primal-dual pair of semidefinite programs (SDPs) with chordal sparsity.…

Optimization and Control · Mathematics 2017-12-12 Yang Zheng , Giovanni Fantuzzi , Antonis Papachristodoulou , Paul Goulart , Andrew Wynn

We revisit the problem of large-scale bundle adjustment and propose a technique called Multidirectional Conjugate Gradients that accelerates the solution of the normal equation by up to 61%. The key idea is that we enlarge the search space…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Simon Weber , Nikolaus Demmel , Daniel Cremers

Primal-dual methods for solving convex optimization problems with functional constraints often exhibit a distinct two-stage behavior. Initially, they converge towards a solution at a sublinear rate. Then, after a certain point, the method…

Optimization and Control · Mathematics 2026-02-12 Mateo Díaz , Pedro Izquierdo Lehmann , Haihao Lu , Jinwen Yang

We study convex-concave saddle point problems with bilinear coupling, covering linearly constrained convex optimization and more general nonsmooth or constrained models via a proximable term in the dual objective. In linearly convergent…

Optimization and Control · Mathematics 2026-03-02 Meng Li , Paul Grigas

It has been shown that many first-order methods satisfy the perturbed Fenchel duality inequality, which yields a unified derivation of convergence. More first-order methods are discussed in this paper, e.g., dual averaging and bundle…

Optimization and Control · Mathematics 2024-12-04 Tiantian Zhao

Stochastic Primal-Dual Hybrid Gradient (SPDHG) is an algorithm proposed by Chambolle et al. (2018) to efficiently solve a wide class of nonsmooth large-scale optimization problems. In this paper we contribute to its theoretical foundations…

Optimization and Control · Mathematics 2023-11-27 Eric B Gutierrez , Claire Delplancke , Matthias J Ehrhardt

The Stochastic Primal-Dual Hybrid Gradient (SPDHG) was proposed by Chambolle et al. (2018) and is an efficient algorithm to solve some nonsmooth large-scale optimization problems. In this paper we prove its almost sure convergence for…

Optimization and Control · Mathematics 2021-04-02 Eric B. Gutierrez , Claire Delplancke , Matthias J. Ehrhardt

Primal-dual algorithms for the resolution of convex-concave saddle point problems usually come with one or several step size parameters. Within the range where convergence is guaranteed, choosing well the step size can make the difference…

Optimization and Control · Mathematics 2024-03-29 Olivier Fercoq

Parallel-across-the method time integration can provide small scale parallelism when solving initial value problems. Spectral deferred corrections (SDC) with a diagonal sweeper, which is closely related to iterated Runge-Kutta methods…

Numerical Analysis · Mathematics 2025-02-12 Gayatri Čaklović , Thibaut Lunet , Sebastian Götschel , Daniel Ruprecht

Super-resolution theory aims to estimate the discrete components lying in a continuous space that constitute a sparse signal with optimal precision. This work investigates the potential of recent super-resolution techniques for spectral…

Information Theory · Computer Science 2016-11-24 M. Ferreira Da Costa , W. Dai

This paper investigates a numerical probabilistic method for the solution of some semilinear stochastic partial differential equations (SPDEs in short). The numerical scheme is based on discrete time approximation for solutions of systems…

Probability · Mathematics 2015-09-21 Achref Bachouch , Mohamed Anis Ben Lasmar , Anis Matoussi , Mohamed Mnif

The conic bundle implementation of the spectral bundle method for large scale semidefinite programming solves in each iteration a semidefinite quadratic subproblem by an interior point approach. For larger cutting model sizes the limiting…

Optimization and Control · Mathematics 2023-08-25 Christoph Helmberg

This paper proposes a squared smoothing Newton method via the Huber smoothing function for solving semidefinite programming problems (SDPs). We first study the fundamental properties of the matrix-valued mapping defined upon the Huber…

Optimization and Control · Mathematics 2024-10-10 Ling Liang , Defeng Sun , Kim-Chuan Toh

In this paper, we apply the Feature Space Decomposition (FSD) method developed in [LS24, GLS25, LSSW26, ALSS26] to obtain, under fairly general conditions, matching upper and lower bounds for the population excess risk of spectral methods…

Statistics Theory · Mathematics 2026-05-18 Guillaume Lecué , Zhifan Li , Zong Shang

This paper develops two parameter-free methods for solving convex and strongly convex hybrid composite optimization problems, namely, a composite subgradient type method and a proximal bundle type method. Functional complexity bounds for…

Optimization and Control · Mathematics 2025-11-24 Vincent Guigues , Jiaming Liang , Renato D. C. Monteiro

We investigate a primal-dual (PD) method for the saddle point problem (SPP) that uses a linear approximation of the primal function instead of the standard proximal step, resulting in a linearized PD (LPD) method. For convex-strongly…

Optimization and Control · Mathematics 2023-05-19 Mohammad Khalafi , Digvijay Boob

We propose a novel methodology for solving a two-stage adjustable robust convex optimisation problem with a general (proximable) convex objective function and constraints defined by sum-of-squares (SOS) convex polynomials. These problems…

Optimization and Control · Mathematics 2026-02-17 Neil D. Dizon , Bethany I. Caldwell , Vaithilingam Jeyakumar , Guoyin Li

Decentralized primal-dual methods are widely used for solving decentralized optimization problems, but their updates often rely on the potentially crude first-order Taylor approximations of the objective functions, which can limit…

Optimization and Control · Mathematics 2026-03-31 Haijuan Liu , Zhuoqing Zheng , Cong Li , Wenying Xu , Xuyang Wu

This paper considers optimization problems where the objective is the sum of a function given by an expectation and a closed convex composite function, and proposes stochastic composite proximal bundle (SCPB) methods for solving it.…

Optimization and Control · Mathematics 2023-10-24 Jiaming Liang , Vincent Guigues , Renato D. C. Monteiro

We propose two approaches to estimate semiparametric discrete choice models for bundles. Our first approach is a kernel-weighted rank estimator based on a matching-based identification strategy. We establish its complete asymptotic…

Econometrics · Economics 2024-12-18 Fu Ouyang , Thomas Tao Yang