English
Related papers

Related papers: Operator Scaling via Geodesically Convex Optimizat…

200 papers

Error bound analysis, which estimates the distance of a point to the solution set of an optimization problem using the optimality residual, is a powerful tool for the analysis of first-order optimization algorithms. In this paper, we use…

Optimization and Control · Mathematics 2020-07-01 Jiawei Zhang , Zhiquan Luo

We propose a new homotopy-based conditional gradient method for solving convex optimization problems with a large number of simple conic constraints. Instances of this template naturally appear in semidefinite programming problems arising…

Optimization and Control · Mathematics 2025-01-31 Pavel Dvurechensky , Gabriele Iommazzo , Shimrit Shtern , Mathias Staudigl

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

Machine Learning · Computer Science 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar

The homogeneous second-order descent method (Zhang et al. 2025, Mathematics of Operations Research) was initially proposed for unconstrained optimisation problems. HSODM shows excellent performance with respect to the global complexity rate…

Optimization and Control · Mathematics 2026-04-08 Yonggang Pei , Yubing Lin , Mauricio Silva Louzeiro , Detong Zhu

This work studies the problem of maximizing a higher degree real homogeneous multivariate polynomial over the unit sphere. This problem is equivalent to finding the leading eigenvalue of the associated symmetric tensor of higher order,…

Optimization and Control · Mathematics 2019-10-02 Yuning Yang , Guoyin Li

Conic optimization has recently emerged as a powerful tool for designing tractable and guaranteed algorithms for non-convex polynomial optimization problems. On the one hand, tractability is crucial for efficiently solving large-scale…

In this paper we analyze several new methods for solving nonconvex optimization problems with the objective function formed as a sum of two terms: one is nonconvex and smooth, and another is convex but simple and its structure is known.…

Optimization and Control · Mathematics 2014-06-25 A. Patrascu , I. Necoara

We study the question of whether parallelization in the exploration of the feasible set can be used to speed up convex optimization, in the local oracle model of computation. We show that the answer is negative for both deterministic and…

Optimization and Control · Mathematics 2019-06-21 Jelena Diakonikolas , Cristóbal Guzmán

In this paper, we discuss a novel higher-order stabilization-free virtual element method for general second-order elliptic eigenvalue problems. Optimal a priori error estimates are derived for both the approximate eigenspace and…

Numerical Analysis · Mathematics 2026-04-07 Liangkun Xu , Shixi Wang , Yidu Yang , Hai Bi

In this paper, we study large-scale convex optimization algorithms based on the Newton method applied to regularized generalized self-concordant losses, which include logistic regression and softmax regression. We first prove that our new…

Optimization and Control · Mathematics 2019-11-22 Ulysse Marteau-Ferey , Francis Bach , Alessandro Rudi

This paper is concerned with the theory, construction and application of variable-stepsize implicit Peer two-step methods that are super-convergent for variable stepsizes, i.e., preserve their classical order achieved for uniform stepsizes…

Optimization and Control · Mathematics 2026-02-12 Jens Lang , Bernhard A. Schmitt

From an optimizer's perspective, achieving the global optimum for a general nonconvex problem is often provably NP-hard using the classical worst-case analysis. In the case of Cox's proportional hazards model, by taking its statistical…

Statistics Theory · Mathematics 2021-07-07 Jianqing Fan , Wenyan Gong , Qiang Sun

We study a class of projective transformations of spectraplexes associated with self-dual cones and, on this basis, propose a polynomial-time algorithm for convex feasibility problems with positive definite constraints. At each iteration of…

Optimization and Control · Mathematics 2025-06-19 Sergei Chubanov

One of the most attractive recent approaches to processing well-structured large-scale convex optimization problems is based on smooth convex-concave saddle point reformu-lation of the problem of interest and solving the resulting problem…

Data Structures and Algorithms · Computer Science 2014-05-22 Aharon Ben-Tal , Arkadi Nemirovski

This paper presents a modified iterative approach to solve the variational inequality problem using the double inertial technique in the context of a real Hilbert space. Our iterative technique involves a projection onto a generalized…

Functional Analysis · Mathematics 2026-03-19 Watanjeet Singh , Sumit Chandok

We study differentially private stochastic optimization in convex and non-convex settings. For the convex case, we focus on the family of non-smooth generalized linear losses (GLLs). Our algorithm for the $\ell_2$ setting achieves optimal…

Machine Learning · Computer Science 2021-11-11 Raef Bassily , Cristóbal Guzmán , Michael Menart

Geometric duality theory for multiple objective linear programming problems turned out to be very useful for the development of efficient algorithms to generate or approximate the whole set of nondominated points in the outcome space. This…

Optimization and Control · Mathematics 2011-09-19 Frank Heyde

In this paper, we propose two algorithms for solving convex optimization problems with linear ascending constraints. When the objective function is separable, we propose a dual method which terminates in a finite number of iterations. In…

Optimization and Control · Mathematics 2014-09-26 Zizhuo Wang

We investigate the techniques and ideas used in the convergence analysis of two proximal ADMM algorithms for solving convex optimization problems involving compositions with linear operators. Besides this, we formulate a variant of the ADMM…

Optimization and Control · Mathematics 2019-12-20 Sebastian Banert , Radu Ioan Bot , Ernö Robert Csetnek