English
Related papers

Related papers: An Interior-Point Algorithm for Continuous Nonline…

200 papers

We provide a condition-based analysis of two interior-point methods for unconstrained geometric programs, a class of convex programs that arise naturally in applications including matrix scaling, matrix balancing, and entropy maximization.…

Optimization and Control · Mathematics 2020-08-28 Peter Bürgisser , Yinan Li , Harold Nieuwboer , Michael Walter

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

Interior-point methods offer a highly versatile framework for convex optimization that is effective in theory and practice. A key notion in their theory is that of a self-concordant barrier. We give a suitable generalization of…

Optimization and Control · Mathematics 2024-06-26 Hiroshi Hirai , Harold Nieuwboer , Michael Walter

We consider structured minimization problems subject to smooth inequality constraints and present a flexible algorithm that combines interior point (IP) and proximal gradient schemes. While traditional IP methods cannot cope with nonsmooth…

Optimization and Control · Mathematics 2024-07-11 Alberto De Marchi , Andreas Themelis

When measurements from dynamical systems are noisy, it is useful to have estimation algorithms that have low sensitivity to measurement noises and outliers. In the first set of results described in this paper we obtain optimal estimators…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Krishan Mohan Nagpal

We present two quantum interior point methods for semidefinite optimization problems, building on recent advances in quantum linear system algorithms. The first scheme, more similar to a classical solution algorithm, computes an inexact…

Quantum Physics · Physics 2023-09-13 Brandon Augustino , Giacomo Nannicini , Tamás Terlaky , Luis F. Zuluaga

In this paper, we consider mixed-integer nonsmooth constrained optimization problems whose objective/constraint functions are available only as the output of a black-box zeroth-order oracle (i.e., an oracle that does not provide derivative…

Optimization and Control · Mathematics 2021-07-02 Tommaso Giovannelli , Giampaolo Liuzzi , Stefano Lucidi , Francesco Rinaldi

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We introduce a new second-order inertial optimization method for machine learning called INNA. It exploits the geometry of the loss function while only requiring stochastic approximations of the function values and the generalized…

Machine Learning · Computer Science 2021-08-17 Camille Castera , Jérôme Bolte , Cédric Févotte , Edouard Pauwels

This paper studies the numerical solution of strictly convex unconstrained optimization problems by linesearch Newton-CG methods. We focus on methods employing inexact evaluations of the objective function and inexact and possibly random…

Optimization and Control · Mathematics 2022-05-16 Stefania Bellavia , Eugenio Fabrizi , Benedetta Morini

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

The discretization of constrained nonlinear optimization problems arising in the field of topology optimization yields algebraic systems which are challenging to solve in practice, due to pathological ill-conditioning, strong nonlinearity…

Optimization and Control · Mathematics 2016-10-31 Michal Kocvara , Daniel Loghin , James Turner

Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been…

Optimization and Control · Mathematics 2025-04-04 Stefania Bellavia , Greta Malaspina

We propose an inexact infeasible arc-search interior-point method for solving linear optimization problems. The method combines an arc-search strategy with inexact solutions to Newton systems and admits a polynomial iteration complexity…

Optimization and Control · Mathematics 2026-01-08 Einosuke Iida , Makoto Yamashita

Many problems in statistical learning, imaging, and computer vision involve the optimization of a non-convex objective function with singularities at the boundary of the feasible set. For such challenging instances, we develop a new…

Optimization and Control · Mathematics 2019-11-07 Pavel Dvurechensky , Mathias Staudigl , César A. Uribe

In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of…

Optimization and Control · Mathematics 2018-12-17 Yang Yang , Marius Pesavento

An optimization algorithm for nonsmooth nonconvex constrained optimization problems with upper-C2 objective functions is proposed and analyzed. Upper-C2 is a weakly concave property that exists in difference of convex (DC) functions and…

Optimization and Control · Mathematics 2022-04-21 Jingyi Wang , Cosmin G. Petra

In this paper, we propose an interior-point method for linearly constrained optimization problems (possibly nonconvex). The method - which we call the Hessian barrier algorithm (HBA) - combines a forward Euler discretization of Hessian…

Optimization and Control · Mathematics 2023-09-14 Immanuel M. Bomze , Panayotis Mertikopoulos , Werner Schachinger , Mathias Staudigl

We extend the classical primal-dual interior point method from the Euclidean setting to the Riemannian one. Our method, named the Riemannian interior point method, is for solving Riemannian constrained optimization problems. We establish…

Optimization and Control · Mathematics 2024-03-06 Zhijian Lai , Akiko Yoshise

Bayesian optimization is a popular and versatile approach that is well suited to solve challenging optimization problems. Their popularity comes from their effective minimization of expensive function evaluations, their capability to…

Optimization and Control · Mathematics 2026-05-14 André L. Marchildon , David W. Zingg