English
Related papers

Related papers: An efficient descent method for locally Lipschitz …

200 papers

Theoretical estimates of the convergence rate of many well-known gradient-type optimization methods are based on quadratic interpolation, provided that the Lipschitz condition for the gradient is satisfied. In this article we obtain a…

Optimization and Control · Mathematics 2018-12-18 Fedor S. Stonyakin

Multimodality is one of the biggest difficulties for optimization as local optima are often preventing algorithms from making progress. This does not only challenge local strategies that can get stuck. It also hinders meta-heuristics like…

Neural and Evolutionary Computing · Computer Science 2020-10-05 Vera Steinhoff , Pascal Kerschke , Pelin Aspar , Heike Trautmann , Christian Grimme

In this article, we propose a Newton-based method for solving multiobjective interval optimization problems (MIOPs). We first provide a connection between weakly Pareto optimal points and Pareto critical points in the context of MIOPs.…

Optimization and Control · Mathematics 2026-03-09 Tapas Mondal , Debdas Ghosh , Do Sang Kim

NonOpt, a C++ software package for minimizing locally Lipschitz objective functions, is presented. The software is intended primarily for minimizing objective functions that are nonconvex and/or nonsmooth. The package has implementations of…

Optimization and Control · Mathematics 2025-04-01 Frank E. Curtis , Lara Zebiane

We present a subgradient method for minimizing non-smooth, non-Lipschitz convex optimization problems. The only structure assumed is that a strictly feasible point is known. We extend the work of Renegar [5] by taking a different…

Optimization and Control · Mathematics 2018-02-28 Benjamin Grimmer

In decentralized optimization, several nodes connected by a network collaboratively minimize some objective function. For minimization of Lipschitz functions lower bounds are known along with optimal algorithms. We study a specific class of…

Optimization and Control · Mathematics 2023-03-15 Savelii Chezhegov , Alexander Rogozin , Alexander Gasnikov

In this article we develop a gradient-based algorithm for the solution of multiobjective optimization problems with uncertainties. To this end, an additional condition is derived for the descent direction in order to account for…

Optimization and Control · Mathematics 2018-08-02 Sebastian Peitz , Michael Dellnitz

In this paper some adaptive mirror descent algorithms for problems of minimization convex objective functional with several convex Lipschitz (generally, non-smooth) functional constraints are considered. It is shown that the methods are…

Optimization and Control · Mathematics 2018-12-20 F. S. Stonyakin , M . S. Alkousa , A. A. Titov

A homotopy method for multi-objective optimization that produces uniformly sampled Pareto fronts by construction is presented. While the algorithm is general, of particular interest is application to simulation-based engineering…

Optimization and Control · Mathematics 2015-05-13 Andreas Adelmann , Peter Arbenz , Andrew Foster , Yves Ineichen

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra

We consider the classical setting of optimizing a nonsmooth Lipschitz continuous convex function over a convex constraint set, when having access to a (stochastic) first-order oracle (FO) for the function and a projection oracle (PO) for…

Optimization and Control · Mathematics 2020-10-06 Kiran Koshy Thekumparampil , Prateek Jain , Praneeth Netrapalli , Sewoong Oh

We consider the problem of minimization of a convex function on a simple set with convex non-smooth inequality constraint and describe first-order methods to solve such problems in different situations: smooth or non-smooth objective…

Optimization and Control · Mathematics 2018-01-30 Anastasia Bayandina , Pavel Dvurechensky , Alexander Gasnikov , Fedor Stonyakin , Alexander Titov

We consider a class of constrained optimization problems with a possibly nonconvex non-Lipschitz objective and a convex feasible set being the intersection of a polyhedron and a possibly degenerate ellipsoid. Such problems have a wide range…

Optimization and Control · Mathematics 2016-04-08 Xiaojun Chen , Zhaosong Lu , Ting Kei Pong

This paper addresses a class of nonsmooth and nonconvex optimization problems defined on complete Riemannian manifolds. The objective function has a composite structure, combining convex, differentiable, and lower semicontinuous terms,…

Optimization and Control · Mathematics 2025-11-19 Vitaliano S. Amaral , Marcio Antônio de A. Bortoloti , Jurandir O. Lopes , Gilson N. Silva

This article introduces the multi-objective adaptive order Caputo fractional gradient descent (MOAOCFGD) algorithm for solving unconstrained multi-objective problems. The proposed method performs equally well for both smooth and non-smooth…

Optimization and Control · Mathematics 2025-07-11 Barsha Shaw , Md Abu Talhamainuddin Ansary

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

Machine Learning · Computer Science 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

In this paper we present an inexact zeroth-order method suitable for the solution nonsmooth and nonconvex stochastic composite optimization problems, in which the objective is split into a real-valued Lipschitz continuous stochastic…

Optimization and Control · Mathematics 2025-12-11 Spyridon Pougkakiotis , Dionysis Kalogerias

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

Many descent algorithms for multiobjective optimization have been developed in the last two decades. Tanabe et al. (Comput Optim Appl 72(2):339--361, 2019) proposed a proximal gradient method for multiobjective optimization, which can solve…

Optimization and Control · Mathematics 2022-04-11 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita