English
Related papers

Related papers: An efficient descent method for locally Lipschitz …

200 papers

This paper proposes a Smoothing Accelerated Proximal Gradient Method with Extrapolation Term (SAPGM) for nonsmooth multiobjective optimization. By combining the smoothing methods and the accelerated algorithm for multiobjective optimization…

Optimization and Control · Mathematics 2024-10-21 Chengzhi Huang

In this paper, a new one-parameter filled function approach is developed for nonlinear multi-objective optimization. Inspired by key filled function ideas from single-objective optimization, the proposed method is adapted to the…

Optimization and Control · Mathematics 2026-04-01 Bikram Adhikary , Md Abu Talhamainuddin Ansary

There are much recent interests in solving noncovnex min-max optimization problems due to its broad applications in many areas including machine learning, networked resource allocations, and distributed optimization. Perhaps, the most…

Optimization and Control · Mathematics 2021-12-20 Thinh T. Doan

We study the oracle complexity of nonsmooth nonconvex optimization, with the algorithm assumed to have access only to local function information. It has been shown by Davis, Drusvyatskiy, and Jiang (2023) that for nonsmooth Lipschitz…

Optimization and Control · Mathematics 2024-09-17 Guy Kornowski , Swati Padmanabhan , Ohad Shamir

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu

In this paper,we propose a Multi-Objective Sequential Quadratic Programming (MOSQP) algorithm for constrained multi-objective optimization problems,basd on a low-order smooth penalty function as the merit function for line search. The…

Optimization and Control · Mathematics 2025-03-13 Zanyang Kong

We introduce a notion of inexact model of a convex objective function, which allows for errors both in the function and in its gradient. For this situation, a gradient method with an adaptive adjustment of some parameters of the model is…

Optimization and Control · Mathematics 2021-10-12 Fedor S. Stonyakin

We study the oracle complexity of finding $\varepsilon$-Pareto stationary points in smooth multiobjective optimization with $m$ objectives. Progress is measured by the Pareto stationarity gap $\mathcal{G}(x)$, the norm of the best convex…

Optimization and Control · Mathematics 2026-02-17 Phillipe R. Sampaio

This paper is devoted to a new modification of a recently proposed adaptive stochastic mirror descent algorithm for constrained convex optimization problems in the case of several convex functional constraints. Algorithms, standard and its…

Optimization and Control · Mathematics 2020-01-22 Mohammad S. Alkousa

We propose a new randomized coordinate descent method for a convex optimization template with broad applications. Our analysis relies on a novel combination of four ideas applied to the primal-dual gap function: smoothing, acceleration,…

Optimization and Control · Mathematics 2017-11-10 Ahmet Alacaoglu , Quoc Tran-Dinh , Olivier Fercoq , Volkan Cevher

We consider structured minimization problems subject to smooth inequality constraints and present a flexible algorithm that combines interior point (IP) and proximal gradient schemes. While traditional IP methods cannot cope with nonsmooth…

Optimization and Control · Mathematics 2024-07-11 Alberto De Marchi , Andreas Themelis

We introduce in this paper an optimal first-order method that allows an easy and cheap evaluation of the local Lipschitz constant of the objective's gradient. This constant must ideally be chosen at every iteration as small as possible,…

Optimization and Control · Mathematics 2012-07-18 Michel Baes , Michael Buergisser

In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing…

Optimization and Control · Mathematics 2025-05-14 Felipe Atenas , Minh N. Dao , Matthew K. Tam

Bundle methods have been intensively studied for solving both convex and nonconvex optimization problems. In most of the bundle methods developed thus far, at least one quadratic programming (QP) subproblem needs to be solved in each…

Optimization and Control · Mathematics 2015-07-08 Shuai Liu , Andrew Eberhard , Yousong Luo

In a wide range of applications it is desirable to optimally control a dynamical system with respect to concurrent, potentially competing goals. This gives rise to a multiobjective optimal control problem where, instead of computing a…

Optimization and Control · Mathematics 2020-12-18 Sebastian Peitz , Sina Ober-Blöbaum , Michael Dellnitz

We consider the problem of finding local minimizers in non-convex and non-smooth optimization. Under the assumption of strict saddle points, positive results have been derived for first-order methods. We present the first known results for…

Machine Learning · Computer Science 2019-08-13 Zhishen Huang , Stephen Becker

We introduce a novel gradient descent algorithm extending the well-known Gradient Sampling methodology to the class of stratifiably smooth objective functions, which are defined as locally Lipschitz functions that are smooth on some regular…

Computational Geometry · Computer Science 2021-09-06 Jacob Leygonie , Mathieu Carrière , Théo Lacombe , Steve Oudot

We propose an adaptive zeroth-order method for minimizing differentiable functions with $L$-Lipschitz continuous gradients. The method is designed to take advantage of the eventual compressibility of the gradient of the objective function,…

Optimization and Control · Mathematics 2025-07-16 Geovani Nunes Grapiglia , Daniel McKenzie

In this paper, a tunneling method is developed for nonlinear multiobjective optimization problems using some ideas of the single objective tunneling method. The proposed method does not require any a priori chosen parameters or ordering…

Optimization and Control · Mathematics 2025-10-06 Bikram Adhikary , Md Abu Talhamainuddin Ansary

In this paper, we are interested in finding the global minimizer of a nonsmooth nonconvex unconstrained optimization problem. By combining the discrete consensus-based optimization (CBO) algorithm and the gradient descent method, we develop…

Optimization and Control · Mathematics 2025-01-16 Jiazhen Wei , Fan Wu , Wei Bian