English
Related papers

Related papers: The Quasi-Newton Method for the Composite Multiobj…

200 papers

Finding optimal solutions of conflicting objectives is a daily matter in many industrial applications, with multi-objective optimization trying to find the best solutions to them. The advent of quantum computing has led to researchers…

We study the local convergence of classical quasi-Newton methods for nonlinear optimization. Although it was well established a long time ago that asymptotically these methods converge superlinearly, the corresponding rates of convergence…

Optimization and Control · Mathematics 2021-06-02 Anton Rodomanov , Yurii Nesterov

Quasi-Newton methods are well known techniques for large-scale numerical optimization. They use an approximation of the Hessian in optimization problems or the Jacobian in system of nonlinear equations. In the Interior Point context,…

Optimization and Control · Mathematics 2022-09-13 Jacek Gondzio , Francisco N. C. Sobral

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

Machine Learning · Computer Science 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Since the late 1950's when quasi-Newton methods first appeared, they have become one of the most widely used and efficient algorithmic paradigms for unconstrained optimization. Despite their immense practical success, there is little theory…

Optimization and Control · Mathematics 2021-02-05 Dmitry Kovalev , Robert M. Gower , Peter Richtárik , Alexander Rogozin

In this paper, we consider the composite optimization problems over the Stiefel manifold. A successful method to solve this class of problems is the proximal gradient method proposed by Chen et al. Motivated by the proximal Newton-type…

Optimization and Control · Mathematics 2025-01-17 Qinsi Wang , Wei Hong Yang

Nonlinear model predictive control~(NMPC) generally requires the solution of a non-convex optimization problem at each sampling instant under strict timing constraints, based on a set of differential equations that can often be stiff and/or…

Optimization and Control · Mathematics 2019-03-22 Pedro Hespanhol , Rien Quirynen

Despite the impressive numerical performance of the quasi-Newton and Anderson/nonlinear acceleration methods, their global convergence rates have remained elusive for over 50 years. This study addresses this long-standing issue by…

Optimization and Control · Mathematics 2023-11-16 Damien Scieur

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

This article introduces the multi-objective adaptive order Caputo fractional gradient descent (MOAOCFGD) algorithm for solving unconstrained multi-objective problems. The proposed method performs equally well for both smooth and non-smooth…

Optimization and Control · Mathematics 2025-07-11 Barsha Shaw , Md Abu Talhamainuddin Ansary

In this paper, we propose two regularized proximal quasi-Newton methods with symmetric rank-1 update of the metric (SR1 quasi-Newton) to solve non-smooth convex additive composite problems. Both algorithms avoid using line search or other…

Optimization and Control · Mathematics 2024-11-22 Shida Wang , Jalal Fadili , Peter Ochs

We present a distributed quasi-Newton (DQN) method, which enables a group of agents to compute an optimal solution of a separable multi-agent optimization problem locally using an approximation of the curvature of the aggregate objective…

Optimization and Control · Mathematics 2024-09-30 Ola Shorinwa , Mac Schwager

In this article using Cuckoo Optimization Algorithm and simple additive weighting method the hybrid COAW algorithm is presented to solve multi-objective problems. Cuckoo algorithm is an efficient and structured method for solving nonlinear…

Neural and Evolutionary Computing · Computer Science 2016-11-03 Zeinab Borhanifar , Elham Shadkam

In this paper, we propose a successive pseudo-convex approximation algorithm to efficiently compute stationary points for a large class of possibly nonconvex optimization problems. The stationary points are obtained by solving a sequence of…

Optimization and Control · Mathematics 2018-12-17 Yang Yang , Marius Pesavento

In this paper we propose a linear scalarization proximal point algorithm for solving arbitrary lower semicontinuous quasiconvex multiobjective minimization problems. Under some natural assumptions and using the condition that the proximal…

Solving an optimization problem whose objective function is the sum of two convex functions has received considerable interests in the context of image processing recently. In particular, we are interested in the scenario when a…

Computer Vision and Pattern Recognition · Computer Science 2014-12-16 Dai-Qiang Chen

In this manuscript, we propose a general proximal quasi-Newton method tailored for nonconvex and nonsmooth optimization problems, where we do not require the sequence of the variable metric (or Hessian approximation) to be uniformly bounded…

Optimization and Control · Mathematics 2025-07-28 Xiaoxi Jia

Global optimization problems with a quasi-concave objective function and linear constraints are studied. We point out that various other classes of global optimization problems can be expressed in this way. We present two algorithms, which…

Optimization and Control · Mathematics 2024-01-26 Daniel Ciripoi , Andreas Löhne , Benjamin Weißing

We consider the class of optimization problems arising from computationally intensive L1-regularized M-estimators, where the function or gradient values are very expensive to compute. A particular instance of interest is the L1-regularized…

Machine Learning · Statistics 2015-01-26 Kai Zhong , Ian E. H. Yen , Inderjit S. Dhillon , Pradeep Ravikumar

We present a proximal gradient method for solving convex multiobjective optimization problems, where each objective function is the sum of two convex functions, with one assumed to be continuously differentiable. The algorithm incorporates…

Optimization and Control · Mathematics 2024-04-18 Yunier Bello-Cruz , J. G. Melo , L. F. Prudente , R. V. G. Serra
‹ Prev 1 3 4 5 6 7 10 Next ›