English
Related papers

Related papers: A dynamic gradient approach to Pareto optimization…

200 papers

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is…

Optimization and Control · Mathematics 2016-02-08 Hideaki Iiduka

In this paper, we first study nonsmooth steepest descent method for nonsmooth functions defined on Hilbert space and establish the corresponding algorithm by proximal subgradients. Then, we use this algorithm to find stationary points for…

Optimization and Control · Mathematics 2015-02-25 Zhou Wei , Qing Hai He

We develop a rigorous framework for global non-convex optimization by reformulating the minimization problem as a discounted infinite-horizon optimal control problem. For non-convex, continuous, and possibly non-smooth objective functions…

Optimization and Control · Mathematics 2026-03-31 Yuyang Huang , Dante Kalise , Hicham Kouhkouh

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

In this work, we analyze the global convergence property of coordinate gradient descent with random choice of coordinates and stepsizes for non-convex optimization problems. Under generic assumptions, we prove that the algorithm iterate…

Optimization and Control · Mathematics 2022-12-01 Ziang Chen , Yingzhou Li , Jianfeng Lu

In this article, we present an efficient descent method for locally Lipschitz continuous multiobjective optimization problems (MOPs). The method is realized by combining a theoretical result regarding the computation of descent directions…

Optimization and Control · Mathematics 2021-03-05 Bennet Gebken , Sebastian Peitz

In this work, we consider methods for solving large-scale optimization problems with a possibly nonsmooth objective function. The key idea is to first specify a class of optimization algorithms using a generic iterative scheme involving…

Optimization and Control · Mathematics 2020-02-19 Sebastian Banert , Axel Ringh , Jonas Adler , Johan Karlsson , Ozan Öktem

This paper reviews the gradient sampling methodology for solving nonsmooth, nonconvex optimization problems. An intuitively straightforward gradient sampling algorithm is stated and its convergence properties are summarized. Throughout this…

Optimization and Control · Mathematics 2018-05-01 James V. Burke , Frank E. Curtis , Adrian S. Lewis , Michael L. Overton , Lucas E. A. Simões

In a Hilbert setting we aim to study a second order in time differential equation, combining viscous and Hessian-driven damping, containing a time scaling parameter function and a Tikhonov regularization term. The dynamical system is…

Optimization and Control · Mathematics 2024-04-24 Robert Ernö Csetnek , Mikhail A. Karapetyants

In a real Hilbert space setting, we study the convergence properties of an inexact gradient algorithm featuring both viscous and Hessian driven damping for convex differentiable optimization. In this algorithm, the gradient evaluation can…

Optimization and Control · Mathematics 2025-09-25 Harsh Choudhary , Jalal Fadili , Vyachelav Kungurtsev

This paper proposes a variational framework for multi-objective level set topology optimization. The approach interprets the level set function as a generalized coordinate of a fictitious material and derives its equation of motion from…

Optimization and Control · Mathematics 2026-03-25 Jan Oellerich , Takayuki Yamada

In this paper, we describe a new active-set algorithmic framework for minimizing a non-convex function over the unit simplex. At each iteration, the method makes use of a rule for identifying active variables (i.e., variables that are zero…

Optimization and Control · Mathematics 2020-05-19 Andrea Cristofari , Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

We propose a variant of the classical conditional gradient method for sparse inverse problems with differentiable measurement models. Such models arise in many practical problems including superresolution, time-series modeling, and matrix…

Optimization and Control · Mathematics 2015-07-07 Nicholas Boyd , Geoffrey Schiebinger , Benjamin Recht

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

In a Hilbert setting, we develop a gradient-based dynamic approach for fast solving convex optimization problems. By applying time scaling, averaging, and perturbation techniques to the continuous steepest descent (SD), we obtain…

Optimization and Control · Mathematics 2023-05-05 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen

We present a generic coordinate descent solver for the minimization of a nonsmooth convex objective with structure. The method can deal in particular with problems with linear constraints. The implementation makes use of efficient residual…

Optimization and Control · Mathematics 2019-09-27 Olivier Fercoq

A generalized conditional gradient method for minimizing the sum of two convex functions, one of them differentiable, is presented. This iterative method relies on two main ingredients: First, the minimization of a partially linearized…

Optimization and Control · Mathematics 2021-10-01 Karl Kunisch , Daniel Walter

In this paper we analyze several new methods for solving nonconvex optimization problems with the objective function formed as a sum of two terms: one is nonconvex and smooth, and another is convex but simple and its structure is known.…

Optimization and Control · Mathematics 2014-06-25 A. Patrascu , I. Necoara