English
Related papers

Related papers: Improved Front Steepest Descent for Multi-objectiv…

200 papers

This paper provides a novel framework for solving multiobjective discrete optimization problems with an arbitrary number of objectives. Our framework formulates these problems as network models, in that enumerating the Pareto frontier…

Optimization and Control · Mathematics 2018-09-06 David Bergman , Merve Bodur , Carlos Cardonha , Andre A. Cire

This paper focuses on developing a conditional gradient algorithm for multiobjective optimization problems with an unbounded feasible region. We employ the concept of recession cone to establish the well-defined nature of the algorithm. The…

Optimization and Control · Mathematics 2024-03-06 Wang Chen , Yong Zhao , Liping Tang , Xinmin Yang

In this paper we consider convergence rate problems for stochastic strongly-convex optimization in the non-Euclidean sense with a constraint set over a time-varying multi-agent network. We propose two efficient non-Euclidean stochastic…

Optimization and Control · Mathematics 2018-08-23 Deming Yuan , Yiguang Hong , Daniel W. C. Ho , Guoping Jiang

We propose a first order algorithm, a modified version of FISTA, to solve an optimization problem with an objective function that is a sum of a possibly nonconvex function, with Lipschitz continuous gradient, and a convex function which can…

Optimization and Control · Mathematics 2025-08-20 Chee-Khian Sim

When solving optimization problems with multiple objective functions we are often faced with the situation that one or several objective functions are non-convex or that we can not easily show the convexity of all functions involved. In…

Optimization and Control · Mathematics 2020-04-01 Kerstin Dächert , Katrin Teichert

For minimizing a strongly convex objective function subject to linear inequality constraints, we consider a penalty approach that allows one to utilize stochastic methods for problems with a large number of constraints and/or objective…

Optimization and Control · Mathematics 2022-02-16 Meng Li , Paul Grigas , Alper Atamturk

Variational inequalities play a key role in machine learning research, such as generative adversarial networks, reinforcement learning, adversarial training, and generative models. This paper is devoted to the constrained variational…

Machine Learning · Computer Science 2026-05-19 Mohammad S. Alkousa , Fedor S. Stonyakin , Belal A. Alashqar , Seydamet S. Ablaev

Consider convex optimization problems subject to a large number of constraints. We focus on stochastic problems in which the objective takes the form of expected values and the feasible set is the intersection of a large number of convex…

Machine Learning · Statistics 2015-11-13 Mengdi Wang , Yichen Chen , Jialin Liu , Yuantao Gu

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

Machine Learning · Computer Science 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

We study the problem of minimizing a $m$-weakly convex and possibly nonsmooth function. Weak convexity provides a broad framework that subsumes convex, smooth, and many composite nonconvex functions. In this work, we propose a…

Optimization and Control · Mathematics 2025-09-04 Feng-Yi Liao , Yang Zheng

We consider stochastic convex optimization with a strongly convex (but not necessarily smooth) objective. We give an algorithm which performs only gradient updates with optimal rate of convergence.

Optimization and Control · Mathematics 2010-06-15 Elad Hazan , Satyen Kale

Modern machine learning models are often constructed taking into account multiple objectives, e.g., minimizing inference time while also maximizing accuracy. Multi-objective hyperparameter optimization (MHPO) algorithms return such…

Machine Learning · Computer Science 2024-02-29 Matthias Feurer , Katharina Eggensperger , Edward Bergman , Florian Pfisterer , Bernd Bischl , Frank Hutter

We revisit the asymptotic bias analysis of the distributed Pareto optimization algorithm developed based on the diffusion strategies. We propose an alternative way to analyze the asymptotic bias of this algorithm at small step-sizes and…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner , Yih-Fang Huang

In this paper, we propose a fast proximal gradient algorithm for multiobjective optimization, it is proved that the convergence rate of the accelerated algorithm for multiobjective optimization developed by Tanabe et al. can be improved…

Optimization and Control · Mathematics 2023-12-13 Jie Zhang , Xinmin Yang

Many existing branch and bound algorithms for multiobjective optimization problems require a significant computational cost to approximate the entire Pareto optimal solution set. In this paper, we propose a new branch and bound algorithm…

Optimization and Control · Mathematics 2024-05-20 Weitian Wu , Xinmin Yang

Flower pollination algorithm is a new nature-inspired algorithm, based on the characteristics of flowering plants. In this paper, we extend this flower algorithm to solve multi-objective optimization problems in engineering. By using the…

Neural and Evolutionary Computing · Computer Science 2014-04-04 Xin-She Yang , M. Karamanoglu , Xingshi He

The paper is devoted to new modifications of recently proposed adaptive methods of Mirror Descent for convex minimization problems in the case of several convex functional constraints. Methods for problems of two classes are considered. The…

Optimization and Control · Mathematics 2018-05-29 Fedor S. Stonyakin , Mohammad S. Alkousa , Alexey N. Stepanov , Maxim A. Barinov

The breakthrough ideas in the modern proximal splitting methodologies allow us to express the set of all minimizers of a superposition of multiple nonsmooth convex functions as the fixed point set of computable nonexpansive operators. In…

Optimization and Control · Mathematics 2022-07-01 Isao Yamada , Masao Yamagishi

This paper introduces a differentiable representation for the optimization of boustrophedon path plans in convex polygons, explores an additional parameter of these path plans that can be optimized, discusses the properties of this…

Robotics · Computer Science 2024-02-21 Thomas Manzini , Robin Murphy

A multi-condition multi-objective optimization method that can find Pareto front over a defined condition space is developed for the first time using deep reinforcement learning. Unlike the conventional methods which perform optimization at…

Machine Learning · Computer Science 2022-05-25 Sejin Kim , Innyoung Kim , Donghyun You