English
Related papers

Related papers: Improved Front Steepest Descent for Multi-objectiv…

200 papers

We propose a descent subgradient algorithm for unconstrained nonsmooth nonconvex multiobjective optimization problems. To find a descent direction, we present an iterative process that efficiently approximates the Goldstein subdifferential…

Optimization and Control · Mathematics 2024-06-24 Morteza Maleknia , Majid Soleimani-damaneh

Two popular examples of first-order optimization methods over linear spaces are coordinate descent and matching pursuit algorithms, with their randomized variants. While the former targets the optimization by moving along coordinates, the…

In the context of the optimization of rotating electric machines, many different objective functions are of interest and considering this during the optimization is of crucial importance. While evolutionary algorithms can provide a Pareto…

Optimization and Control · Mathematics 2024-04-19 Alessio Cesarano , Peter Gangl

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

In this paper, a new one-parameter filled function approach is developed for nonlinear multi-objective optimization. Inspired by key filled function ideas from single-objective optimization, the proposed method is adapted to the…

Optimization and Control · Mathematics 2026-04-01 Bikram Adhikary , Md Abu Talhamainuddin Ansary

It is desirable in many multi-objective machine learning applications, such as multi-task learning with conflicting objectives and multi-objective reinforcement learning, to find a Pareto solution that can match a given preference of a…

Machine Learning · Computer Science 2024-02-19 Xiaoyuan Zhang , Xi Lin , Qingfu Zhang

In this paper, we analyze the mirror descent algorithm for non-smooth optimization problems in which the objective function is relatively strongly convex, without relying on the standard Lipschitz continuity assumption commonly used in the…

Optimization and Control · Mathematics 2026-03-03 Mohammad S. Alkousa , Fedor S. Stonyakin

Multi-objective gradient methods are becoming the standard for solving multi-objective problems. Among others, they show promising results in developing multi-objective recommender systems with both correlated and conflicting objectives.…

Machine Learning · Computer Science 2021-09-02 Blagoj Mitrevski , Milena Filipovic , Diego Antognini , Emma Lejal Glaude , Boi Faltings , Claudiu Musat

Data-driven evolutionary multi-objective optimization (EMO) has been recognized as an effective approach for multi-objective optimization problems with expensive objective functions. The current research is mainly developed for problems…

Neural and Evolutionary Computing · Computer Science 2022-05-31 Renzhi Chen , Ke Li

Online-learning research has mainly been focusing on minimizing one objective function. In many real-world applications, however, several objective functions have to be considered simultaneously. Recently, an algorithm for dealing with…

Machine Learning · Computer Science 2017-03-21 Guy Uziel , Ran El-Yaniv

Multi-objective integer or mixed-integer programming problems typically have disconnected feasible domains, making the task of constructing an approximation of the Pareto front challenging. The present paper shows that certain algorithms…

Optimization and Control · Mathematics 2021-05-25 Regina S. Burachik , C. Yalçın Kaya , M. Mustafa Rizvi

This note proposes an effective pruning-based Pareto front generation method in mixed-discrete bi-objective optimization. The mixed-discrete problem is decomposed into multiple continuous subproblems; two-phase pruning steps identify and…

Optimization and Control · Mathematics 2013-06-10 SeungBum Hong , Jaemyung Ahn , Han-Lim Choi

In this note we aim at putting more emphasis on the fact that trying to solve non-convex optimization problems with coordinate-descent iterative linear matrix inequality algorithms leads to suboptimal solutions, and put forward other…

Optimization and Control · Mathematics 2024-10-30 Emile Simon , Vincent Wertz

This article introduces the multi-objective adaptive order Caputo fractional gradient descent (MOAOCFGD) algorithm for solving unconstrained multi-objective problems. The proposed method performs equally well for both smooth and non-smooth…

Optimization and Control · Mathematics 2025-07-11 Barsha Shaw , Md Abu Talhamainuddin Ansary

In general, a multi-objective optimization problem does not have a single optimal solution but a set of Pareto optimal solutions, which forms the Pareto front in the objective space. Various evolutionary algorithms have been proposed to…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Hisao Ishibuchi , Lie Meng Pang , Ke Shang

In this work, we propose a novel method to tackle the problem of multiobjective optimization under parameteric uncertainties, by considering the Conditional Pareto Sets and Conditional Pareto Fronts. Based on those quantities we can define…

Optimization and Control · Mathematics 2026-01-15 Victor Trappler , Céline Helbert , Rodolphe Le Riche

We present some extensions to the limited memory steepest descent method based on spectral properties and cyclic iterations. Our aim is to show that it is possible to combine sweep and delayed strategies for improving the performance of…

Numerical Analysis · Mathematics 2019-12-10 Qinmeng Zou , Frederic Magoules

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

Machine Learning · Statistics 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

We consider the minimization of an M-convex function, which is a discrete convexity concept for functions on the integer lattice points. It is known that a minimizer of an Mconvex function can be obtained by the steepest descent algorithm.…

Optimization and Control · Mathematics 2025-03-04 Taihei Oki , Akiyoshi Shioura

First-order optimization methods tend to inherently favor certain solutions over others when minimizing an underdetermined training objective that has multiple global optima. This phenomenon, known as implicit bias, plays a critical role in…

Machine Learning · Computer Science 2024-04-09 Guanghui Wang , Zihao Hu , Claudio Gentile , Vidya Muthukumar , Jacob Abernethy