English
Related papers

Related papers: Multiobjectivization of Local Search: Single-Objec…

200 papers

Non-convex optimization is ubiquitous in modern machine learning. Researchers devise non-convex objective functions and optimize them using off-the-shelf optimizers such as stochastic gradient descent and its variants, which leverage the…

Machine Learning · Computer Science 2021-03-26 Tengyu Ma

This paper proposes a multiobjective multitasking optimization evolutionary algorithm based on decomposition with dual neighborhood. In our proposed algorithm, each subproblem not only maintains a neighborhood based on the Euclidean…

Computational Engineering, Finance, and Science · Computer Science 2021-01-20 Xianpeng Wang , Zhiming Dong , Lixin Tang , Qingfu Zhang

Multi-objectivization is a term used to describe strategies developed for optimizing single-objective problems by multi-objective algorithms. This paper focuses on multi-objectivizing the sum-of-the-parts combinatorial optimization…

Neural and Evolutionary Computing · Computer Science 2021-02-04 Jialong Shi , Jianyong Sun , Qingfu Zhang

Optimization algorithms are pivotal in advancing various scientific and industrial fields but often encounter obstacles such as trapping in local minima, saddle points, and plateaus (flat regions), which makes the convergence to reasonable…

Optimization and Control · Mathematics 2026-01-15 Amir M. Vahedi , Horea T. Ilies

Most multimodal multi-objective evolutionary algorithms (MMEAs) aim to find all global Pareto optimal sets (PSs) for a multimodal multi-objective optimization problem (MMOP). However, in real-world problems, decision makers (DMs) may be…

Neural and Evolutionary Computing · Computer Science 2023-06-13 Wenhua Li , Xingyi Yao , Kaiwen Li , Rui Wang , Tao Zhang , Ling Wang

Bilevel optimization has been developed for many machine learning tasks with large-scale and high-dimensional data. This paper considers a constrained bilevel optimization problem, where the lower-level optimization problem is convex with…

Machine Learning · Computer Science 2023-08-22 Siyuan Xu , Minghui Zhu

Recently, a deep reinforcement learning method is proposed to solve multiobjective optimization problem. In this method, the multiobjective optimization problem is decomposed to a number of single-objective optimization subproblems and all…

Neural and Evolutionary Computing · Computer Science 2020-02-14 Hong Wu , Jiahai Wang , Zizhen Zhang

This study aims to optimize the evaluation metric of multimodal multi-objective optimization problems using a Regionalized Metric Framework, which provides a certain boost to research in this field. Existing evaluation metrics usually use…

Neural and Evolutionary Computing · Computer Science 2025-06-03 Jintai Chen , Fangqing Liu , Xueming Yan , Han Huang

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

In machine learning, nonconvex optimization problems with multiple local optimums are often encountered. Graduated Optimization Algorithm (GOA) is a popular heuristic method to obtain global optimums of nonconvex problems through…

Machine Learning · Computer Science 2017-07-11 Li Chen , Shuisheng Zhou , Zhuan Zhang

When addressing the challenge of complex multi-objective optimization problems, particularly those with non-convex and non-uniform Pareto fronts, Decomposition-based Multi-Objective Evolutionary Algorithms (MOEADs) often converge to local…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Ting Dong , Haoxin Wang , Hengxi Zhang , Wenbo Ding

Studies have shown that multi-objective optimization problems are hard problems. Such problems either require longer time to converge to an optimum solution, or may not converge at all. Recently some researchers have claimed that real…

Neural and Evolutionary Computing · Computer Science 2014-06-11 Shahab U. Ansari , Sameen Mansha

We consider the problem of composed image retrieval that takes an input query consisting of an image and a modification text indicating the desired changes to be made on the image and retrieves images that match these changes. Current…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Prateksha Udhayanan , Srikrishna Karanam , Balaji Vasan Srinivasan

In this paper we consider multi-objective optimization problems over a box. The problem is very relevant and several computational approaches have been proposed in the literature. They broadly fall into two main classes: evolutionary…

Optimization and Control · Mathematics 2022-12-08 Matteo Lapucci , Pierluigi Mansueto , Fabio Schoen

Arising in semi-parametric statistics, control applications, and as sub-problems in global optimization methods, certain optimization problems can have objective functions requiring numerical integration to evaluate, yet gradient function…

Optimization and Control · Mathematics 2025-03-06 Christian Varner , Vivak Patel

Finding multiple solutions of non-convex optimization problems is a ubiquitous yet challenging task. Most past algorithms either apply single-solution optimization methods from multiple random initial guesses or search in the vicinity of…

Machine Learning · Computer Science 2023-03-03 Lingxiao Li , Noam Aigerman , Vladimir G. Kim , Jiajin Li , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

In this paper, we study the Multi-Objective Bi-Level Optimization (MOBLO) problem, where the upper-level subproblem is a multi-objective optimization problem and the lower-level subproblem is for scalar optimization. Existing gradient-based…

Machine Learning · Computer Science 2024-07-11 Feiyang Ye , Baijiong Lin , Xiaofeng Cao , Yu Zhang , Ivor Tsang

A multi-modal multi-objective optimization problem is a special kind of multi-objective optimization problem with multiple Pareto subsets. In this paper, we propose an efficient multi-modal multi-objective optimization algorithm based on…

Neural and Evolutionary Computing · Computer Science 2020-04-22 Yiming Peng , Hisao Ishibuchi

In this article we develop a gradient-based algorithm for the solution of multiobjective optimization problems with uncertainties. To this end, an additional condition is derived for the descent direction in order to account for…

Optimization and Control · Mathematics 2018-08-02 Sebastian Peitz , Michael Dellnitz

Multi-objective optimization (MOO) lies at the core of many machine learning (ML) applications that involve multiple, potentially conflicting objectives (e.g., multi-task learning, multi-objective reinforcement learning, among many others).…

Machine Learning · Computer Science 2024-12-18 Mingjing Xu , Peizhong Ju , Jia Liu , Haibo Yang