English
Related papers

Related papers: LibMOON: A Gradient-based MultiObjective Optimizat…

200 papers

Multi-objective optimization problems (MOPs) often require a trade-off between conflicting objectives, maximizing diversity and convergence in the objective space. This study presents an approach to improve the quality of MOP solutions by…

Optimization and Control · Mathematics 2026-02-02 Gladston Moreira , Ivan Meneghini , Elizabeth Wanner

Choices in scientific research and management require balancing multiple, often competing objectives.Multiple-objective optimization (MOO) provides a unifying framework for solving multiple objective problems. Model selection is a critical…

Applications · Statistics 2018-10-26 Perry Williams , William Kendall , Mevin Hooten

Recent advances in learnable evolutionary algorithms have demonstrated the importance of leveraging population distribution information and historical evolutionary trajectories. While significant progress has been made in continuous…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Jiaxiang Huang , Licheng Jiao

Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in…

Machine Learning · Computer Science 2024-03-20 Heshan Fernando , Han Shen , Miao Liu , Subhajit Chaudhury , Keerthiram Murugesan , Tianyi Chen

This paper addresses the problem of constrained multi-objective optimization over black-box objective functions with practitioner-specified preferences over the objectives when a large fraction of the input space is infeasible (i.e.,…

Machine Learning · Computer Science 2023-03-24 Alaleh Ahmadianshalchi , Syrine Belakaria , Janardhan Rao Doppa

Multi-objective optimization problems whose objectives have different evaluation costs are commonly seen in the real world. Such problems are now known as multi-objective optimization problems with heterogeneous objectives (HE-MOPs). So…

Neural and Evolutionary Computing · Computer Science 2022-08-26 Xilu Wang , Yaochu Jin , Sebastian Schmitt , Markus Olhofer

Real-world problems often involve the optimization of several objectives under multiple constraints. An example is the hyper-parameter tuning problem of machine learning algorithms. In particular, the minimization of the estimation of the…

Machine Learning · Statistics 2021-07-02 Eduardo C. Garrido-Merchán , Daniel Hernández-Lobato

Multiobjective simulation optimization (MOSO) problems are optimization problems with multiple conflicting objectives, where evaluation of at least one of the objectives depends on a black-box numerical code or real-world experiment, which…

Optimization and Control · Mathematics 2025-01-13 Tyler H. Chang , Stefan M. Wild

The multi-objective optimization is to optimize several objective functions over a common feasible set. Since the objectives usually do not share a common optimizer, people often consider (weakly) Pareto points. This paper studies…

Optimization and Control · Mathematics 2023-12-05 Jiawang Nie , Zi Yang

Real-world problems are often multi-objective with decision-makers unable to specify a priori which trade-off between the conflicting objectives is preferable. Intuitively, building machine learning solutions in such cases would entail…

Machine Learning · Computer Science 2021-10-20 Timo M. Deist , Monika Grewal , Frank J. W. M. Dankers , Tanja Alderliesten , Peter A. N. Bosman

Real-world problems are often comprised of many objectives and require solutions that carefully trade-off between them. Current approaches to many-objective optimization often require challenging assumptions, like knowledge of the…

Neural and Evolutionary Computing · Computer Science 2023-07-07 Jackson Dean , Nick Cheney

The goal of multi-objective optimization is to understand optimal trade-offs between competing objective functions by finding the Pareto front, i.e., the set of all Pareto optimal solutions, where no objective can be improved without…

Post-training of LLMs with RLHF, and subsequently preference optimization algorithms such as DPO, IPO, etc., made a big difference in improving human alignment. However, all such techniques can only work with a single (human) objective. In…

Machine Learning · Computer Science 2025-05-19 Akhil Agnihotri , Rahul Jain , Deepak Ramachandran , Zheng Wen

Multi-objective optimization (MOO) problems require balancing competing objectives, often under constraints. The Pareto optimal solution set defines all possible optimal trade-offs over such objectives. In this work, we present a novel…

Machine Learning · Computer Science 2022-04-19 Soumyajit Gupta , Gurpreet Singh , Raghu Bollapragada , Matthew Lease

The main feature of the Dynamic Multi-objective Optimization Problems (DMOPs) is that optimization objective functions will change with times or environments. One of the promising approaches for solving the DMOPs is reusing the obtained…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Weizhen Hu , Min Jiang , Xing Gao , Kay Chen Tan , Yiu-ming Cheung

We present BackboneLearn: an open-source software package and framework for scaling mixed-integer optimization (MIO) problems with indicator variables to high-dimensional problems. This optimization paradigm can naturally be used to…

Machine Learning · Computer Science 2023-11-27 Vassilis Digalakis , Christos Ziakas

Bilevel optimization problems comprise an upper level optimization task that contains a lower level optimization task as a constraint. While there is a significant and growing literature devoted to solving bilevel problems with single…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Bing Wang , Hemant K. Singh , Tapabrata Ray

Multi-objective combinatorial optimization seeks Pareto-optimal solutions over exponentially large discrete spaces, yet existing methods sacrifice generality, scalability, or theoretical guarantees. We reformulate it as an online learning…

Machine Learning · Computer Science 2026-02-13 Esha Singh , Dongxia Wu , Chien-Yi Yang , Tajana Rosing , Rose Yu , Yi-An Ma

Numerous real-world applications of uncertain multiobjective optimization problems (UMOPs) can be found in science, engineering, business, and management. To handle the solution of uncertain optimization problems, robust optimization is a…

Optimization and Control · Mathematics 2025-03-11 Shubham Kumar , Nihar Kumar Mahatoa , Debdas Ghosh

Efficiently solving multi-objective optimization problems for simulation optimization of important scientific and engineering applications such as materials design is becoming an increasingly important research topic. This is due largely to…

Artificial Intelligence · Computer Science 2023-06-27 Eric Hans Lee , Bolong Cheng , Michael McCourt