English
Related papers

Related papers: Two nonmonotone multiobjective memory gradient alg…

200 papers

Multi-objective Bayesian optimization aims to find the Pareto front of trade-offs between a set of expensive objectives while collecting as few samples as possible. In some cases, it is possible to evaluate the objectives separately, and a…

Machine Learning · Statistics 2025-03-04 Jack M. Buckingham , Sebastian Rojas Gonzalez , Juergen Branke

In biobjective mixed integer linear programs (BOMILPs), two linear objectives are minimized over a polyhedron while restricting some of the variables to be integer. Since many of the techniques for finding or approximating the Pareto set of…

Data Structures and Algorithms · Computer Science 2018-09-17 Nathan Adelgren , Pietro Belotti , Akshay Gupte

Finding diverse solutions to optimization problems has been of practical interest for several decades, and recently enjoyed increasing attention in research. While submodular optimization has been rigorously studied in many fields, its…

Data Structures and Algorithms · Computer Science 2023-07-18 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

Expensive multi-objective optimization problems can be found in many real-world applications, where their objective function evaluations involve expensive computations or physical experiments. It is desirable to obtain an approximate Pareto…

Neural and Evolutionary Computing · Computer Science 2022-10-18 Xi Lin , Zhiyuan Yang , Xiaoyuan Zhang , Qingfu Zhang

Although traditional optimization methods focus on finding a single optimal solution, most objective functions in modern machine learning problems, especially those in deep learning, often have multiple or infinite numbers of optima.…

Machine Learning · Computer Science 2022-02-18 Chengyue Gong , Lemeng Wu , Qiang Liu

We propose an optimization proxy in terms of iterative implicit gradient methods for solving constrained optimization problems with nonconvex loss functions. This framework can be applied to a broad range of machine learning settings,…

Optimization and Control · Mathematics 2025-10-14 Harshal D. Kaushik , Ming Jin

In a general Hilbert framework, we consider continuous gradient-like dynamical systems for constrained multiobjective optimization involving non-smooth convex objective functions. Our approach is in the line of a previous work where was…

Optimization and Control · Mathematics 2017-07-14 Hedy Attouch , Guillaume Garrigos , Xavier Goudou

Specialized function gradient computing hardware could greatly improve the performance of state-of-the-art optimization algorithms, e.g., based on gradient descent or conjugate gradient methods that are at the core of control, machine…

Many existing branch and bound algorithms for multiobjective optimization problems require a significant computational cost to approximate the entire Pareto optimal solution set. In this paper, we propose a new branch and bound algorithm…

Optimization and Control · Mathematics 2024-05-20 Weitian Wu , Xinmin Yang

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

This paper introduces a nonlinear conjugate gradient method (NCGM) for addressing the robust counterpart of uncertain multiobjective optimization problems (UMOPs). Here, the robust counterpart is defined as the minimum across objective-wise…

Optimization and Control · Mathematics 2025-03-04 Shubham Kumar , Nihar Kumar Mahato , Debdas Ghosh

We consider bi-objective ranking and selection problems, where the goal is to correctly identify the Pareto optimal solutions among a finite set of candidates for which the two objective outcomes have been observed with uncertainty (e.g.,…

Machine Learning · Statistics 2024-03-29 Sebastian Rojas Gonzalez , Juergen Branke , Inneke van Nieuwenhuyse

We study the problem of optimizing nonlinear objective functions over bipartite matchings. While the problem is generally intractable, we provide several efficient algorithms for it, including a deterministic algorithm for maximizing convex…

Optimization and Control · Mathematics 2008-07-24 Yael Berstein , Shmuel Onn

We present a generic branch-and-bound algorithm for finding all the Pareto solutions of a biobjective mixed-integer linear program. The main contributions are new algorithms for obtaining dual bounds at a node, for checking node fathoming,…

Optimization and Control · Mathematics 2021-12-06 Nathan Adelgren , Akshay Gupte

We propose a model of Pareto optimization (multi-objective programming) in the context of a categorical theory of resources. We describe how to adapt multi-objective swarm intelligence algorithms to this categorical formulation.

Category Theory · Mathematics 2022-04-27 Matilde Marcolli

As machine learning (ML) applications grow increasingly complex in recent years, modern ML frameworks often need to address multiple potentially conflicting objectives with coupled decision variables across different layers. This creates a…

Machine Learning · Computer Science 2025-11-12 Zhiyao Zhang , Zhuqing Liu , Xin Zhang , Wen-Yen Chen , Jiyan Yang , Jia Liu

Multicriterion optimization and Pareto optimality are fundamental tools in economics. In this paper we propose a new relaxation method for solving multiple objective quadratic programming problems. Exploiting the technique of the linear…

Optimization and Control · Mathematics 2012-11-21 Yan-Qin Bai , Chuan-Hao Guo

Sequential decision-making problems with multiple objectives arise naturally in practice and pose unique challenges for research in decision-theoretic planning and learning, which has largely focused on single-objective settings. This…

Artificial Intelligence · Computer Science 2014-02-05 Diederik Marijn Roijers , Peter Vamplew , Shimon Whiteson , Richard Dazeley

We propose an inexact variable-metric proximal point algorithm to accelerate gradient-based optimization algorithms. The proposed scheme, called QNing can be notably applied to incremental first-order methods such as the stochastic…

Machine Learning · Statistics 2019-01-30 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

Although application examples of multilevel optimization have already been discussed since the 1990s, the development of solution methods was almost limited to bilevel cases due to the difficulty of the problem. In recent years, in machine…

Optimization and Control · Mathematics 2021-10-27 Ryo Sato , Mirai Tanaka , Akiko Takeda