English
Related papers

Related papers: Non-Extreme Individual Minima for Improved Pareto …

200 papers

Optimization of resonances associated with 1-D wave equations in inhomogeneous media is studied under the constraint $\| B \|_1 <= m$ on the nonnegative function $B \in L^1 (0,\ell)$ that represents the medium's structure. From the Physics…

Optimization and Control · Mathematics 2014-06-23 Illya M. Karabash

Current approaches to group fairness in federated learning assume the existence of predefined and labeled sensitive groups during training. However, due to factors ranging from emerging regulations to dynamics and location-dependency of…

Machine Learning · Computer Science 2024-02-26 Afroditi Papadaki , Natalia Martinez , Martin Bertran , Guillermo Sapiro , Miguel Rodrigues

In this paper, we deal with the Front Steepest Descent algorithm for multi-objective optimization. We point out that the algorithm from the literature is often incapable, by design, of spanning large portions of the Pareto front. We thus…

Optimization and Control · Mathematics 2023-03-17 Matteo Lapucci , Pierluigi Mansueto

Multi-objective Bayesian optimization aims to find the Pareto front of trade-offs between a set of expensive objectives while collecting as few samples as possible. In some cases, it is possible to evaluate the objectives separately, and a…

Machine Learning · Statistics 2025-03-04 Jack M. Buckingham , Sebastian Rojas Gonzalez , Juergen Branke

It has been shown that dimension reduction methods such as PCA may be inherently prone to unfairness and treat data from different sensitive groups such as race, color, sex, etc., unfairly. In pursuit of fairness-enhancing dimensionality…

Machine Learning · Computer Science 2020-03-10 Mohammad Mahdi Kamani , Farzin Haddadpour , Rana Forsati , Mehrdad Mahdavi

Scalarization allows to solve a multi-objective optimization problem by solving many single-objective sub-problems, uniquely determined by some parameters. In this work, we propose several adaptive strategies to select such parameters in…

Optimization and Control · Mathematics 2022-11-08 Giacomo Borghi

The proliferation of saddle points, rather than poor local minima, is increasingly understood to be a primary obstacle in large-scale non-convex optimization for machine learning. Variable elimination algorithms, like Variable Projection…

Machine Learning · Computer Science 2025-11-04 Min Gan , Guang-Yong Chen , Yang Yi , Lin Yang

Ample empirical evidence in deep neural network training suggests that a variety of optimizers tend to find nearly global optima. In this article, we adopt the reversed perspective that convergence to an arbitrary point is assumed rather…

Machine Learning · Computer Science 2025-10-13 Jerome Bolte , Quoc-Tung Le , Edouard Pauwels

In this paper, we develop a global descent method for non-convex multi-objective optimization problems. The proposed approach builds upon foundational concepts from single-objective global descent techniques while removing the need for…

Optimization and Control · Mathematics 2025-07-31 Bikram Adhikary , Md Abu Talhamainuddin Ansary , Savin Treanta

In this paper, we tackle the problem of computing a sequence of rankings with the guarantee of the Pareto-optimal balance between (1) maximizing the utility of the consumers and (2) minimizing unfairness between producers of the items. Such…

Information Retrieval · Computer Science 2024-02-23 Phuong Dinh Mai , Duc-Trong Le , Tuan-Anh Hoang , Dung D. Le

In decision-making systems, algorithmic recourse aims to identify minimal-cost actions to alter an individual features, thereby obtaining a desired outcome. This empowers individuals to understand, question, or alter decisions that…

Machine Learning · Computer Science 2025-02-12 Wen-Ling Chen , Hong-Chang Huang , Kai-Hung Lin , Shang-Wei Hwang , Hao-Tsung Yang

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

We introduce a nonmonotone extension of the Front Descent framework for multiobjective optimization. The method uses novel nonmonotone line searches that allow temporary increases in some objective functions. To our knowledge, this is the…

Optimization and Control · Mathematics 2025-09-03 Pierluigi Mansueto

Many communication and control problems are cast as multi-objective Markov decision processes (MOMDPs). The complete solution to an MOMDP is the Pareto front. Much of the literature approximates this front via scalarization into…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Jiping Luo , Nikolaos Pappas

Nervous systems, like any organismal structure, have been shaped by evolutionary processes to increase fitness. The resulting neural 'bauplan' has to account for multiple objectives simultaneously, including computational function as well…

Neurons and Cognition · Quantitative Biology 2021-05-05 Fabian Pallasdies , Philipp Norton , Jan-Hendrik Schleimer , Susanne Schreiber

Multidimensional optimization problems where the objective function and the constraints are multiextremal non-differentiable Lipschitz functions (with unknown Lipschitz constants) and the feasible region is a finite collection of robust…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Paolo Pugliese , Domenico Famularo

The evaluation of heuristic optimizers on test problems, better known as \emph{benchmarking}, is a cornerstone of research in multi-objective optimization. However, most test problems used in benchmarking numerical multi-objective black-box…

Optimization and Control · Mathematics 2026-01-26 Lennart Schäpermeier , Pascal Kerschke

Multi-Objective Markov Decision Processes (MO-MDPs) are receiving increasing attention, as real-world decision-making problems often involve conflicting objectives that cannot be addressed by a single-objective MDP. The Pareto front…

Machine Learning · Computer Science 2025-02-11 Yining Li , Peizhong Ju , Ness B. Shroff

The main challenge of nonconvex optimization is to find a global optimum, or at least to avoid ``bad'' local minima and meaningless stationary points. We study here the extent to which algorithms, as opposed to optimization models and…

Optimization and Control · Mathematics 2025-02-27 Thi Lan Dinh , Wiebke Bennecke , G. S. Matthijs Jansen , D. Russell Luke , Stefan Mathias

Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond…

Machine Learning · Computer Science 2023-10-25 Jinbiao Chen , Zizhen Zhang , Zhiguang Cao , Yaoxin Wu , Yining Ma , Te Ye , Jiahai Wang