English
Related papers

Related papers: A multiobjective optimization approach to statisti…

200 papers

Many systems require optimisation over multiple objectives, where objectives are characteristics of the system such as energy consumed or increase in time to perform the work. Optimisation is performed by selecting the `best' set of input…

Performance · Computer Science 2019-10-08 Alexander J. M. Kell , Matthew Forshaw , A. Stephen McGough

Balancing competing objectives is omnipresent across disciplines, from drug design to autonomous systems. Multi-objective Bayesian optimization is a promising solution for such expensive, black-box problems: it fits probabilistic surrogates…

Machine Learning · Computer Science 2026-05-13 Xinyu Zhang , Conor Hassan , Julien Martinelli , Daolang Huang , Samuel Kaski

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

In one of our earlier works, we proposed to approximate Pareto fronts to multiobjective optimization problems by two-sided approximations, one from inside and another from outside of the feasible objective set, called, respectively, lower…

Optimization and Control · Mathematics 2018-04-24 Ignacy Kaliszewski , Janusz Miroforidis

Multi-task learning is a powerful method for solving multiple correlated tasks simultaneously. However, it is often impossible to find one single solution to optimize all the tasks, since different tasks might conflict with each other.…

Machine Learning · Computer Science 2020-01-01 Xi Lin , Hui-Ling Zhen , Zhenhua Li , Qingfu Zhang , Sam Kwong

Design problems in industrial engineering often involve a large number of design variables with multiple objectives, under complex nonlinear constraints. The algorithms for multiobjective problems can be significantly different from the…

Optimization and Control · Mathematics 2013-03-27 Xin-She Yang

Modern machine learning tasks often require considering not just one but multiple objectives. For example, besides the prediction quality, this could be the efficiency, robustness or fairness of the learned models, or any of their…

Machine Learning · Computer Science 2022-08-30 Peter Súkeník , Christoph H. Lampert

Optimization of three-dimensional road alignments is a nonlinear non-convex optimization problem. The development of models that fully optimize a three-dimensional road alignment problem is challenging due to numerous factors involved and…

Optimization and Control · Mathematics 2016-02-04 D. Hirpa , W. Hare , Y. Lucet , Y. Pushak , S. Tesfamariam

Many machine learning tasks aim to find models that work well not for a single, but for a group of criteria, often opposing ones. One such example is imbalanced data classification, where, on the one hand, we want to achieve the best…

Machine Learning · Computer Science 2025-11-18 Szymon Wojciechowski , Michał Woźniak

There is a well known intrinsic trade-off between the fairness of a representation and the performance of classifiers derived from the representation. Due to the complexity of optimisation algorithms in most modern representation learning…

Machine Learning · Statistics 2025-10-27 Mark Kozdoba , Binyamin Perets , Shie Mannor

Multi-objective optimization is central to many engineering and machine learning applications, where multiple objectives must be optimized in balance. While multi-gradient based optimization methods combine these objectives in each step,…

Optimization and Control · Mathematics 2026-05-13 Trang H. Tran , Luis Nunes Vicente

Many optimization problems arising in applications have to consider several objective functions at the same time. Evolutionary algorithms seem to be a very natural choice for dealing with multi-objective problems as the population of such…

Neural and Evolutionary Computing · Computer Science 2013-09-17 Tobias Friedrich , Frank Neumann , Christian Thyssen

In this paper, we consider black-box multiobjective optimization problems in which all objective functions are not given analytically. In multiobjective optimization, it is important to produce a set of uniformly distributed discrete…

Optimization and Control · Mathematics 2022-02-11 Kwang-Hui Ju , Ju-Song Kim

Selecting the optimal material for a part designed through topology optimization is a complex problem. The shape and properties of the Pareto front plays an important role in this selection. In this paper we show that the compliance-volume…

Optimization and Control · Mathematics 2022-11-29 Edouard Duriez , Miguel Charlotte , Catherine Azzaro-Pantel , Joseph Morlier

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

Characterizing and optimizing nanoscopic heat engines require an appropriate understanding of the interplay between power, efficiency, entropy production and fluctuations. Despite significant recent advancements, including linear stochastic…

Statistical Mechanics · Physics 2025-11-07 Gustavo A. L. Forão , Jonas Berx , Carlos E. Fiore

Multi-Objective Alignment (MOA) aims to align LLMs' responses with multiple human preference objectives, with Direct Preference Optimization (DPO) emerging as a prominent approach. However, we find that DPO-based MOA approaches suffer from…

Machine Learning · Computer Science 2025-12-09 Moxin Li , Yuantao Zhang , Wenjie Wang , Wentao Shi , Zhuo Liu , Fuli Feng , Tat-Seng Chua

This paper studies a class of multi-robot coordination problems where a team of robots aim to reach their goal regions with minimum time and avoid collisions with obstacles and other robots. A novel numerical algorithm is proposed to…

Optimization and Control · Mathematics 2020-09-02 Guoxiang Zhao , Minghui Zhu

A challenging category of robotics problems arises when sensing incurs substantial costs. This paper examines settings in which a robot wishes to limit its observations of state, for instance, motivated by specific considerations of energy…

Robotics · Computer Science 2023-09-26 Patrick Zhong , Federico Rossi , Dylan A. Shell

Many problems in robotics seek to simultaneously optimize several competing objectives under constraints. A conventional approach to solving such multi-objective optimization problems is to create a single cost function comprised of the…

Robotics · Computer Science 2022-06-02 Alexander Botros , Armin Sadeghi , Nils Wilde , Javier Alonso-Mora , Stephen L. Smith