English
Related papers

Related papers: Mind the Gap: Measuring Generalization Performance…

200 papers

Automated experimentation has the potential to revolutionize scientific discovery, but its effectiveness depends on well-defined optimization targets, which are often uncertain or probabilistic in real-world settings. In this work, we…

Machine Learning · Computer Science 2025-04-10 Yu Liu , Sergei V. Kalinin

We consider Markov decision processes (MDPs) with multiple limit-average (or mean-payoff) objectives. There exist two different views: (i) the expectation semantics, where the goal is to optimize the expected mean-payoff objective, and (ii)…

Logic in Computer Science · Computer Science 2019-03-14 Krishnendu Chatterjee , Zuzana Křetínská , Jan Křetínský

The fitting of physical models is often done only using a single target observable. However, when multiple targets are considered, the fitting procedure becomes cumbersome, there being no easy way to quantify the robustness of the model for…

Chemical Physics · Physics 2022-01-12 Rodrigo A. Vargas-Hernández , Chern Chuang , Paul Brumer

In this paper, we propose a variable metric method for unconstrained multiobjective optimization problems (MOPs). First, a sequence of points is generated using different positive definite matrices in the generic framework. It is proved…

Optimization and Control · Mathematics 2022-07-18 Jian Chen , Gaoxi Li , Xinmin Yang

While Deep Learning (DL) experts often have prior knowledge about which hyperparameter settings yield strong performance, only few Hyperparameter Optimization (HPO) algorithms can leverage such prior knowledge and none incorporate priors…

Machine Learning · Computer Science 2025-11-12 Soham Basu , Frank Hutter , Danny Stoll

Reinforcement Learning with Human Feedback (RLHF) is a widely used fine-tuning approach that aligns machine learning model, particularly Language Model (LM) with human preferences. There are typically multiple objectives driving the…

Machine Learning · Computer Science 2025-02-25 Nuoya Xiong , Aarti Singh

Prompt optimization is a practical and widely applicable alternative to fine tuning for improving large language model performance. Yet many existing methods evaluate candidate prompts by sampling full outputs, often coupled with self…

Computation and Language · Computer Science 2025-09-19 Chenzhuo Zhao , Ziqian Liu , Xinda Wang , Junting Lu , Chaoyi Ruan

Design problems in industrial engineering often involve a large number of design variables with multiple objectives, under complex nonlinear constraints. The algorithms for multiobjective problems can be significantly different from the…

Optimization and Control · Mathematics 2013-03-27 Xin-She Yang

Multi-modal multi-objective optimization aims to find all Pareto optimal solutions including overlapping solutions in the objective space. Multi-modal multi-objective optimization has been investigated in the evolutionary computation…

Neural and Evolutionary Computing · Computer Science 2020-09-29 Ryoji Tanabe , Hisao Ishibuchi

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

The evaluation of heuristic optimizers on test problems, better known as \emph{benchmarking}, is a cornerstone of research in multi-objective optimization. However, most test problems used in benchmarking numerical multi-objective black-box…

Optimization and Control · Mathematics 2026-01-26 Lennart Schäpermeier , Pascal Kerschke

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

In multi-objective optimization, a single decision vector must balance the trade-offs between many objectives. Solutions achieving an optimal trade-off are said to be Pareto optimal: these are decision vectors for which improving any one…

Optimization and Control · Mathematics 2023-08-07 Abhishek Roy , Geelon So , Yi-An Ma

The efficient optimization method for locally Lipschitz continuous multiobjective optimization problems from [1] is extended from finite-dimensional problems to general Hilbert spaces. The method iteratively computes Pareto critical points,…

Optimization and Control · Mathematics 2024-02-12 Konstantin Sonntag , Bennet Gebken , Georg Müller , Sebastian Peitz , Stefan Volkwein

Predicting nuclear masses is a longstanding challenge. One path forward is machine learning (ML) which trains on experimental data, but can suffer large errors when extrapolating toward neutron-rich species. In nature, such masses shape…

Solar and Stellar Astrophysics · Physics 2025-06-10 Mengke Li , Matthew Mumpower , Nicole Vassh , William Samuel Porter , Rebecca Surman

As a result of the ever increasing complexity of configuring and fine-tuning machine learning models, the field of automated machine learning (AutoML) has emerged over the past decade. However, software implementations like Auto-WEKA and…

Machine Learning · Computer Science 2022-11-09 Dimitrios Iliadis , Marcel Wever , Bernard De Baets , Willem Waegeman

Recent research has proposed a series of specialized optimization algorithms for deep multi-task models. It is often claimed that these multi-task optimization (MTO) methods yield solutions that are superior to the ones found by simply…

Machine Learning · Computer Science 2022-09-26 Derrick Xin , Behrooz Ghorbani , Ankush Garg , Orhan Firat , Justin Gilmer

Our research aims to propose a new performance-explainability analytical framework to assess and benchmark machine learning methods. The framework details a set of characteristics that systematize the performance-explainability assessment…

Machine Learning · Computer Science 2021-11-22 Kevin Fauvel , Véronique Masson , Élisa Fromont

Dynamic multi-objective optimization (DMOO) has recently attracted increasing interest from both academic researchers and engineering practitioners, as numerous real-world applications that evolve over time can be naturally formulated as…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Chang Shao , Qi Zhao , Nana Pu , Shi Cheng , Jing Jiang , Yuhui Shi

Many real-world classification tasks require predicting multiple labels per instance, necessitating the optimization of complex evaluation metrics such as the $F$-measure and Jaccard index. While the Empirical Utility Maximization (EUM)…

Machine Learning · Computer Science 2026-05-28 Mehryar Mohri , Yutao Zhong