English
Related papers

Related papers: Mind the Gap: Measuring Generalization Performance…

200 papers

Most machine learning algorithms are configured by one or several hyperparameters that must be carefully chosen and often considerably impact performance. To avoid a time consuming and unreproducible manual trial-and-error process to find…

Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences. Previous methods commonly utilize the set of Pareto objectives (particles on…

Machine Learning · Computer Science 2024-02-16 Xiaoyuan Zhang , Xi Lin , Yichi Zhang , Yifan Chen , Qingfu Zhang

Multiple-objective optimization (MOO) aims to simultaneously optimize multiple conflicting objectives and has found important applications in machine learning, such as minimizing classification loss and discrepancy in treating different…

Machine Learning · Computer Science 2022-09-16 Eric Enouen , Katja Mathesius , Sean Wang , Arielle Carr , Sihong Xie

Constrained multiobjective optimization has gained much interest in the past few years. However, constrained multiobjective optimization problems (CMOPs) are still unsatisfactorily understood. Consequently, the choice of adequate CMOPs for…

Neural and Evolutionary Computing · Computer Science 2023-02-07 Aljoša Vodopija , Tea Tušar , Bogdan Filipič

There has been a growing interest in off-policy evaluation in the literature such as recommender systems and personalized medicine. We have so far seen significant progress in developing estimators aimed at accurately estimating the…

Machine Learning · Computer Science 2024-04-24 Yuta Saito , Masahiro Nomura

Model merging, which combines multiple models into a single model, has gained popularity in recent years. By efficiently integrating the capabilities of various models, this significantly reduces the parameter count and memory usage.…

Machine Learning · Computer Science 2025-02-11 Weiyu Chen , James Kwok

Recent empirical work shows that inconsistent results based on choice of hyperparameter optimization (HPO) configuration are a widespread problem in ML research. When comparing two algorithms J and K searching one subspace can yield the…

Machine Learning · Computer Science 2022-02-18 A. Feder Cooper , Yucheng Lu , Jessica Zosa Forde , Christopher De Sa

Over the last few decades, many architectures have been developed that harness the power of neural networks to detect objects in near real-time. Training such systems requires substantial time across multiple GPUs and massive labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Mayuresh Savargaonkar , Abdallah Chehade , Samir Rawashdeh

Hyperparameter optimization (HPO) is generally treated as a bi-level optimization problem that involves fitting a (probabilistic) surrogate model to a set of observed hyperparameter responses, e.g. validation loss, and consequently…

Machine Learning · Computer Science 2021-10-18 Hadi S. Jomaa , Jonas Falkner , Lars Schmidt-Thieme

Multi-objective optimization (MOO) problems are prevalent in machine learning. These problems have a set of optimal solutions, called the Pareto front, where each point on the front represents a different trade-off between possibly…

Machine Learning · Computer Science 2021-04-27 Aviv Navon , Aviv Shamsian , Gal Chechik , Ethan Fetaya

We present a model-agnostic framework for jointly optimizing the predictive performance and interpretability of supervised machine learning models for tabular data. Interpretability is quantified via three measures: feature sparsity,…

Machine Learning · Computer Science 2023-07-18 Lennart Schneider , Bernd Bischl , Janek Thomas

Hyperparameter optimization (HPO) is a core problem for the machine learning community and remains largely unsolved due to the significant computational resources required to evaluate hyperparameter configurations. As a result, a series of…

Machine Learning · Computer Science 2021-10-12 Sebastian Pineda Arango , Hadi S. Jomaa , Martin Wistuba , Josif Grabocka

Hyperparameter optimization (HPO) is critical for enhancing the performance of machine learning models, yet it often involves a computationally intensive search across a large parameter space. Traditional approaches such as Grid Search and…

Machine Learning · Computer Science 2024-12-24 Md. Tarek Hasan

To learn models or features that generalize across tasks and domains is one of the grand goals of machine learning. In this paper, we propose to use cross-domain, cross-task data as validation objective for hyper-parameter optimization…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Tonmoy Saikia , Thomas Brox , Cordelia Schmid

Multi-objective Bayesian optimization (MOBO) provides a principled framework for optimizing expensive black-box functions with multiple objectives. However, existing MOBO methods often struggle with coverage, scalability with respect to the…

Machine Learning · Computer Science 2026-04-20 Yaohong Yang , Sammie Katt , Samuel Kaski

We study a multi-objective scheduling problem on two dedicated processors. The aim is to minimize simultaneously the makespan, the total tardiness and the total completion time. This NP-hard problem requires the use of well-adapted methods.…

Data Structures and Algorithms · Computer Science 2021-01-05 Adel Kacem , Abdelaziz Dammak

An important challenge in multi-objective reinforcement learning is obtaining a Pareto front of policies to attain optimal performance under different preferences. We introduce Iterated Pareto Referent Optimisation (IPRO), which decomposes…

Machine Learning · Computer Science 2025-02-07 Willem Röpke , Mathieu Reymond , Patrick Mannion , Diederik M. Roijers , Ann Nowé , Roxana Rădulescu

Multi-Objective Optimization (MOO) techniques have become increasingly popular in recent years due to their potential for solving real-world problems in various fields, such as logistics, finance, environmental management, and engineering.…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Noor A. Rashed , Yossra H. Ali , Tarik A. Rashid , A. Salih

Multi-objective probabilistic model checking provides a way to verify several, possibly conflicting, quantitative properties of a stochastic system. It has useful applications in controller synthesis and compositional probabilistic…

Logic in Computer Science · Computer Science 2015-03-20 Vojtech Forejt , Marta Kwiatkowska , David Parker

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO methods by providing…

Machine Learning · Computer Science 2019-05-14 Aaron Klein , Frank Hutter