English
Related papers

Related papers: Bi-objective Ranking and Selection Using Stochasti…

200 papers

We explore the fundamental problem of sorting through the lens of learning-augmented algorithms, where algorithms can leverage possibly erroneous predictions to improve their efficiency. We consider two different settings: In the first…

Data Structures and Algorithms · Computer Science 2023-11-03 Xingjian Bai , Christian Coester

Successive Halving is a popular algorithm for hyperparameter optimization which allocates exponentially more resources to promising candidates. However, the algorithm typically relies on intermediate performance values to make resource…

Machine Learning · Computer Science 2025-08-21 Jihao Andreas Lin , Nicolas Mayoraz , Steffen Rendle , Dima Kuzmin , Emil Praun , Berivan Isik

Stochastic alternating algorithms for bi-objective optimization are considered when optimizing two conflicting functions for which optimization steps have to be applied separately for each function. Such algorithms consist of applying a…

Optimization and Control · Mathematics 2023-01-09 Suyun Liu , Luis Nunes Vicente

Bayesian optimization is a powerful tool for expensive stochastic black-box optimization problems such as simulation-based optimization or machine learning hyperparameter tuning. Many stochastic objective functions implicitly require a…

Machine Learning · Statistics 2019-10-22 Michael Pearce , Matthias Poloczek , Juergen Branke

We want to select the best systems out of a given set of systems (or rank them) with respect to their expected performance. The systems allow random observations only and we assume that the joint observation of the systems has a…

Methodology · Statistics 2017-01-23 Björn Görder , Michael Kolonko

Various local search approaches have recently been applied to machine scheduling problems under multiple objectives. Their foremost consideration is the identification of the set of Pareto optimal alternatives. An important aspect of…

Artificial Intelligence · Computer Science 2008-09-02 Martin Josef Geiger

The article presents an approach to interactively solve multi-objective optimization problems. While the identification of efficient solutions is supported by computational intelligence techniques on the basis of local search, the search is…

Artificial Intelligence · Computer Science 2008-09-05 Martin Josef Geiger

Preferential Bayesian optimization allows optimization of objectives that are either expensive or difficult to measure directly, by relying on a minimal number of comparative evaluations done by a human expert. Generating candidate…

An ongoing aim of research in multiobjective Bayesian optimization is to extend its applicability to a large number of objectives. While coping with a limited budget of evaluations, recovering the set of optimal compromise solutions…

Optimization and Control · Mathematics 2019-10-04 Mickaël Binois , Victor Picheny , Patrick Taillandier , Abderrahmane Habbal

The challenge of noisy multi-objective optimization lies in the constant trade-off between exploring new decision points and improving the precision of known points through resampling. This decision should take into account both the…

Machine Learning · Computer Science 2025-04-25 Timo Budszuhn , Mark Joachim Krallmann , Daniel Horn

The success of a cross-sectional systematic strategy depends critically on accurately ranking assets prior to portfolio construction. Contemporary techniques perform this ranking step either with simple heuristics or by sorting outputs from…

Trading and Market Microstructure · Quantitative Finance 2020-12-15 Daniel Poh , Bryan Lim , Stefan Zohren , Stephen Roberts

In this work, we propose different formulations and gradient-based algorithms for deterministic and stochastic bilevel problems with conflicting objectives in the lower level. Such problems have received little attention in the…

Optimization and Control · Mathematics 2023-11-08 Tommaso Giovannelli , Griffin Dean Kent , Luis Nunes Vicente

We develop a new method for stochastic optimization using the Bayesian statistics approach. More precisely, we optimize parameters of chess engines as those data are available to us, but the method should apply to all situations where we…

Optimization and Control · Mathematics 2022-07-06 Ivan Ivec , Ivana Vojnović

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

Algorithmic fairness has been a serious concern and received lots of interest in machine learning community. In this paper, we focus on the bipartite ranking scenario, where the instances come from either the positive or negative class and…

Machine Learning · Computer Science 2023-07-28 Sen Cui , Weishen Pan , Changshui Zhang , Fei Wang

In this work we introduce a new framework for multi-objective Bayesian optimisation where the multi-objective functions can only be accessed via choice judgements, such as ``I pick options A,B,C among this set of five options A,B,C,D,E''.…

Machine Learning · Statistics 2021-10-18 Alessio Benavoli , Dario Azzimonti , Dario Piga

Engineering design involves demanding models encompassing many decision variables and uncontrollable parameters. In addition, unavoidable aleatoric and epistemic uncertainties can be very impactful and add further complexity. The…

Systems and Control · Electrical Eng. & Systems 2026-02-27 Enrico Ampellio , Blazhe Gjorgiev , Giovanni Sansavini

In interactive systems, feedback is often provided in the form of preference between queried options rather than precise scores, which motivates optimization methods to learn from such comparisons. In this work, we propose a…

Optimization and Control · Mathematics 2025-12-23 Siyi Wang , Zifan Wang , Karl Henrik Johanssson

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

Spectral risk objectives - also called $L$-risks - allow for learning systems to interpolate between optimizing average-case performance (as in empirical risk minimization) and worst-case performance on a task. We develop stochastic…

Machine Learning · Statistics 2022-12-13 Ronak Mehta , Vincent Roulet , Krishna Pillutla , Lang Liu , Zaid Harchaoui