English
Related papers

Related papers: Global and Preference-based Optimization with Mixe…

200 papers

We propose a novel and efficient algorithm for the collaborative preference completion problem, which involves jointly estimating individualized rankings for a set of entities over a shared set of items, based on a limited number of…

Machine Learning · Statistics 2016-11-16 Suriya Gunasekar , Oluwasanmi Koyejo , Joydeep Ghosh

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

In simulation-based engineering, design choices are often obtained following the optimization of complex blackbox models. These models frequently involve mixed-variable domains with quantitative and categorical variables. Unlike…

Optimization and Control · Mathematics 2026-03-31 Charles Audet , Youssef Diouane , Edward Hallé-Hannan , Sébastien Le Digabel , Christophe Tribes

We present a new machine learning approach to estimate personalized treatment effects in the classical potential outcomes framework with binary outcomes. To overcome the problem that both treatment and control outcomes for the same unit are…

Machine Learning · Statistics 2018-05-07 Siong Thye Goh , Cynthia Rudin

Preference-based optimization algorithms are iterative procedures that seek the optimal calibration of a decision vector based only on comparisons between couples of different tunings. At each iteration, a human decision-maker expresses a…

Optimization and Control · Mathematics 2023-10-03 Davide Previtali , Mirko Mazzoleni , Antonio Ferramosca , Fabio Previdi

We analyze combinatorial optimization problems with ordinal, i.e., non-additive, objective functions that assign categories (like good, medium and bad) rather than cost coefficients to the elements of feasible solutions. We review different…

Optimization and Control · Mathematics 2022-04-06 Kathrin Klamroth , Michael Stiglmayr , Julia Sudhoff

In this paper, we analyze how global optima of an agent's preferences can be reconstructed from the solutions found for local problems. A sheaf-theoretic analysis provides an abstract characterization of the global solution, and polynomial…

Theoretical Economics · Economics 2025-03-18 Fernando Tohmé

Majorization-minimization algorithms consist of iteratively minimizing a majorizing surrogate of an objective function. Because of its simplicity and its wide applicability, this principle has been very popular in statistics and in signal…

Machine Learning · Statistics 2013-09-11 Julien Mairal

We consider the global minimization of a particular type of minimum structured optimization problems wherein the variables must belong to some basic set, the feasible domain is described by the intersection of a large number of functional…

Optimization and Control · Mathematics 2024-12-09 Guillaume Van Dessel , François Glineur

Global optimization of large-scale, complex systems such as multi-physics black-box simulations and real-world industrial systems is important but challenging. This work presents a novel Surrogate-Based Optimization framework based on…

Machine Learning · Computer Science 2026-01-13 Maaz Ahmad , Iftekhar A. Karimi

Multi-objective learning under user-specified preference is common in real-world problems such as multi-lingual speech recognition under fairness. In this work, we frame such a problem as a semivectorial bilevel optimization problem, whose…

Optimization and Control · Mathematics 2025-04-07 Lisha Chen , Quan Xiao , Ellen Hidemi Fukuda , Xinyi Chen , Kun Yuan , Tianyi Chen

Generating simulated training data needed for constructing sufficiently accurate surrogate models to be used for efficient optimization or parameter identification can incur a huge computational effort in the offline phase. We consider a…

Numerical Analysis · Mathematics 2024-04-03 Phillip Semler , Martin Weiser

Multi-objective optimization is a widely studied problem in diverse fields, such as engineering and finance, that seeks to identify a set of non-dominated solutions that provide optimal trade-offs among competing objectives. However, the…

Neural and Evolutionary Computing · Computer Science 2024-01-15 Arash Heidari , Sebastian Rojas Gonzalez , Tom Dhaene , Ivo Couckuyt

The paper provides global optimization algorithms for two particularly difficult nonconvex problems raised by hybrid system identification: switching linear regression and bounded-error estimation. While most works focus on local…

Machine Learning · Computer Science 2017-11-27 Fabien Lauer

Bayesian optimization has become a fundamental global optimization algorithm in many problems where sample efficiency is of paramount importance. Recently, there has been proposed a large number of new applications in fields such as…

Artificial Intelligence · Computer Science 2019-02-06 Ruben Martinez-Cantin

The predict+optimize problem combines machine learning ofproblem coefficients with a combinatorial optimization prob-lem that uses the predicted coefficients. While this problemcan be solved in two separate stages, it is better to…

Machine Learning · Computer Science 2020-12-07 Ali Ugur Guler , Emir Demirovic , Jeffrey Chan , James Bailey , Christopher Leckie , Peter J. Stuckey

Adaptive random search approaches have been shown to be effective for global optimization problems, where under certain conditions, the expected performance time increases only linearly with dimension. However, previous analyses assume that…

Optimization and Control · Mathematics 2022-03-22 David D. Linz , Zelda B. Zabinsky

We explore a multiple-stage variant of the min-max robust selection problem with budgeted uncertainty that includes queries. First, one queries a subset of items and gets the exact values of their uncertain parameters. Given this…

Optimization and Control · Mathematics 2025-01-07 Xiaoyu Chen , Marc Goerigk , Michael Poss

Lipschitz one-dimensional constrained global optimization (GO) problems where both the objective function and constraints can be multiextremal and non-differentiable are considered in this paper. Problems, where the constraints are verified…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev , Dmitri E. Kvasov , Falah M. H. Khalaf

One of the challenges in optimization of high dimensional problems is finding appropriate solutions in a way that are as close as possible to the global optima. In this regard, one of the most common phenomena that occurs is the curse of…

Optimization and Control · Mathematics 2021-12-22 Somayeh Seifi Shalamzari , Mojtaba Banifakhr