English
Related papers

Related papers: Pareto-Optimal Anytime Algorithms via Bayesian Rac…

200 papers

In this paper, the monotone submodular maximization problem (SM) is studied. SM is to find a subset of size $\kappa$ from a universe of size $n$ that maximizes a monotone submodular objective function $f$. We show using a novel analysis…

Data Structures and Algorithms · Computer Science 2021-07-07 Victoria G. Crawford

We consider problems with multiple linear objectives and linear constraints and use Adjustable Robust Optimization and Polynomial Optimization as tools to approximate the Pareto set with polynomials of arbitrarily large degree. The main…

Optimization and Control · Mathematics 2015-01-13 Bram L. Gorissen , Dick den Hertog

The optimization of expensive-to-evaluate black-box functions is prevalent in various scientific disciplines. Bayesian optimization is an automatic, general and sample-efficient method to solve these problems with minimal knowledge of the…

Machine Learning · Computer Science 2024-02-20 Carl Hvarfner , Frank Hutter , Luigi Nardi

Hyperparameter tuning is a challenging problem especially when the system itself involves uncertainty. Due to noisy function evaluations, optimization under uncertainty can be computationally expensive. In this paper, we present a novel…

Machine Learning · Computer Science 2025-10-09 Akash Yadav , Ruda Zhang

The problem of making sequential decisions in unknown probabilistic environments is studied. In cycle $t$ action $y_t$ results in perception $x_t$ and reward $r_t$, where all quantities in general may depend on the complete history. The…

Artificial Intelligence · Computer Science 2007-05-23 Marcus Hutter

Many problems in robotics seek to simultaneously optimize several competing objectives under constraints. A conventional approach to solving such multi-objective optimization problems is to create a single cost function comprised of the…

Robotics · Computer Science 2022-06-02 Alexander Botros , Armin Sadeghi , Nils Wilde , Javier Alonso-Mora , Stephen L. Smith

Fairness in clustering has been considered extensively in the past; however, the trade-off between the two objectives -- e.g., can we sacrifice just a little in the quality of the clustering to significantly increase fairness, or…

Machine Learning · Computer Science 2024-08-20 Rashida Hakim , Ana-Andreea Stoica , Christos H. Papadimitriou , Mihalis Yannakakis

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

We propose a novel numerical approach to compute the Pareto front in multivariate polynomial multi-objective optimization problems. When the objective functions and (equality) constraints are multivariate polynomials, the Pareto front,…

Optimization and Control · Mathematics 2026-04-06 Hans van Rooij , Christof Vermeersch , Marie Deferme , Bart De Moor

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

Machine Learning · Computer Science 2021-09-02 Nadhir Hassen , Irina Rish

The taxing computational effort that is involved in solving some high-dimensional statistical problems, in particular problems involving non-convex optimization, has popularized the development and analysis of algorithms that run…

Statistics Theory · Mathematics 2020-02-13 Guy Holtzman , Adam Soffer , Dan Vilenchik

In the imprecise geometry model, the input is an imprecise point set, which is a family of regions $F = (R_1, \ldots,R_n)$, where for each $R_i$ one may retrieve the true point $p_i \in R_i$. By preprocessing $F$, we can construct the…

We consider a sequential decision making task, where the goal is to optimize an unknown function without evaluating parameters that violate an a~priori unknown (safety) constraint. A common approach is to place a Gaussian process prior on…

Machine Learning · Computer Science 2024-05-13 Alessandro G. Bottero , Carlos E. Luis , Julia Vinogradska , Felix Berkenkamp , Jan Peters

We consider the first, and most well studied, speed scaling problem in the algorithmic literature: where the scheduling quality of service measure is a deadline feasibility constraint, and where the power objective is to minimize the total…

Data Structures and Algorithms · Computer Science 2013-07-03 Ahmed Abousamra , David P. Bunde , Kirk Pruhs

We study a sequential decision-making model where a set of items is repeatedly matched to the same set of agents over multiple rounds. The objective is to determine a sequence of matchings that either maximizes the utility of the least…

Computer Science and Game Theory · Computer Science 2025-10-07 Eugene Lim , Tzeh Yuan Neoh , Nicholas Teh

Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…

Machine Learning · Statistics 2021-04-12 Jan-Matthis Lueckmann , Jan Boelts , David S. Greenberg , Pedro J. Gonçalves , Jakob H. Macke

This is the first study on crowdsourcing Pareto-optimal object finding, which has applications in public opinion collection, group decision making, and information exploration. Departing from prior studies on crowdsourcing skyline and…

Artificial Intelligence · Computer Science 2014-09-16 Abolfazl Asudeh , Gensheng Zhang , Naeemul Hassan , Chengkai Li , Gergely V. Zaruba

We consider discrete bilevel optimization problems where the follower solves an integer program with a fixed number of variables. Using recent results in parametric integer programming, we present polynomial time algorithms for pure and…

Optimization and Control · Mathematics 2017-01-03 Matthias Köppe , Maurice Queyranne , Christopher Thomas Ryan

Bayesian optimization is an effective method to efficiently optimize unknown objective functions with high evaluation costs. Traditional Bayesian optimization algorithms select one point per iteration for single objective function, whereas…

Machine Learning · Statistics 2019-05-08 Takashi Wada , Hideitsu Hino

We present a powerful general framework for designing data-dependent optimization algorithms, building upon and unifying recent techniques in adaptive regularization, optimistic gradient predictions, and problem-dependent randomization. We…

Machine Learning · Statistics 2015-10-14 Mehryar Mohri , Scott Yang