English
Related papers

Related papers: Pareto-frontier Entropy Search with Variational Lo…

200 papers

Developing efficient multi-objective optimization methods to compute the Pareto set of optimal compromises between conflicting objectives remains a key challenge, especially for large-scale and expensive problems. To bridge this gap, we…

Machine Learning · Computer Science 2026-02-05 Sedjro Salomon Hotegni , Sebastian Peitz

We study fairness-accuracy tradeoffs when a single predictive model must serve multiple demographic groups. A useful tool for understanding this tradeoff is the fairness-accuracy (FA) Pareto frontier, which characterizes the set of models…

Machine Learning · Statistics 2026-02-17 Alireza Fallah , Michael I. Jordan , Annie Ulichney

In many real-world optimization problems, we have prior information about what objective function values are achievable. In this paper, we study the scenario that we have either exact knowledge of the minimum value or a, possibly inexact,…

Machine Learning · Computer Science 2025-09-26 Hanyang Wang , Juergen Branke , Matthias Poloczek

We propose a new approach for estimating the parameters of a probability distribution. It consists on combining two new methods of estimation. The first is based on the definition of a new distance measuring the difference between…

Methodology · Statistics 2008-12-30 Ahmed Guellil , Tewfik Kernane

Recently, it has been shown that the enumeration of Minimal Correction Subsets (MCS) of Boolean formulas allows solving Multi-Objective Boolean Optimization (MOBO) formulations. However, a major drawback of this approach is that most MCSs…

Artificial Intelligence · Computer Science 2022-04-15 Andreia P. Guerreiro , João Cortes , Daniel Vanderpooten , Cristina Bazgan , Inês Lynce , Vasco Manquinho , José Rui Figueira

In decision-making problems, the outcome of an intervention often depends on the causal relationships between system components and is highly costly to evaluate. In such settings, causal Bayesian optimization (CBO) can exploit the causal…

Machine Learning · Statistics 2025-02-21 Shriya Bhatija , Paul-David Zuercher , Jakob Thumm , Thomas Bohné

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

Real-world problems are often multi-objective with decision-makers unable to specify a priori which trade-off between the conflicting objectives is preferable. Intuitively, building machine learning solutions in such cases would entail…

Machine Learning · Computer Science 2021-10-20 Timo M. Deist , Monika Grewal , Frank J. W. M. Dankers , Tanja Alderliesten , Peter A. N. Bosman

The paper solves the problem of optimal portfolio choice when the parameters of the asset returns distribution, like the mean vector and the covariance matrix are unknown and have to be estimated by using historical data of the asset…

Statistical Finance · Quantitative Finance 2023-04-19 David Bauder , Taras Bodnar , Nestor Parolya , Wolfgang Schmid

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

In this paper, a branch and bound algorithm that incorporates the decision maker's preference information is proposed for multiobjective optimization. In the proposed algorithm, a new discarding test is designed to check whether a box…

Optimization and Control · Mathematics 2023-02-28 Weitian Wu , Xinmin Yang

We commonly encounter the problem of identifying an optimally weight adjusted version of the empirical distribution of observed data, adhering to predefined constraints on the weights. Such constraints often manifest as restrictions on the…

Machine Learning · Statistics 2024-01-17 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

Bayesian optimization (BO) is a popular method to optimize expensive black-box functions. It efficiently tunes machine learning algorithms under the implicit assumption that hyperparameter evaluations cost approximately the same. In…

Machine Learning · Computer Science 2020-11-25 Gauthier Guinet , Valerio Perrone , Cédric Archambeau

This paper addresses the problem of optimal control of robotic sensing systems aimed at autonomous information gathering in scenarios such as environmental monitoring, search and rescue, and surveillance and reconnaissance. The information…

Systems and Control · Computer Science 2016-01-28 Mikko Lauri , Nikolay Atanasov , George J. Pappas , Risto Ritala

Bayesian optimization has been successfully applied to optimize black-box functions where the number of evaluations is severely limited. However, in many real-world applications, it is hard or impossible to know in advance which designs are…

Many real-world tasks require optimizing expensive black-box functions accessible only through noisy evaluations, a setting commonly addressed with Bayesian optimization (BO). While Bayesian neural networks (BNNs) have recently emerged as…

Machine Learning · Computer Science 2026-01-14 Farhad Mirkarimi

We consider the bi-criteria shortest-path problem where we want to compute shortest paths on a graph that simultaneously balance two cost functions. While this problem has numerous applications, there is usually no path minimizing both cost…

Data Structures and Algorithms · Computer Science 2021-03-08 Oren Salzman

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

Recent work in unsupervised representation learning has focused on learning deep directed latent-variable models. Fitting these models by maximizing the marginal likelihood or evidence is typically intractable, thus a common approximation…

Machine Learning · Computer Science 2018-02-15 Alexander A. Alemi , Ben Poole , Ian Fischer , Joshua V. Dillon , Rif A. Saurous , Kevin Murphy

A body of work has been done to automate machine learning algorithm to highlight the importance of model choice. Automating the process of choosing the best forecasting model and its corresponding parameters can result to improve a wide…

Machine Learning · Computer Science 2021-09-02 Nadhir Hassen , Irina Rish