English
Related papers

Related papers: Versatile Black-Box Optimization

200 papers

Shifted combinatorial optimization is a new nonlinear optimization framework, which is a broad extension of standard combinatorial optimization, involving the choice of several feasible solutions at a time. It captures well studied and…

Optimization and Control · Mathematics 2017-06-08 Martin Koutecky , Asaf Levin , Syed M. Meesum , Shmuel Onn

Black box variational inference allows researchers to easily prototype and evaluate an array of models. Recent advances allow such algorithms to scale to high dimensions. However, a central question remains: How to specify an expressive…

Machine Learning · Statistics 2016-06-01 Rajesh Ranganath , Dustin Tran , David M. Blei

Bayesian Optimization (BO) has proven to be very successful at optimizing a static, noisy, costly-to-evaluate black-box function $f : \mathcal{S} \to \mathbb{R}$. However, optimizing a black-box which is also a function of time (i.e., a…

Machine Learning · Statistics 2024-10-22 Anthony Bardou , Patrick Thiran , Giovanni Ranieri

Black-box optimization (BBO) has become increasingly relevant for tackling complex decision-making problems, especially in public policy domains such as police redistricting. However, its broader application in public policymaking is…

Machine Learning · Statistics 2025-01-23 Wenqian Xing , JungHo Lee , Chong Liu , Shixiang Zhu

Genetic algorithms are a class of heuristic search techniques that apply basic evolutionary operators in a computational setting. We have designed a fully parallel and distributed hardware/software implementation of the generalized…

Astrophysics · Physics 2009-11-07 T. S. Metcalfe , P. Charbonneau

Many optimization problems in robotics involve the optimization of time-expensive black-box functions, such as those involving complex simulations or evaluation of real-world experiments. Furthermore, these functions are often stochastic as…

This paper introduces a non-variational quantum algorithm designed to solve a wide range of combinatorial optimisation problems, including constrained and non-binary problems. The algorithm leverages an engineered interference process…

Quantum Physics · Physics 2024-08-02 Tavis Bennett , Lyle Noakes , Jingbo Wang

Mixture variational distributions in black box variational inference (BBVI) have demonstrated impressive results in challenging density estimation tasks. However, currently scaling the number of mixture components can lead to a linear…

Machine Learning · Computer Science 2024-06-12 Alexandra Hotti , Oskar Kviman , Ricky Molén , Víctor Elvira , Jens Lagergren

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

Machine Learning · Statistics 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

This document briefly describes the Black-Box Multi-Objective Optimization Benchmarking (BMOBench) platform. It presents the test problems, evaluation procedure, and experimental setup. To this end, the BMOBench is demonstrated by comparing…

Optimization and Control · Mathematics 2017-07-04 Abdullah Al-Dujaili , S. Suresh

The quantum approximate optimization algorithm (QAOA) is a hybrid variational quantum-classical algorithm that solves combinatorial optimization problems. While there is evidence suggesting that the fixed form of the standard QAOA ansatz is…

Derivative-free optimization has become an important technique used in machine learning for optimizing black-box models. To conduct updates without explicitly computing gradient, most current approaches iteratively sample a random search…

Machine Learning · Statistics 2018-08-03 Liu Liu , Minhao Cheng , Cho-Jui Hsieh , Dacheng Tao

Bayesian optimization (BO) is a widely-used sequential method for zeroth-order optimization of complex and expensive-to-compute black-box functions. The existing BO methods assume that the function evaluation (feedback) is available to the…

Machine Learning · Computer Science 2022-06-22 Arun Verma , Zhongxiang Dai , Bryan Kian Hsiang Low

In decision-making under uncertainty, several criteria have been studied to aggregate the performance of a solution over multiple possible scenarios. This paper introduces a novel variant of ordered weighted averaging (OWA) for optimization…

Optimization and Control · Mathematics 2024-01-30 Werner Baak , Marc Goerigk , Adam Kasperski , Paweł Zieliński

We develop an optimization algorithm suitable for Bayesian learning in complex models. Our approach relies on natural gradient updates within a general black-box framework for efficient training with limited model-specific derivations. It…

Machine Learning · Statistics 2022-12-13 Martin Magris , Mostafa Shabani , Alexandros Iosifidis

A typical goal of research in combinatorial optimization is to come up with fast algorithms that find optimal solutions to a computational problem. The process that takes a real-world problem and extracts a clean mathematical abstraction of…

Data Structures and Algorithms · Computer Science 2025-07-22 Sheikh Shakil Akhtar , Jayakrishnan Madathil , Pranabendu Misra , Geevarghese Philip

Quadratic unconstrained binary optimization (QUBO) solvers can be applied to design an optimal structure to avoid resonance. QUBO algorithms that work on a classical or quantum device have succeeded in some industrial applications. However,…

Mesoscale and Nanoscale Physics · Physics 2022-09-29 Tadayoshi Matsumori , Masato Taki , Tadashi Kadowaki

We propose a non-convex training objective for robust binary classification of data sets in which label noise is present. The design is guided by the intention of solving the resulting problem by adiabatic quantum optimization. Two…

Quantum Physics · Physics 2012-05-31 Vasil S. Denchev , Nan Ding , S. V. N. Vishwanathan , Hartmut Neven

To date, research in quantum computation promises potential for outperforming classical heuristics in combinatorial optimization. However, when aiming at provable optimality, one has to rely on classical exact methods like integer…

Quantum Physics · Physics 2025-03-13 Friedrich Wagner , Jonas Nüßlein , Frauke Liers