English
Related papers

Related papers: A black box method for solving the complex exponen…

200 papers

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

We present a probabilistic modeling framework and adaptive sampling algorithm wherein unsupervised generative models are combined with black box predictive models to tackle the problem of input design. In input design, one is given one or…

Machine Learning · Computer Science 2020-02-12 David H. Brookes , Jennifer Listgarten

Maximum consensus estimation plays a critically important role in robust fitting problems in computer vision. Currently, the most prevalent algorithms for consensus maximization draw from the class of randomized hypothesize-and-verify…

Computer Vision and Pattern Recognition · Computer Science 2018-10-24 Huu Le , Tat-Jun Chin , Anders Eriksson , Thanh-Toan Do , David Suter

Standard approaches to stochastic gradient estimation, with only noisy black-box function evaluations, use the finite-difference method or its variants. While natural, it is open to our knowledge whether their statistical accuracy is the…

Statistics Theory · Mathematics 2020-11-13 Henry Lam , Haidong Li , Xuhui Zhang

Analytic continuation of numerical data obtained in imaginary time or frequency has become an essential part of many branches of quantum computational physics. It is, however, an ill-conditioned procedure and thus a hard numerical problem.…

Strongly Correlated Electrons · Physics 2016-08-18 Dominic Bergeron , A. -M. S. Tremblay

Assessment of practical quantum information processing (QIP) remains partial without understanding limits imposed by noise. Unfortunately, mere description of noise grows exponentially with system size, becoming cumbersome even for modest…

Quantum Physics · Physics 2024-08-14 Vikesh Siddhu , John Smolin

Bayesian optimization is an effective method for finding extrema of a black-box function. We propose a new type of Bayesian optimization for learning user preferences in high-dimensional spaces. The central assumption is that the underlying…

Machine Learning · Statistics 2020-08-17 Petrus Mikkola , Milica Todorović , Jari Järvi , Patrick Rinke , Samuel Kaski

Estimating percentiles of black-box deterministic functions with random inputs is a challenging task when the number of function evaluations is severely restricted, which is typical for computer experiments. This article proposes two new…

Statistics Theory · Mathematics 2016-05-23 T Labopin-Richard , V Picheny

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

Machine Learning · Computer Science 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

Black-box optimization has potential in numerous applications such as hyperparameter optimization in machine learning and optimization in design of experiments. Ising machines are useful for binary optimization problems because variables…

Machine Learning · Computer Science 2022-09-05 Yuya Seki , Ryo Tamura , Shu Tanaka

Derivative Free Optimization is known to be an efficient and robust method to tackle the black-box optimization problem. When it comes to noisy functions, classical comparison-based algorithms are slower than gradient-based algorithms. For…

Optimization and Control · Mathematics 2016-04-29 Marie-Liesse Cauwet , Olivier Teytaud

Quantum computation has been growing rapidly in both theory and experiments. In particular, quantum computing devices with a large number of qubits have been developed by IBM, Google, IonQ, and others. The current quantum computing devices…

Quantum Physics · Physics 2021-02-10 Rishabh Gupta , Rongxin Xia , Raphael D. Levine , Sabre Kais

Many quantum algorithms contain an important subroutine, the quantum amplitude estimation. As the name implies, this is essentially the parameter estimation problem and thus can be handled via the established statistical estimation theory.…

Quantum Physics · Physics 2022-01-10 Tomoki Tanaka , Shumpei Uno , Tamiya Onodera , Naoki Yamamoto , Yohichi Suzuki

The stochastic knapsack problem is the stochastic variant of the classical knapsack problem in which the algorithm designer is given a a knapsack with a given capacity and a collection of items where each item is associated with a profit…

Data Structures and Algorithms · Computer Science 2017-12-05 Anindya De

We study the problem of black-box optimization of a function f of any dimension, given function evaluations perturbed by noise. The function is assumed to be locally smooth around one of its global optima, but this smoothness is unknown.…

Machine Learning · Statistics 2026-05-05 Jean-Bastien Grill , Michal Valko , Rémi Munos

Parallel black box optimization consists in estimating the optimum of a function using $\lambda$ parallel evaluations of $f$. Averaging the $\mu$ best individuals among the $\lambda$ evaluations is known to provide better estimates of the…

Optimization and Control · Mathematics 2021-08-11 Laurent Meunier , Iskander Legheraba , Yann Chevaleyre , Olivier Teytaud

Hard optimization problems are often approached by finding approximate solutions. Here, we highlight the concept of proportional sampling and discuss how it can be used to improve the performance of stochastic algorithms for optimization.…

Quantum Physics · Physics 2018-08-01 Juan Miguel Arrazola , Thomas R. Bromley , Patrick Rebentrost

We consider learning to optimize a classification metric defined by a black-box function of the confusion matrix. Such black-box learning settings are ubiquitous, for example, when the learner only has query access to the metric of…

Machine Learning · Computer Science 2021-06-25 Gaurush Hiranandani , Jatin Mathur , Harikrishna Narasimhan , Mahdi Milani Fard , Oluwasanmi Koyejo

In this paper, the problem of estimating the level set of a black-box function from noisy and expensive evaluation queries is considered. A new algorithm for this problem in the Bayesian framework with a Gaussian Process (GP) prior is…

Machine Learning · Statistics 2019-02-27 Shubhanshu Shekhar , Tara Javidi