English
Related papers

Related papers: Quantile Optimization via Multiple Timescale Local…

200 papers

When a black-box optimization objective can only be evaluated with costly or noisy measurements, most standard optimization algorithms are unsuited to find the optimal solution. Specialized algorithms that deal with exactly this situation…

Machine Learning · Computer Science 2021-06-11 Laurens Bliek , Sicco Verwer , Mathijs de Weerdt

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

Machine Learning · Computer Science 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

Derivative Free Optimization is known to be an efficient and robust method to tackle the black-box optimization problem. When it comes to noisy functions, classical comparison-based algorithms are slower than gradient-based algorithms. For…

Optimization and Control · Mathematics 2016-04-29 Marie-Liesse Cauwet , Olivier Teytaud

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Variational hybrid quantum-classical optimization represents one of the most promising avenue to show the advantage of nowadays noisy intermediate-scale quantum computers in solving hard problems, such as finding the minimum-energy state of…

Quantum Physics · Physics 2020-11-18 Laura Gentini , Alessandro Cuccoli , Stefano Pirandola , Paola Verrucchi , Leonardo Banchi

First-order methods for stochastic optimization have undeniable relevance, in part due to their pivotal role in machine learning. Variance reduction for these algorithms has become an important research topic. In contrast to common…

Machine Learning · Computer Science 2021-09-08 Manuel Madeira , Renato Negrinho , João Xavier , Pedro M. Q. Aguiar

We propose stochastic optimization algorithms that can find local minima faster than existing algorithms for nonconvex optimization problems, by exploiting the third-order smoothness to escape non-degenerate saddle points more efficiently.…

Optimization and Control · Mathematics 2017-12-19 Yaodong Yu , Pan Xu , Quanquan Gu

We propose a new distributed optimization algorithm for solving a class of constrained optimization problems in which (a) the objective function is separable (i.e., the sum of local objective functions of agents), (b) the optimization…

Optimization and Control · Mathematics 2021-06-16 Van Sy Mai , Richard J. La , Tao Zhang , Abdella Battou

We present a finite-time analysis of two smoothed functional stochastic approximation algorithms for simulation-based optimization. The first is a two time-scale gradient-based method, while the second is a three time-scale Newton-based…

Machine Learning · Computer Science 2026-04-01 Kaustubh Kartikey , Shalabh Bhatnagar

In many practical applications, heuristic or approximation algorithms are used to efficiently solve the task at hand. However their solutions frequently do not satisfy natural monotonicity properties of optimal solutions. In this work we…

Machine Learning · Computer Science 2020-03-24 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos

Gradient descent is one of the most basic algorithms for solving continuous optimization problems. In [Jordan, PRL, 95(5):050501, 2005], Jordan proposed the first quantum algorithm for estimating gradients of functions close to linear, with…

Quantum Physics · Physics 2026-05-11 Yuxin Zhang , Changpeng Shao

We introduce a fresh scheme based on the local hidden variable models to quantify nonlocality for arbitrarily high-dimensional quantum systems. Our scheme explores the minimal amount of white noise that must be added to the system in order…

Quantum Physics · Physics 2009-11-09 Dong-Ling Deng , Jing-Ling Chen , Zi-Sui Zhou

A stochastic-gradient-based interior-point algorithm for minimizing a continuously differentiable objective function (that may be nonconvex) subject to bound constraints is presented, analyzed, and demonstrated through experimental results.…

Optimization and Control · Mathematics 2024-03-15 Frank E. Curtis , Vyacheslav Kungurtsev , Daniel P. Robinson , Qi Wang

For safety-critical black-box optimization tasks, observations of the constraints and the objective are often noisy and available only for the feasible points. We propose an approach based on log barriers to find a local solution of a…

Optimization and Control · Mathematics 2021-02-25 Ilnura Usmanova , Andreas Krause , Maryam Kamgarpour

We study quantum algorithms based on quantum (sub)gradient estimation using noisy function evaluation oracles, and demonstrate the first dimension-independent query complexities (up to poly-logarithmic factors) for zeroth-order convex…

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

In derivative-free and blackbox optimization, the objective function is often evaluated through the execution of a computer program seen as a blackbox. It can be noisy, in the sense that its outputs are contaminated by random errors.…

Optimization and Control · Mathematics 2019-11-15 Stéphane Alarie , Charles Audet , Pierre-Yves Bouchet , Sébastien Le Digabel

We consider the problem of black-box function optimization over the boolean hypercube. Despite the vast literature on black-box function optimization over continuous domains, not much attention has been paid to learning models for…

This study systematically benchmarks classical optimization strategies for the Quantum Approximate Optimization Algorithm when applied to Generalized Mean-Variance Problems under near-term Noisy Intermediate-Scale Quantum conditions. We…

Quantum Physics · Physics 2025-11-13 Tomáš Bezděk , Haomu Yuan , Vojtěch Novák , Silvie Illésová , Martin Beseda

Optimization of high-dimensional black-box functions is an extremely challenging problem. While Bayesian optimization has emerged as a popular approach for optimizing black-box functions, its applicability has been limited to…

Machine Learning · Statistics 2018-08-06 Zi Wang , Chengtao Li , Stefanie Jegelka , Pushmeet Kohli