English
Related papers

Related papers: A derivative-free method for structured optimizati…

200 papers

In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide…

Optimization and Control · Mathematics 2019-08-15 Jeffrey Larson , Matt Menickelly , Stefan M. Wild

We consider the problem of optimizing the sum of a smooth, nonconvex function for which derivatives are unavailable, and a convex, nonsmooth function with easy-to-evaluate proximal operator. Of particular focus is the case where the smooth…

Optimization and Control · Mathematics 2024-07-23 Yanjun Liu , Kevin H. Lam , Lindon Roberts

In this paper, we consider mixed-integer nonsmooth constrained optimization problems whose objective/constraint functions are available only as the output of a black-box zeroth-order oracle (i.e., an oracle that does not provide derivative…

Optimization and Control · Mathematics 2021-07-02 Tommaso Giovannelli , Giampaolo Liuzzi , Stefano Lucidi , Francesco Rinaldi

Derivative-free optimization algorithms are particularly useful for tackling blackbox optimization problems where the objective function arises from complex and expensive procedures that preclude the use of classical gradient-based methods.…

Optimization and Control · Mathematics 2026-03-31 El Houcine Bergou , Youssef Diouane , Vyacheslav Kungurtsev , Clément W. Royer

We propose and analyze a model-based derivative-free (DFO) algorithm for solving bound-constrained optimization problems where the objective function is the composition of a smooth function and a vector of black-box functions. We assume…

Optimization and Control · Mathematics 2024-01-03 Frank E. Curtis , Shima Dezfulian , Andreas Wächter

Optimization of frame structures is formulated as a~non-convex optimization problem, which is currently solved to local optimality. In this contribution, we investigate four optimization approaches: (i) general non-linear optimization, (ii)…

Optimization and Control · Mathematics 2019-09-17 Marek Tyburec , Jan Zeman , Martin Kružík , Didier Henrion

A tremendous range of design tasks in materials, physics, and biology can be formulated as finding the optimum of an objective function depending on many parameters without knowing its closed-form expression or the derivative. Traditional…

Machine Learning · Computer Science 2024-04-08 Ye Wei , Bo Peng , Ruiwen Xie , Yangtao Chen , Yu Qin , Peng Wen , Stefan Bauer , Po-Yen Tung

To reduce complexity and achieve scalable performance in high-dimensional black-box settings, we propose a distributed method for nonconvex derivative-free optimization of continuous variables with an additively separable objective, subject…

Optimization and Control · Mathematics 2025-11-03 Damilola Fasiku , Wentao Tang

We develop a sketching algorithm to find the point on the convex hull of a dataset, closest to a query point outside it. Studying the convex hull of datasets can provide useful information about their geometric structure and their…

Differential Geometry · Mathematics 2022-03-30 Roozbeh Yousefzadeh

In statistics, it is common to encounter multi-modal and non-smooth likelihood (or objective function) maximization problems, where the parameters have known upper and lower bounds. This paper proposes a novel derivative-free global…

Optimization and Control · Mathematics 2023-09-14 Priyam Das

A structured version of derivative-free random pattern search optimization algorithms is introduced which is able to exploit coordinate partially separable structure (typically associated with sparsity) often present in unconstrained and…

Optimization and Control · Mathematics 2021-01-13 Margherita Porcelli , Philippe L. Toint

In this paper, we consider the problem of minimizing a smooth function, given as finite sum of black-box functions, over a convex set. In order to advantageously exploit the structure of the problem, for instance when the terms of the…

Optimization and Control · Mathematics 2026-03-13 Francesco Cecere , Matteo Lapucci , Davide Pucci , Marco Sciandrone

We present a model-based derivative-free method for optimization subject to general convex constraints, which we assume are unrelaxable and accessed only through a projection operator that is cheap to evaluate. We prove global convergence…

Optimization and Control · Mathematics 2022-03-18 Matthew Hough , Lindon Roberts

We introduce a novel distributed derivative-free optimization framework that is resilient to stragglers. The proposed method employs coded search directions at which the objective function is evaluated, and a decoding step to find the next…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-16 Burak Bartan , Mert Pilanci

This paper explores a method for solving constrained optimization problems when the derivatives of the objective function are unavailable, while the derivatives of the constraints are known. We allow the objective and constraint function to…

Optimization and Control · Mathematics 2024-02-20 Melody Qiming Xuan , Jorge Nocedal

In applications throughout science and engineering one is often faced with the challenge of solving an ill-posed inverse problem, where the number of available measurements is smaller than the dimension of the model to be estimated. However…

Optimization and Control · Mathematics 2012-10-30 Venkat Chandrasekaran , Benjamin Recht , Pablo A. Parrilo , Alan S. Willsky

In this paper, we consider the problem of black box continuous submodular maximization where we only have access to the function values and no information about the derivatives is provided. For a monotone and continuous DR-submodular…

Machine Learning · Computer Science 2020-03-03 Lin Chen , Mingrui Zhang , Hamed Hassani , Amin Karbasi

In this paper we consider constrained optimization problems where both the objective and constraint functions are of the black-box type. Furthermore, we assume that the nonlinear inequality constraints are non-relaxable, i.e. their values…

Optimization and Control · Mathematics 2026-01-13 Andrea Brilli , Giampaolo Liuzzi , Stefano Lucidi

The Low Order-Value Optimization (LOVO) problem involves minimizing the minimum among a finite number of function values within a feasible set. LOVO has several practical applications such as robust parameter estimation, protein alignment,…

Optimization and Control · Mathematics 2025-11-27 Anderson E. Schwertner , Francisco N. C. Sobral

In this work we consider unconstrained optimization problems. The objective function is known through a zeroth order stochastic oracle that gives an estimate of the true objective function. To solve these problems, we propose a…

Optimization and Control · Mathematics 2025-08-04 Alberto De Santis , Giampaolo Liuzzi , Stefano Lucidi
‹ Prev 1 2 3 10 Next ›