English
Related papers

Related papers: Black-box optimization on hyper-rectangle using Re…

200 papers

This paper presents an evolutionary algorithm with a new goal-sequence domination scheme for better decision support in multi-objective optimization. The approach allows the inclusion of advanced hard/soft priority and constraint…

Artificial Intelligence · Computer Science 2011-06-02 E. F. Khor , T. H. Lee , R. Sathikannan , K. C. Tan

We study novel robust zero-order algorithms with acceleration for the solution of real-time optimization problems. In particular, we propose a family of extremum seeking dynamics that can be universally modeled as singularly perturbed…

Optimization and Control · Mathematics 2020-12-17 Jorge I. Poveda , Na Li

In this work, we utilize a Trust Region based Derivative Free Optimization (DFO-TR) method to directly maximize the Area Under Receiver Operating Characteristic Curve (AUC), which is a nonsmooth, noisy function. We show that AUC is a smooth…

Machine Learning · Computer Science 2017-03-22 Hiva Ghanbari , Katya Scheinberg

A gradient-free deterministic method is developed to solve global optimization problems for Lipschitz continuous functions defined in arbitrary path-wise connected compact sets in Euclidean spaces. The method can be regarded as granular…

Optimization and Control · Mathematics 2021-07-15 Tao Qian , Lei Dai , Liming Zhang , Zehua Chen

This work explores a novel approach for adaptive, differentiable parametrization of large-scale non-stationary random fields. Coupled with any gradient-based algorithm, the method can be applied to variety of optimization problems,…

Optimization and Control · Mathematics 2019-03-19 Andrei Mukhin , Aleksey Khlyupin

This paper proposes a new algorithm for solving constrained global optimization problems where both the objective function and constraints are one-dimensional non-differentiable multiextremal Lipschitz functions. Multiextremal constraints…

Optimization and Control · Mathematics 2011-07-27 Yaroslav D. Sergeyev

In multiobjective optimization, the result of an optimization algorithm is a set of efficient solutions from which the decision maker selects one. It is common that not all the efficient solutions can be computed in a short time and the…

Neural and Evolutionary Computing · Computer Science 2024-03-20 Miguel Ángel Domínguez-Ríos , Francisco Chicano , Enrique Alba

Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem…

Robotics · Computer Science 2023-02-01 Joanne Taery Kim , Sehoon Ha

We present an optimization algorithm that can identify a global minimum of a potentially nonconvex smooth function with high probability, assuming the Gibbs measure of the potential satisfies a logarithmic Sobolev inequality. Our…

Optimization and Control · Mathematics 2025-09-16 Daniel Cortild , Claire Delplancke , Nadia Oudjane , Juan Peypouquet

In many practical decision-making problems it happens that functions involved in optimization process are black-box with unknown analytical representations and hard to evaluate. In this paper, a global optimization problem is considered…

Optimization and Control · Mathematics 2015-09-16 Yaroslav D. Sergeyev , Dmitri E. Kvasov

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

In this paper, we consider smooth convex optimization problems with simple constraints and inexactness in the oracle information such as value, partial or directional derivatives of the objective function. We introduce a unifying framework,…

Optimization and Control · Mathematics 2020-12-17 Pavel Dvurechensky , Alexander Gasnikov , Alexander Tiurin , Vladimir Zholobov

Context. Mathematical optimization can be used as a computational tool to obtain the optimal solution to a given problem in a systematic and efficient way. For example, in twice-differentiable functions and problems with no constraints, the…

Instrumentation and Methods for Astrophysics · Physics 2009-05-25 J. Canto , S. Curiel , E. Martinez-Gomez

Numerous applications require algorithms that can align partially overlapping point sets while maintaining invariance to geometric transformations (e.g., similarity, affine, rigid). This paper introduces a novel global optimization method…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Wei Lian , Zhesen Cui , Fei Ma , Hang Pan , Wangmeng Zuo , Jianmei Zhang

Black-box optimization is primarily important for many compute-intensive applications, including reinforcement learning (RL), robot control, etc. This paper presents a novel theoretical framework for black-box optimization, in which our…

Machine Learning · Computer Science 2020-09-10 Yueming Lyu , Ivor W. Tsang

Feature-based algorithm selection aims to automatically find the best one from a portfolio of optimization algorithms on an unseen problem based on its landscape features. Feature-based algorithm selection has recently received attention in…

Neural and Evolutionary Computing · Computer Science 2022-04-27 Ryoji Tanabe

We consider derivative-free black-box global optimization of expensive noisy functions, when most of the randomness in the objective is produced by a few influential scalar random inputs. We present a new Bayesian global optimization…

Machine Learning · Computer Science 2016-02-23 Saul Toscano-Palmerin , Peter I. Frazier

Many computer vision problems are formulated as the optimization of a cost function. This approach faces two main challenges: (i) designing a cost function with a local optimum at an acceptable solution, and (ii) developing an efficient…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Jayakorn Vongkulbhisal , Fernando De la Torre , João P. Costeira

Classification performance is often not uniform over the data. Some areas in the input space are easier to classify than others. Features that hold information about the "difficulty" of the data may be non-discriminative and are therefore…

Machine Learning · Computer Science 2016-05-24 Oran Richman , Shie Mannor

Global optimization of black-box functions is challenging in high dimensions. We introduce a conceptual adaptive random search framework, Branching Adaptive Surrogate Search Optimization (BASSO), that combines partitioning and surrogate…

Optimization and Control · Mathematics 2025-04-28 Pariyakorn Maneekul , Zelda B. Zabinsky , Giulia Pedrielli