English
Related papers

Related papers: Parameter-Free Deterministic Global Search with Ce…

200 papers

Comparison-Based Optimization (CBO) is an optimization paradigm that assumes only very limited access to the objective function f(x). Despite the growing relevance of CBO to real-world applications, this field has received little attention…

Optimization and Control · Mathematics 2023-03-27 Isha Slavin , Daniel McKenzie

We consider the fundamental derandomization problem of deterministically finding a satisfying assignment to a CNF formula that has many satisfying assignments. We give a deterministic algorithm which, given an $n$-variable…

Computational Complexity · Computer Science 2018-01-12 Rocco A. Servedio , Li-Yang Tan

Factor Analysis (FA) is a technique of fundamental importance that is widely used in classical and modern multivariate statistics, psychometrics and econometrics. In this paper, we revisit the classical rank-constrained FA problem, which…

Methodology · Statistics 2017-04-25 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

A formulation for the automated generation of algorithms via mathematical programming (optimization) is proposed. The formulation is based on the concept of optimizing within a parameterized family of algorithms, or equivalently a family of…

Optimization and Control · Mathematics 2018-02-14 Alexander Mitsos , Jaromił Najman , Ioannis G. Kevrekidis

We introduce a new online algorithm for expected log-likelihood maximization in situations where the objective function is multi-modal and/or has saddle points, that we term G-PFSO. The key element underpinning G-PFSO is a probability…

Machine Learning · Statistics 2022-07-07 Mathieu Gerber , Randal Douc

Dynamic Threshold Optimization (DTO) adaptively "compresses" the decision space (DS) in a global search and optimization problem by bounding the objective function from below. This approach is different from "shrinking" DS by reducing…

Other Computer Science · Computer Science 2012-06-07 Richard A. Formato

In this paper, we propose the StepDIRECT algorithm for derivative-free optimization (DFO), in which the black-box objective function has a stepwise landscape. Our framework is based on the well-known DIRECT algorithm. By incorporating the…

Optimization and Control · Mathematics 2022-02-03 Dzung T. Phan , Hongsheng Liu , Lam M. Nguyen

Parameter selection is one of the most important parts for nearly all the control strategies. Traditionally, controller parameters are chosen by utilizing trial and error, which is always tedious and time consuming. Moreover, such method is…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Yujia Wang , Tong Wang , Jiae Yang , Xuebo Yang

Multi-objective optimization is a widely studied problem in diverse fields, such as engineering and finance, that seeks to identify a set of non-dominated solutions that provide optimal trade-offs among competing objectives. However, the…

Neural and Evolutionary Computing · Computer Science 2024-01-15 Arash Heidari , Sebastian Rojas Gonzalez , Tom Dhaene , Ivo Couckuyt

The main contribution of this paper is an efficient and generalized decentralized monitoring algorithm allowing to detect satisfaction or violation of any regular specification by local monitors alone in a system without central observation…

Software Engineering · Computer Science 2014-02-18 Tom Cornebize , Yliès Falcone

The parameter-less hierarchical Bayesian optimization algorithm (hBOA) enables the use of hBOA without the need for tuning parameters for solving each problem instance. There are three crucial parameters in hBOA: (1) the selection pressure,…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Martin Pelikan , Tz-Kai Lin

This paper proposes the multi objective variant of the recently introduced fitness dependent optimizer (FDO). The algorithm is called a Multi objective Fitness Dependent Optimizer (MOFDO) and is equipped with all five types of knowledge…

Neural and Evolutionary Computing · Computer Science 2023-02-14 Jaza M. Abdullah , Tarik A. Rashid , Bestan B. Maaroof , Seyedali Mirjalili

Bayesian optimization is a class of data efficient model based algorithms typically focused on global optimization. We consider the more general case where a user is faced with multiple problems that each need to be optimized conditional on…

Machine Learning · Statistics 2020-11-04 Michael Pearce , Janis Klaise , Matthew Groves

Optimization algorithms are essential for solving many real-world problems. However, challenges such as getting trapped in local minima and effectively balancing exploration and exploitation often limit their performance. This paper…

Artificial Intelligence · Computer Science 2025-09-23 Mahmood A. Jumaah , Yossra H. Ali , Tarik A. Rashid

In the paper, the global optimization problem of a multidimensional "black-box" function satisfying the Lipschitz condition over a hyperinterval with an unknown Lipschitz constant is considered. A new efficient algorithm for solving this…

Optimization and Control · Mathematics 2015-03-19 Yaroslav D. Sergeyev , Dmitri E. Kvasov

Given a set of human's decisions that are observed, inverse optimization has been developed and utilized to infer the underlying decision making problem. The majority of existing studies assumes that the decision making problem is with a…

Machine Learning · Statistics 2018-08-03 Chaosheng Dong , Bo Zeng

Heuristic forward search is currently the dominant paradigm in classical planning. Forward search algorithms typically rely on a single, relatively simple variation of best-first search and remain fixed throughout the process of solving a…

Artificial Intelligence · Computer Science 2019-11-28 Pawel Gomoluch , Dalal Alrajeh , Alessandra Russo , Antonio Bucchiarone

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

Mathematical optimization is a fundamental tool for decision-making in a wide range of applications. However, in many real-world scenarios, the parameters of the optimization problem are not known a priori and must be predicted from…

Machine Learning · Computer Science 2025-11-13 Senne Berden , Ali İrfan Mahmutoğulları , Dimos Tsouros , Tias Guns

Software configuration tuning is essential for optimizing a given performance objective (e.g., minimizing latency). Yet, due to the software's intrinsically complex configuration landscape and expensive measurement, there has been a rather…

Software Engineering · Computer Science 2024-03-18 Pengzhou Chen , Tao Chen , Miqing Li