English
Related papers

Related papers: Benchmarking Randomized Optimization Algorithms on…

200 papers

We consider online convex optimization with time-varying stage costs and additional switching costs. Since the switching costs introduce coupling across all stages, multi-step-ahead (long-term) predictions are incorporated to improve the…

Machine Learning · Computer Science 2020-11-26 Yingying Li , Na Li

One key challenge in optimization is the selection of a suitable set of benchmark problems. A common goal is to find functions which are representative of a class of real-world optimization problems in order to ensure findings on the…

Neural and Evolutionary Computing · Computer Science 2025-05-15 Diederick Vermetten , Catalin-Viorel Dinu , Marcus Gallagher

This study analyzes performance of several genetic and evolutionary algorithms on randomly generated NK fitness landscapes with various values of n and k. A large number of NK problem instances are first generated for each n and k, and the…

Neural and Evolutionary Computing · Computer Science 2008-07-30 Martin Pelikan

In this paper we develop optimal algorithms in the binary-forking model for a variety of fundamental problems, including sorting, semisorting, list ranking, tree contraction, range minima, and ordered set union, intersection and difference.…

Data Structures and Algorithms · Computer Science 2020-06-26 Guy E. Blelloch , Jeremy T. Fineman , Yan Gu , Yihan Sun

The compact Genetic Algorithm (cGA), parameterized by its hypothetical population size $K$, offers a low-memory alternative to evolving a large offspring population of solutions. It evolves a probability distribution, biasing it towards…

Neural and Evolutionary Computing · Computer Science 2024-04-19 Cella Florescu , Marc Kaufmann , Johannes Lengler , Ulysse Schaller

The power system planning task is a combinatorial optimization problem. The objective function minimizes the economic costs subject to a set of technical and operational constraints. Meta-heuristics are often used as optimization strategies…

Systems and Control · Electrical Eng. & Systems 2020-02-11 Florian Schäfer , Jan-Hendrik Menke , Martin Braun

The paper presents an experimental study of resilient path planning for con-tinuum robots taking into account the multi-objective optimisation problem. To do this, we used two well-known algorithms, namely Genetic algorithm and A*…

Robotics · Computer Science 2024-11-06 Oxana Shamilyan , Ievgen Kabin , Zoya Dyka , Peter Langendoerfer

Neural networks are gaining popularity in the reinforcement learning field due to the vast number of successfully solved complex benchmark problems. In fact, artificial intelligence algorithms are, in some cases, able to overcome human…

Neural and Evolutionary Computing · Computer Science 2019-04-25 Mikel Malagon , Josu Ceberio

Optimization algorithms for wireless systems play a fundamental role in improving their performance and efficiency. However, it is known that the complexity of conventional optimization algorithms in the literature often exponentially…

Signal Processing · Electrical Eng. & Systems 2024-07-04 Rafael Cerna Loli , Bruno Clerckx

Heuristic algorithms such as simulated annealing, Concorde, and METIS are effective and widely used approaches to find solutions to combinatorial optimization problems. However, they are limited by the high sample complexity required to…

Machine Learning · Computer Science 2019-06-18 Qingpeng Cai , Will Hang , Azalia Mirhoseini , George Tucker , Jingtao Wang , Wei Wei

We study a class of nonconvex nonsmooth optimization problems in which the objective is a sum of two functions: One function is the average of a large number of differentiable functions, while the other function is proper, lower…

Optimization and Control · Mathematics 2023-05-12 Duy-Nhat Phan , Sedi Bartz , Nilabja Guha , Hung M. Phan

We contribute the first randomized algorithm that is an integration of arbitrarily many deterministic algorithms for the fully online multiprocessor scheduling with testing problem. When there are two machines, we show that with two…

Data Structures and Algorithms · Computer Science 2023-06-29 Mingyang Gong , Zhi-Zhong Chen , Guohui Lin , Lusheng Wang

Stochastic approximation (SA) is a powerful class of iterative algorithms for nonlinear root-finding that can be used for minimizing a loss function, $L(\boldsymbol{\theta})$, with respect to a parameter vector $\boldsymbol{\theta}$, when…

Optimization and Control · Mathematics 2017-07-24 Karla Hernández Cuevas

The implementation of adaptive genetic algorithms (AGA) for optimization problems has proven to be superior than many other methods due to its nature of producing more robust and high quality solutions. Considering the complexity involved…

Computational Physics · Physics 2024-11-28 Brandon Willnecker , Mervlyn Moodley

We investigate the power of randomized algorithms for the maximum cardinality matching (MCM) and the maximum weight matching (MWM) problems in the online preemptive model. In this model, the edges of a graph are revealed one by one and the…

Data Structures and Algorithms · Computer Science 2015-07-03 Ashish Chiplunkar , Sumedh Tirodkar , Sundar Vishwanathan

Hamiltonian Monte Carlo (HMC) algorithms which combine numerical approximation of Hamiltonian dynamics on finite intervals with stochastic refreshment and Metropolis correction are popular sampling schemes, but it is known that they may…

Computation · Statistics 2022-08-16 Peter A. Whalley , Daniel Paulin , Benedict Leimkuhler

Randomized search heuristics such as evolutionary algorithms, simulated annealing, and ant colony optimization are a broadly used class of general-purpose algorithms. Analyzing them via classical methods of theoretical computer science is a…

Neural and Evolutionary Computing · Computer Science 2015-03-18 Benjamin Doerr , Carola Winzen

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

We propose and analyse a variant of the recently introduced kinetic based optimization method that incorporates ideas like survival-of-the-fittest and mutation strategies well-known from genetic algorithms. Thus, we provide a first attempt…

Optimization and Control · Mathematics 2024-07-18 Giacomo Albi , Federica Ferrarese , Claudia Totzeck

We combine the fields of heuristic optimization and optimal stopping. We propose a strategy for benchmarking randomized optimization algorithms that minimizes the expected total cost for obtaining a good solution with an optimal number of…

Quantum Physics · Physics 2016-12-07 Walter Vinci , Daniel A. Lidar