English
Related papers

Related papers: A New Method for Lower Bounds on the Running Time …

200 papers

We lower bound the complexity of finding $\epsilon$-stationary points (with gradient norm at most $\epsilon$) using stochastic first-order methods. In a well-studied model where algorithms access smooth, potentially non-convex functions…

Optimization and Control · Mathematics 2022-03-01 Yossi Arjevani , Yair Carmon , John C. Duchi , Dylan J. Foster , Nathan Srebro , Blake Woodworth

A boundary evolution Algorithm (BEA) is proposed by simultaneously taking into account the bottom and the high-level crossover and mutation, ie., the boundary of the hierarchical genetic algorithm. Operators and optimal individuals based on…

Neural and Evolutionary Computing · Computer Science 2019-03-06 Zhaoyang Ai , Chaodong Fan , Yingjie Zhang , Huigui Rong , Ze'an Tian , Haibing Fu

The decomposition-based multi-objective evolutionary algorithm (MOEA/D) does not directly optimize a given multi-objective function $f$, but instead optimizes $N + 1$ single-objective subproblems of $f$ in a co-evolutionary manner. It…

Neural and Evolutionary Computing · Computer Science 2024-10-07 Benjamin Doerr , Martin S. Krejca , Noé Weeks

A key challenge to make effective use of evolutionary algorithms is to choose appropriate settings for their parameters. However, the appropriate parameter setting generally depends on the structure of the optimisation problem, which is…

Neural and Evolutionary Computing · Computer Science 2020-04-02 Brendan Case , Per Kristian Lehre

We consider a classical scheduling problem on $m$ identical machines. For an arbitrary constant $q>1$, the aim is to assign jobs to machines such that $\sum_{i=1}^m C_i^q$ is minimized, where $C_i$ is the total processing time of jobs…

Computational Complexity · Computer Science 2021-07-14 Lin Chen , Liangde Tao , José Verschae

We study upper and lower bounds on the sample-complexity of learning near-optimal behaviour in finite-state discounted Markov Decision Processes (MDPs). For the upper bound we make the assumption that each action leads to at most two…

Machine Learning · Computer Science 2013-05-17 Tor Lattimore , Marcus Hutter

We study the computational limits of Low-Rank Adaptation (LoRA) for finetuning transformer-based models using fine-grained complexity theory. Our key observation is that the existence of low-rank decompositions within the gradient…

Machine Learning · Computer Science 2025-06-09 Jerry Yao-Chieh Hu , Maojiang Su , En-Jui Kuo , Zhao Song , Han Liu

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification.…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Mohammad Reza Bonyadi , David C. Reutens

Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use…

Quantum Physics · Physics 2024-12-24 Vignesh Anantharamakrishnan , Márcio M. Taddei

In evolutionary algorithms, the fitness of a population increases with time by mutating and recombining individuals and by a biased selection of more fit individuals. The right selection pressure is critical in ensuring sufficient…

Artificial Intelligence · Computer Science 2007-05-23 Marcus Hutter

This paper presents a novel Differential Evolution algorithm for protein folding optimization that is applied to a three-dimensional AB off-lattice model. The proposed algorithm includes two new mechanisms. A local search is used to improve…

Artificial Intelligence · Computer Science 2018-05-08 Borko Bošković , Janez Brest

The $(1 + (\lambda,\lambda))$ genetic algorithm is a younger evolutionary algorithm trying to profit also from inferior solutions. Rigorous runtime analyses on unimodal fitness functions showed that it can indeed be faster than classical…

Neural and Evolutionary Computing · Computer Science 2022-06-17 Denis Antipov , Benjamin Doerr , Vitalii Karavaev

We study evolutionary algorithms in a dynamic setting, where for each generation a different fitness function is chosen, and selection is performed with respect to the current fitness function. Specifically, we consider Dynamic BinVal, in…

Neural and Evolutionary Computing · Computer Science 2021-07-09 Johannes Lengler , Simone Riedi

A hybrid evolutionary algorithm with importance sampling method is proposed for multi-dimensional optimization problems in this paper. In order to make use of the information provided in the search process, a set of visited solutions is…

Neural and Evolutionary Computing · Computer Science 2013-08-26 Guanghui Huang , Zhifeng Pan

One important goal of black-box complexity theory is the development of complexity models allowing to derive meaningful lower bounds for whole classes of randomized search heuristics. Complementing classical runtime analysis, black-box…

Neural and Evolutionary Computing · Computer Science 2016-04-11 Carola Doerr , Johannes Lengler

Recently, it has been proven that evolutionary algorithms produce good results for a wide range of combinatorial optimization problems. Some of the considered problems are tackled by evolutionary algorithms that use a representation which…

Neural and Evolutionary Computing · Computer Science 2013-01-18 Benjamin Doerr , Anton Eremeev , Frank Neumann , Madeleine Theile , Christian Thyssen

As an important part of genetic algorithms (GAs), mutation operators is widely used in evolutionary algorithms to solve $\mathcal{NP}$-hard problems because it can increase the population diversity of individual. Due to limitations in…

Neural and Evolutionary Computing · Computer Science 2024-03-19 Yang Yang

Traditional methods present a very restrictive range of applications, mainly limited by the features of the function to be optimized and of the constraint functions. In contrast, evolutionary algorithms present almost no restriction to the…

Neural and Evolutionary Computing · Computer Science 2021-01-26 Mauro S. Innocente , Johann Sienz

In this paper we study the evolution of the mutation rate for simple organisms in dynamic environments. A model with multiple fitness coding loci tracking a moving fitness peak is developed and an analytical expression for the optimal…

Biological Physics · Physics 2007-05-23 Martin Nilsson , Nigel Snoad

Optimization seeks extremal points in a function. When there are superextensively many optima, optimization algorithms are liable to get stuck. Under these conditions, generic algorithms tend to find marginal optima, which have many nearly…

Disordered Systems and Neural Networks · Physics 2024-07-25 Jaron Kent-Dobias