English
Related papers

Related papers: Evolving Deep Learning Optimizers

200 papers

Evolution gave rise to human and animal intelligence here on Earth. We argue that the path to developing artificial human-like-intelligence will pass through mimicking the evolutionary process in a nature-like simulation. In Nature, there…

Artificial Intelligence · Computer Science 2020-05-07 João P. Abrantes , Arnaldo J. Abrantes , Frans A. Oliehoek

Modern deep learning heavily depends on adaptive optimizers such as Adam and its variants, which are renowned for their capacity to handle model scaling and streamline hyperparameter tuning. However, these algorithms typically experience…

Machine Learning · Computer Science 2024-10-18 Son Nguyen , Lizhang Chen , Bo Liu , Qiang Liu

The optimization algorithm and its hyperparameters can significantly affect the training speed and resulting model accuracy in machine learning applications. The wish list for an ideal optimizer includes fast and smooth convergence to low…

Machine Learning · Computer Science 2024-02-20 Marco Eckhoff , Markus Reiher

The concept of learning to optimize involves utilizing a trainable optimization strategy rather than relying on manually defined full gradient estimations such as ADAM. We present a framework that jointly trains the full gradient estimator…

Machine Learning · Computer Science 2026-01-30 Ruiqi Wang , Diego Klabjan

We propose several deep-learning accelerated optimization solvers with convergence guarantees. We use ideas from the analysis of accelerated forward-backward schemes like FISTA, but instead of the classical approach of proving convergence…

Optimization and Control · Mathematics 2021-05-12 Sebastian Banert , Jevgenija Rudzusika , Ozan Öktem , Jonas Adler

Optimizing functions without access to gradients is the remit of black-box methods such as evolution strategies. While highly general, their learning dynamics are often times heuristic and inflexible - exactly the limitations that…

Neural and Evolutionary Computing · Computer Science 2023-03-03 Robert Tjarko Lange , Tom Schaul , Yutian Chen , Tom Zahavy , Valentin Dallibard , Chris Lu , Satinder Singh , Sebastian Flennerhag

The learning dynamics of biological brains and artificial neural networks are of interest to both neuroscience and machine learning. A key difference between them is that neural networks are often trained from a randomly initialized state…

Neural and Evolutionary Computing · Computer Science 2025-05-19 Benjamin Midler , Alejandro Pan Vazquez

Momentum based optimizers are central to a wide range of machine learning applications. These typically rely on an Exponential Moving Average (EMA) of gradients, which decays exponentially the present contribution of older gradients. This…

Machine Learning · Computer Science 2024-10-01 Matteo Pagliardini , Pierre Ablin , David Grangier

This paper deals with nonconvex stochastic optimization problems in deep learning and provides appropriate learning rates with which adaptive learning rate optimization algorithms, such as Adam and AMSGrad, can approximate a stationary…

Optimization and Control · Mathematics 2020-11-24 Hideaki Iiduka

We present a framework for optimizing prompts in vision-language models to elicit multimodal reasoning without model retraining. Using an evolutionary algorithm to guide prompt updates downstream of visual tasks, our approach improves upon…

Computation and Language · Computer Science 2025-04-01 Sid Bharthulwar , John Rho , Katrina Brown

Differentiable programming has revolutionised optimisation by enabling efficient gradient-based training of complex models, such as Deep Neural Networks (NNs) with billions and trillions of parameters. However, traditional Evolutionary…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Beatrice F. R. Citterio , Andrea Tangherloni

This work uses genetic programming to explore the design space of local optimisation algorithms. Optimisers are expressed in the Push programming language, a stack-based language with a wide range of typed primitive instructions. The…

Neural and Evolutionary Computing · Computer Science 2019-05-27 Michael Lones

Differential evolution is one of the most prestigious population-based stochastic optimization algorithm for black-box problems. The performance of a differential evolution algorithm depends highly on its mutation and crossover strategy and…

Neural and Evolutionary Computing · Computer Science 2021-02-09 Jianyong Sun , Xin Liu , Thomas Bäck , Zongben Xu

Recent advancements in meta-learning have enabled the automatic discovery of novel reinforcement learning algorithms parameterized by surrogate objective functions. To improve upon manually designed algorithms, the parameterization of this…

Gradient-based first-order adaptive optimization methods such as the Adam optimizer are prevalent in training artificial networks, achieving the state-of-the-art results. This work attempts to answer the question whether it is viable for…

Neural and Evolutionary Computing · Computer Science 2022-12-20 Yukun Yang , Peng Li

Optimization algorithms are widely employed to tackle complex problems, but designing them manually is often labor-intensive and requires significant expertise. Global placement is a fundamental step in electronic design automation (EDA).…

Neural and Evolutionary Computing · Computer Science 2025-04-28 Xufeng Yao , Jiaxi Jiang , Yuxuan Zhao , Peiyu Liao , Yibo Lin , Bei Yu

Deep learning has shown that learned functions can dramatically outperform hand-designed functions on perceptual tasks. Analogously, this suggests that learned optimizers may similarly outperform current hand-designed optimizers, especially…

Neural and Evolutionary Computing · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jeremy Nixon , C. Daniel Freeman , Jascha Sohl-Dickstein

This paper studies a class of adaptive gradient based momentum algorithms that update the search directions and learning rates simultaneously using past gradients. This class, which we refer to as the "Adam-type", includes the popular…

Machine Learning · Computer Science 2019-03-12 Xiangyi Chen , Sijia Liu , Ruoyu Sun , Mingyi Hong

The recent successes of deep learning and deep reinforcement learning have firmly established their statuses as state-of-the-art artificial learning techniques. However, longstanding drawbacks of these approaches, such as their poor sample…

Artificial Intelligence · Computer Science 2020-02-05 Thommen George Karimpanal

Evolutionary computation (EC) algorithms, renowned as powerful black-box optimizers, leverage a group of individuals to cooperatively search for the optimum. The exploration-exploitation tradeoff (EET) plays a crucial role in EC, which,…

Neural and Evolutionary Computing · Computer Science 2024-04-15 Zeyuan Ma , Jiacheng Chen , Hongshu Guo , Yining Ma , Yue-Jiao Gong