English
Related papers

Related papers: Learning to Evolve for Optimization via Stability-…

200 papers

Optimization for deep networks is currently a very active area of research. As neural networks become deeper, the ability in manually optimizing the network becomes harder. Mini-batch normalization, identification of effective respective…

Neural and Evolutionary Computing · Computer Science 2018-08-07 M. U. B. Dias , D. D. N. De Silva , S. Fernando

Multi-objective evolutionary algorithms (MOEAs) are widely used to solve multi-objective optimization problems. The algorithms rely on setting appropriate parameters to find good solutions. However, this parameter tuning could be very…

Neural and Evolutionary Computing · Computer Science 2022-11-18 Remco Coppens , Robbert Reijnen , Yingqian Zhang , Laurens Bliek , Berend Steenhuisen

Learning to Optimize (L2O), a technique that utilizes machine learning to learn an optimization algorithm automatically from data, has gained arising attention in recent years. A generic L2O approach parameterizes the iterative update rule…

Machine Learning · Computer Science 2023-05-31 Jialin Liu , Xiaohan Chen , Zhangyang Wang , Wotao Yin , HanQin Cai

Customized static operator design has enabled widespread application of Evolutionary Algorithms (EAs), but their search effectiveness often deteriorates as evolutionary progresses. Dynamic operator configuration approaches attempt to…

Neural and Evolutionary Computing · Computer Science 2026-01-23 Rongjie Liao , Junhao Qiu , Xin Chen , Xiaoping Li

Geospatial modeling provides critical solutions for pressing global challenges such as sustainability and climate change. Existing large language model (LLM)-based algorithm discovery frameworks, such as AlphaEvolve, excel at evolving…

Artificial Intelligence · Computer Science 2025-09-29 Peng Luo , Xiayin Lou , Yu Zheng , Zhuo Zheng , Stefano Ermon

AlphaEvolve (Novikov et al., 2025) is a generic evolutionary coding agent that combines the generative capabilities of LLMs with automated evaluation in an iterative evolutionary framework that proposes, tests, and refines algorithmic…

Neural and Evolutionary Computing · Computer Science 2025-12-23 Bogdan Georgiev , Javier Gómez-Serrano , Terence Tao , Adam Zsolt Wagner

Learning to learn (L2L) trains a meta-learner to assist the learning of a task-specific base learner. Previously, it was shown that a meta-learner could learn the direct rules to update learner parameters; and that the learnt neural…

Learning to Optimize (L2O) enhances optimization efficiency with integrated neural networks. L2O paradigms achieve great outcomes, e.g., refitting optimizer, generating unseen solutions iteratively or directly. However, conventional L2O…

Machine Learning · Computer Science 2025-03-17 Mingjia Shi , Ruihan Lin , Xuxi Chen , Yuhao Zhou , Zezhen Ding , Pingzhi Li , Tong Wang , Kai Wang , Zhangyang Wang , Jiheng Zhang , Tianlong Chen

Variational Quantum Algorithms (VQAs) employ parameterized quantum circuits optimized using classical methods to minimize a cost function. While VQAs have found broad applications, certain challenges persist. Notably, a significant…

Quantum Physics · Physics 2025-03-06 Lucas Friedrich , Jonas Maziero

Neighborhood search operators are critical to the performance of Multi-Objective Evolutionary Algorithms (MOEAs) and rely heavily on expert design. Although recent LLM-based Automated Heuristic Design (AHD) methods have made notable…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Junhao Qiu , Xin Chen , Liang Ge , Liyong Lin , Zhichao Lu , Qingfu Zhang

In this white paper, we present AlphaEvolve, an evolutionary coding agent that substantially enhances capabilities of state-of-the-art LLMs on highly challenging tasks such as tackling open scientific problems or optimizing critical pieces…

Recent advancements in large language models (LLMs) have significantly enhanced the ability of LLM-based systems to perform complex tasks through natural language processing and tool interaction. However, optimizing these LLM-based systems…

Computation and Language · Computer Science 2025-06-19 Peiyan Zhang , Haibo Jin , Leyang Hu , Xinnuo Li , Liying Kang , Man Luo , Yangqiu Song , Haohan Wang

In this paper we consider the problem of learning variational models in the context of supervised learning via risk minimization. Our goal is to provide a deeper understanding of the two approaches of learning of variational models via…

Machine Learning · Statistics 2023-09-07 Christoph Brauer , Niklas Breustedt , Timo de Wolff , Dirk A. Lorenz

Dynamic Optimization Problems (DOPs) are challenging to address due to their complex nature, i.e., dynamic environment variation. Evolutionary Computation methods are generally advantaged in solving DOPs since they resemble dynamic…

Neural and Evolutionary Computing · Computer Science 2026-02-02 Zijian Gao , Yuanting Zhong , Zeyuan Ma , Yue-Jiao Gong , Hongshu Guo

Despite the success of metaheuristic algorithms in solving complex network optimization problems, they often struggle with adaptation, especially in dynamic or high-dimensional search spaces. Traditional approaches can become stuck in local…

Neural and Evolutionary Computing · Computer Science 2025-01-13 Boris Kriuk , Keti Sulamanidze , Fedor Kriuk

We introduce learning to condition (L2C), a scalable, data-driven framework for accelerating Most Probable Explanation (MPE) inference in Probabilistic Graphical Models (PGMs), a fundamentally intractable problem. L2C trains a neural…

Machine Learning · Computer Science 2025-10-01 Brij Malhotra , Shivvrat Arya , Tahrima Rahman , Vibhav Giridhar Gogate

Meta-learning models, or models that learn to learn, have been a long-desired target for their ability to quickly solve new tasks. Traditional meta-learning methods can require expensive inner and outer loops, thus there is demand for…

Neural and Evolutionary Computing · Computer Science 2021-03-12 Kevin Frans , Olaf Witkowski

The iterative search process of evolutionary algorithms (EAs) encapsulates optimization knowledge within historical populations and fitness evaluations. Effective utilization of this knowledge is crucial for facilitating knowledge transfer…

Neural and Evolutionary Computing · Computer Science 2026-04-22 Chao Wang , Lingling Li , Licheng Jiao , Jiaxuan Zhao , Fang Liu , Shuyuan Yang

In supply chain management, decision-making often involves balancing multiple conflicting objectives, such as cost reduction, service level improvement, and environmental sustainability. Traditional multi-objective optimization methods,…

Artificial Intelligence · Computer Science 2025-09-09 Niki Kotecha , Ehecatl Antonio del Rio Chanona

Evolutionary artificial neural networks (EANNs) refer to a special class of artificial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. Evolutionary algorithms are used to adapt…

Artificial Intelligence · Computer Science 2016-11-17 Ajith Abraham