English
Related papers

Related papers: Large Language Models as Evolutionary Optimizers

200 papers

Identifying critical nodes in networks is a classical decision-making task, and many methods struggle to strike a balance between adaptability and utility. Therefore, we propose an approach that empowers Evolutionary Algorithm (EA) with…

Social and Information Networks · Computer Science 2024-03-08 Jinzhu Mao , Dongyun Zou , Li Sheng , Siyi Liu , Chen Gao , Yue Wang , Yong Li

Large Language Models (LLMs) are used for Register-Transfer Level (RTL) code generation, but they face two main challenges: functional correctness and Power, Performance, and Area (PPA) optimization. Iterative, feedback-based methods…

Neural and Evolutionary Computing · Computer Science 2025-10-27 Kyungjun Min , Kyumin Cho , Junhwan Jang , Seokhyeong Kang

Generating challenging instances is crucial for the evaluation and advancement of combinatorial optimization solvers. In this work, we introduce EALG (Evolutionary Adversarial Generation of Language Model-Guided Generators), a novel…

Artificial Intelligence · Computer Science 2025-06-04 Ruibo Duan , Yuxin Liu , Xinyao Dong , Chenglin Fan

This paper presents an evolutionary framework for the training of large language models(LLM). The models are divided into several experts(sub-networks), which have the same structure but different parameter values. Only one expert is…

Machine Learning · Computer Science 2025-09-30 Yingshi Chen

Evolution, the engine behind the survival and growth of life on Earth, operates through the population-based process of reproduction. Inspired by this principle, this paper formally defines a newly emerging problem -- the population-based…

Computation and Language · Computer Science 2025-03-10 Yiqun Zhang , Peng Ye , Xiaocui Yang , Shi Feng , Shufei Zhang , Lei Bai , Wanli Ouyang , Shuyue Hu

The integration of Large Language Models (LLMs) with evolutionary computation (EC) has introduced a promising paradigm for automating the design of metaheuristic algorithms. However, existing frameworks, such as the Large Language Model…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Haoran Yin , Anna V. Kononova , Thomas Bäck , Niki van Stein

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

Evolutionary agentic systems intensify the trade-off between computational efficiency and reasoning capability by repeatedly invoking large language models (LLMs) during inference. This setting raises a central question: how can an agent…

Computation and Language · Computer Science 2026-04-27 Pretam Ray , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Automated heuristic design (AHD) has gained considerable attention for its potential to automate the development of effective heuristics. The recent advent of large language models (LLMs) has paved a new avenue for AHD, with initial efforts…

Neural and Evolutionary Computing · Computer Science 2024-07-16 Rui Zhang , Fei Liu , Xi Lin , Zhenkun Wang , Zhichao Lu , Qingfu Zhang

Optimization benchmarks play a fundamental role in assessing algorithm performance; however, existing artificial benchmarks often fail to capture the diversity and irregularity of real-world problem structures, while benchmarks derived from…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Yuhiro Ono , Tomohiro Harada , Yukiya Miura

We consider the protein sequence engineering problem, which aims to find protein sequences with high fitness levels, starting from a given wild-type sequence. Directed evolution has been a dominating paradigm in this field which has an…

Machine Learning · Computer Science 2025-01-20 Yinkai Wang , Jiaxing He , Yuanqi Du , Xiaohui Chen , Jianan Canal Li , Li-Ping Liu , Xiaolin Xu , Soha Hassoun

This paper pursues the insight that large language models (LLMs) trained to generate code can vastly improve the effectiveness of mutation operators applied to programs in genetic programming (GP). Because such LLMs benefit from training…

Neural and Evolutionary Computing · Computer Science 2022-06-20 Joel Lehman , Jonathan Gordon , Shawn Jain , Kamal Ndousse , Cathy Yeh , Kenneth O. Stanley

In the realm of machine learning, traditional model development and automated approaches like AutoML typically rely on layers of abstraction, such as tree-based or Cartesian genetic programming. Our study introduces "Guided Evolution" (GE),…

Neural and Evolutionary Computing · Computer Science 2024-07-18 Clint Morris , Michael Jurado , Jason Zutty

This paper presents LLM2TEA, a Large Language Model (LLM) driven MultiTask Evolutionary Algorithm, representing the first agentic AI designer of its kind operating with generative evolutionary multitasking (GEM). LLM2TEA enables the…

Artificial Intelligence · Computer Science 2025-10-14 Melvin Wong , Jiao Liu , Thiago Rios , Stefan Menzel , Yew Soon Ong

An evolutionary algorithm (EA) is developed as an alternative to the EM algorithm for parameter estimation in model-based clustering. This EA facilitates a different search of the fitness landscape, i.e., the likelihood surface, utilizing…

Computation · Statistics 2020-06-09 Sharon M. McNicholas , Paul D. McNicholas , Daniel A. Ashlock

Large Language Models (LLMs) excel in various tasks, but they rely on carefully crafted prompts that often demand substantial human effort. To automate this process, in this paper, we propose a novel framework for discrete prompt…

Computation and Language · Computer Science 2025-05-02 Qingyan Guo , Rui Wang , Junliang Guo , Bei Li , Kaitao Song , Xu Tan , Guoqing Liu , Jiang Bian , Yujiu Yang

When we manually design an evolutionary optimization algorithm, we implicitly or explicitly assume a set of target optimization problems. In the case of automated algorithm design, target optimization problems are usually explicitly shown.…

Neural and Evolutionary Computing · Computer Science 2025-03-03 Lie Meng Pang , Hisao Ishibuchi

Surrogate-assisted evolutionary algorithms have been widely developed to solve complex and computationally expensive multi-objective optimization problems in recent years. However, when dealing with high-dimensional optimization problems,…

Neural and Evolutionary Computing · Computer Science 2024-03-19 Guodong Chen , Jiu Jimmy Jiao , Xiaoming Xue , Zhongzheng Wang

Large Language Models (LLMs) have shown great potential in automatically generating and optimizing (meta)heuristics, making them valuable tools in heuristic optimization tasks. However, LLMs are generally inefficient when it comes to…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Niki van Stein , Diederick Vermetten , Thomas Bäck