English
Related papers

Related papers: Large Language Model Aided Multi-objective Evoluti…

200 papers

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

Multi-Objective Evolutionary Algorithms (MOEAs) have been proved efficient to deal with Multi-objective Optimization Problems (MOPs). Until now tens of MOEAs have been proposed. The unified mode would provide a more systematic approach to…

Neural and Evolutionary Computing · Computer Science 2011-02-01 Bojin Zheng , Yuanxiang Li

Instruction-based language modeling has received significant attention in pretrained language models. However, the efficiency of instruction engineering remains low and hinders the development of instruction studies. Recent studies have…

Computation and Language · Computer Science 2023-10-27 Heng Yang , Ke Li

Discovering efficient algorithms for solving complex problems has been an outstanding challenge in mathematics and computer science, requiring substantial human expertise over the years. Recent advancements in evolutionary search with large…

Artificial Intelligence · Computer Science 2026-05-26 Anja Surina , Amin Mansouri , Lars Quaedvlieg , Amal Seddas , Maryna Viazovska , Emmanuel Abbe , Caglar Gulcehre

The integration of Large Language Models (LLMs) with evolutionary computation (EC) has introduced a promising paradigm for automating the design of metaheuristic algorithms. However, existing frameworks, such as the Large Language Model…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Haoran Yin , Anna V. Kononova , Thomas Bäck , Niki van Stein

Large language models (LLMs) have become increasingly capable, but their development often requires substantial computational resources. While model merging has emerged as a cost-effective promising approach for creating new models by…

Neural and Evolutionary Computing · Computer Science 2025-01-28 Takuya Akiba , Makoto Shing , Yujin Tang , Qi Sun , David Ha

We study how large language models can be used in combination with evolutionary computation techniques to automatically discover optimization algorithms for the design of photonic structures. Building on the Large Language Model…

Neural and Evolutionary Computing · Computer Science 2025-03-26 Haoran Yin , Anna V. Kononova , Thomas Bäck , Niki van Stein

The advent of Large Language Models (LLMs) has opened new frontiers in automated algorithm design, giving rise to numerous powerful methods. However, these approaches retain critical limitations: they require extensive evaluation of the…

Neural and Evolutionary Computing · Computer Science 2026-02-05 Haoran Yin , Shuaiqun Pan , Zhao Wei , Jian Cheng Wong , Yew-Soon Ong , Anna V. Kononova , Thomas Bäck , Niki van Stein

Large language models (LLMs) are increasingly deployed in real-world applications that require careful balancing of multiple, often conflicting, objectives, such as informativeness versus conciseness, or helpfulness versus creativity.…

Machine Learning · Computer Science 2025-08-12 Qiang He , Setareh Maghsudi

Fine-tuning large language models (LLMs) with low-rank adaptation (LoRA) is a cost-effective way to incorporate information from a specific dataset. However, when a problem requires incorporating information from multiple datasets - as in…

Machine Learning · Computer Science 2026-04-03 Liyi Zhang , Jake Snell , Thomas L. Griffiths

Evolutionary algorithms (EAs) have proven effective in exploring the vast solution spaces typical of graph-structured combinatorial problems. However, traditional encoding schemes, such as binary or numerical representations, often fail to…

Neural and Evolutionary Computing · Computer Science 2025-10-28 Jie Zhao , Kang Hao Cheong

Large Language Models (LLMs) deliver powerful AI capabilities but face deployment challenges due to high resource costs and latency, whereas Small Language Models (SLMs) offer efficiency and deployability at the cost of reduced performance.…

Artificial Intelligence · Computer Science 2025-05-13 Yi Chen , JiaHao Zhao , HaoHao Han

The advent of large language models (LLMs) has revolutionized natural language processing, enabling unprecedented capabilities in understanding and generating human-like text. However, the computational cost and convergence times associated…

Computation and Language · Computer Science 2024-11-26 Kerim Büyükakyüz

Optimization benchmarks play a fundamental role in assessing algorithm performance; however, existing artificial benchmarks often fail to capture the diversity and irregularity of real-world problem structures, while benchmarks derived from…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Yuhiro Ono , Tomohiro Harada , Yukiya Miura

Many-objective evolutionary algorithms (MOEAs), especially the decomposition-based MOEAs, have attracted wide attention in recent years. Recent studies show that a well designed combination of the decomposition method and the domination…

Neural and Evolutionary Computing · Computer Science 2019-09-05 Yingyu Zhang , Yuanzhen Li , Quan-Ke Panb , P. N. Suganthan

Multi-objective discrete optimization problems, such as molecular design, pose significant challenges due to their vast and unstructured combinatorial spaces. Traditional evolutionary algorithms often get trapped in local optima, while…

Machine Learning · Computer Science 2025-10-09 Nian Ran , Zhongzheng Li , Yue Wang , Qingsong Ran , Xiaoyuan Zhang , Shikun Feng , Richard Allmendinger , Xiaoguang Zhao

Multi-Objective Reinforcement Learning (MORL) presents significant challenges and opportunities for optimizing multiple objectives in Large Language Models (LLMs). We introduce a MORL taxonomy and examine the advantages and limitations of…

Computation and Language · Computer Science 2025-09-29 Lingxiao Kong , Cong Yang , Oya Deniz Beyan , Zeyd Boukhers

Optimizing scientific computing algorithms for modern GPUs is a labor-intensive and iterative process involving repeated code modification, benchmarking, and tuning across complex hardware and software stacks. Recent work has explored large…

Artificial Intelligence · Computer Science 2026-01-22 Leyi Zhao , Weijie Huang , Yitong Guo , Jiang Bian , Chenghong Wang , Xuhong Zhang

Parameter control has succeeded in accelerating the convergence process of evolutionary algorithms. While empirical and theoretical studies have shed light on the behavior of algorithms for single-objective optimization, little is known…

Neural and Evolutionary Computing · Computer Science 2023-05-09 Furong Ye , Frank Neumann , Jacob de Nobel , Aneta Neumann , Thomas Bäck

Most multimodal multi-objective evolutionary algorithms (MMEAs) aim to find all global Pareto optimal sets (PSs) for a multimodal multi-objective optimization problem (MMOP). However, in real-world problems, decision makers (DMs) may be…

Neural and Evolutionary Computing · Computer Science 2023-06-13 Wenhua Li , Xingyi Yao , Kaiwen Li , Rui Wang , Tao Zhang , Ling Wang