English
Related papers

Related papers: Towards Explainable Evolution Strategies with Larg…

200 papers

Environmental, Social, and Governance (ESG) considerations play a central role in contemporary financial decision-making. In parallel, Large Language Model (LLM) applications in this domain have primarily emphasized well-defined…

Computational Engineering, Finance, and Science · Computer Science 2026-05-01 Gabriel Assis , Ayrton Surica , Pedro Kroll , Gabriela Aires , Darian Rabbani , Edson Bollis , Lucas Pellicer , Aline Paes

This paper explores the seamless integration of Generative AI (GenAI) and Evolutionary Algorithms (EAs) within the domain of large-scale multi-objective optimization. Focusing on the transformative role of Large Language Models (LLMs), our…

Neural and Evolutionary Computing · Computer Science 2024-05-14 Gaurav Singh , Kavitesh Kumar Bali

Evolution Strategies (ES) has recently emerged as a competitive alternative to reinforcement learning (RL) for large language model (LLM) fine-tuning, offering advantages through simplicity, scalability, and inference-only training.…

Machine Learning · Computer Science 2026-05-29 Kajetan Schweighofer , Conor F. Hayes , Roberto Dailey , Risto Miikkulainen , Xin Qiu

Optimization can be found in many real-life applications. Designing an effective algorithm for a specific optimization problem typically requires a tedious amount of effort from human experts with domain knowledge and algorithm design…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Fei Liu , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

Multi-objective optimization is a common problem in practical applications, and multi-objective evolutionary algorithm (MOEA) is considered as one of the effective methods to solve these problems. However, their randomness sometimes…

Neural and Evolutionary Computing · Computer Science 2024-10-04 Wanyi Liu , Long Chen , Zhenzhou Tang

In the evolutionary computing community, the remarkable language-handling capabilities and reasoning power of large language models (LLMs) have significantly enhanced the functionality of evolutionary algorithms (EAs), enabling them to…

Neural and Evolutionary Computing · Computer Science 2025-09-25 Jiao Liu , Zhu Sun , Shanshan Feng , Caishun Chen , Yew-Soon Ong

We demonstrate the ability of large language models (LLMs) to perform iterative self-improvement of robot policies. An important insight of this paper is that LLMs have a built-in ability to perform (stochastic) numerical optimization and…

Evolution Strategies (ES) is a class of powerful black-box optimisation methods that are highly parallelisable and can handle non-differentiable and noisy objectives. However, na\"ive ES becomes prohibitively expensive at scale on GPUs due…

This research presents a novel application of Evolutionary Computation to the domain of residential electric vehicle (EV) energy management. While reinforcement learning (RL) achieves high performance in vehicle-to-grid (V2G) optimization,…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Vishesh Purnananda , Benjamin John Wruck , Mingyu Guo

The integration of Environmental, Social, and Governance (ESG) factors into corporate decision-making is a fundamental aspect of sustainable finance. However, ensuring that business practices align with evolving regulatory frameworks…

Artificial Intelligence · Computer Science 2025-12-17 Mattia Birti , Andrea Maurino , Francesco Osborne

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

Multi-objective optimization problems (MOPs) are ubiquitous in real-world applications, presenting a complex challenge of balancing multiple conflicting objectives. Traditional evolutionary algorithms (EAs), though effective, often rely on…

Neural and Evolutionary Computing · Computer Science 2024-07-29 Yuxiao Huang , Shenghao Wu , Wenjie Zhang , Jibin Wu , Liang Feng , Kay Chen Tan

Evaluating true metacognition in Large Language Models (LLMs) is difficult due to biases and heuristics. This paper presents a framework to measure and enhance LLM metacognition while controlling for these biases. A measurement method using…

Neural and Evolutionary Computing · Computer Science 2026-05-26 Sangjun Park , Elliot Meyerson , Xin Qiu , Risto Miikkulainen

Large language models (LLMs) exhibit remarkable capabilities across diverse tasks, yet aligning them efficiently and effectively with human expectations remains a critical challenge. This thesis advances LLM alignment by introducing novel…

Computation and Language · Computer Science 2025-06-12 Yuxin Jiang

Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task…

Computation and Language · Computer Science 2024-06-04 Zhengwei Tao , Ting-En Lin , Xiancai Chen , Hangyu Li , Yuchuan Wu , Yongbin Li , Zhi Jin , Fei Huang , Dacheng Tao , Jingren Zhou

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

The transition from static Large Language Models (LLMs) to self-improving agents is hindered by the lack of structured reasoning in traditional evolutionary approaches. Existing methods often struggle with premature convergence and…

Artificial Intelligence · Computer Science 2026-01-01 Chunhui Wan , Xunan Dai , Zhuo Wang , Minglei Li , Yanpeng Wang , Yinan Mao , Yu Lan , Zhiwen Xiao

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

In recent years, large language models (LLMs) have made remarkable progress, with model optimization primarily relying on gradient-based optimizers such as Adam. However, these gradient-based methods impose stringent hardware requirements,…

Artificial Intelligence · Computer Science 2025-10-24 WenTao Liu , Siyu Song , Hao Hao , Aimin Zhou