English
Related papers

Related papers: Evolution without an Oracle: Driving Effective Evo…

200 papers

Large Language Models (LLMs) have shown strong capabilities in language understanding and reasoning across diverse domains. Recently, there has been increasing interest in utilizing LLMs not merely as assistants in optimization tasks, but…

Neural and Evolutionary Computing · Computer Science 2025-10-10 Jie Zhao , Tao Wen , Kang Hao Cheong

Uncertainty quantification (UQ) methods for large language models are predominantly designed by hand based on domain knowledge and heuristics, limiting their scalability and generality. We apply LLM-powered evolutionary search to…

Computation and Language · Computer Science 2026-04-07 Mikhail Seleznyov , Daniil Korbut , Viktor Moskvoretskii , Oleg Somov , Alexander Panchenko , Elena Tutubalina

Differential Evolution (DE) is a widely used evolutionary algorithm for black-box optimization problems. However, in modern DE implementations, a major challenge lies in the limited population diversity caused by the fixed population size…

Neural and Evolutionary Computing · Computer Science 2025-06-18 Tomofumi Kitamura , Alex Fukunaga

We introduce Evolutionary Ensemble (EvE), a decentralized framework that organizes existing, highly capable coding agents into a live, co-evolving system for algorithmic discovery. Rather than reinventing the wheel within the "LLMs as…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Zongmin Yu , Liu Yang

Large Language Models (LLMs) have achieved significant progress across various fields and have exhibited strong potential in evolutionary computation, such as generating new solutions and automating algorithm design. Surrogate-assisted…

Neural and Evolutionary Computing · Computer Science 2024-06-18 Hao Hao , Xiaoqun Zhang , Aimin Zhou

This paper presents EASE (Effortless Algorithmic Solution Evolution), an open-source and fully modular framework for iterative algorithmic solution generation leveraging large language models (LLMs). EASE integrates generation, testing,…

Machine Learning · Computer Science 2025-09-24 Adam Viktorin , Tomas Kadavy , Jozef Kovac , Michal Pluhacek , Roman Senkerik

The reasoning frontier of Large Language Models (LLMs) has advanced significantly through modern post-training paradigms (e.g., Reinforcement Learning from Verifiable Rewards (RLVR)). However, the efficacy of these methods remains…

Machine Learning · Computer Science 2026-05-13 Liqin Ye , Yanbin Yin , Michael Galarnyk , Yuzhao Heng , Sudheer Chava , Chao Zhang

LLM-as-a-Judge has revolutionized AI evaluation by leveraging large language models for scalable assessments. However, as evaluands become increasingly complex, specialized, and multi-step, the reliability of LLM-as-a-Judge has become…

Computation and Language · Computer Science 2026-01-09 Runyang You , Hongru Cai , Caiqi Zhang , Qiancheng Xu , Meng Liu , Tiezheng Yu , Yongqi Li , Wenjie Li

Large Language Models (LLMs) have demonstrated remarkable capabilities on various tasks, while the further evolvement is limited to the lack of high-quality training data. In addition, traditional training approaches rely too much on…

Computation and Language · Computer Science 2025-02-14 Peidong Wang , Ming Wang , Zhiming Ma , Xiaocui Yang , Shi Feng , Daling Wang , Yifei Zhang , Kaisong Song

Machine learning may enable the automated generation of test oracles. We have characterized emerging research in this area through a systematic literature review examining oracle types, researcher goals, the ML techniques applied, how the…

Software Engineering · Computer Science 2021-08-10 Afonso Fontes , Gregory Gay

Large Transformer models are capable of implementing a plethora of so-called in-context learning algorithms. These include gradient descent, classification, sequence completion, transformation, and improvement. In this work, we investigate…

Artificial Intelligence · Computer Science 2024-02-29 Robert Tjarko Lange , Yingtao Tian , Yujin Tang

Training large language models (LLMs) with synthetic reasoning data has become a popular approach to enhancing their reasoning capabilities, while a key factor influencing the effectiveness of this paradigm is the quality of the generated…

Artificial Intelligence · Computer Science 2026-03-24 Zhuojie Yang , Wentao Wan , Keze Wang

AI-assisted programming is rapidly reshaping software development, with large language models (LLMs) enabling new paradigms such as vibe coding and agentic coding. While prior works have focused on prompt design and code generation quality,…

Software Engineering · Computer Science 2026-02-10 Fei Gu , Zi Liang , Jiahao MA , Hongzong LI

Evolve-based agent such as AlphaEvolve is one of the notable successes in using Large Language Models (LLMs) to build AI Scientists. These agents tackle open-ended scientific problems by iteratively improving and evolving programs,…

Machine Learning · Computer Science 2026-03-31 Yongqiang Chen , Chenxi Liu , Zhenhao Chen , Tongliang Liu , Bo Han , Kun Zhang

We propose a model for the evolutionary ecology of words as one attempt to extend evolutionary game theory and agent-based models by utilizing the rich linguistic expressions of Large Language Models (LLMs). Our model enables the emergence…

Populations and Evolution · Quantitative Biology 2025-05-12 Reiji Suzuki , Takaya Arita

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang

We introduce Learning to Self-Evolve (LSE), a reinforcement learning framework that trains large language models (LLMs) to improve their own contexts at test time. We situate LSE in the setting of test-time self-evolution, where a model…

Computation and Language · Computer Science 2026-03-20 Xiaoyin Chen , Canwen Xu , Yite Wang , Boyi Liu , Zhewei Yao , Yuxiong He

LLM-guided evolutionary search (Evolve systems) has reached state-of-the-art results on mathematical and combinatorial tasks, yet most existing systems report only the best of many runs and leave the run-to-run distribution undocumented. We…

Computation and Language · Computer Science 2026-05-29 Sixue Xing , Haoyu He , Kerui Wu , Zhuo Yang , Haozheng Luo , Tianfan Fu , Aarthy Nagarajan

Large Language Models (LLMs) exhibit strong potential in mathematical reasoning, yet their effectiveness is often limited by a shortage of high-quality queries. This limitation necessitates scaling up computational responses through…

Artificial Intelligence · Computer Science 2025-05-20 Jingyue Gao , Runji Lin , Keming Lu , Bowen Yu , Junyang Lin , Jianyu Chen

LLMs have demonstrated significant potential in quantitative finance by processing vast unstructured data to emulate human-like analytical workflows. However, current LLM-based methods primarily follow either an Asset-Centric paradigm…

Artificial Intelligence · Computer Science 2026-02-13 Taian Guo , Haiyang Shen , Junyu Luo , Zhongshi Xing , Hanchun Lian , Jinsheng Huang , Binqi Chen , Luchen Liu , Yun Ma , Ming Zhang