English
Related papers

Related papers: irace-evo: Automatic Algorithm Configuration Exten…

200 papers

Evolutionary agentic systems intensify the trade-off between computational efficiency and reasoning capability by repeatedly invoking large language models (LLMs) during inference. This setting raises a central question: how can an agent…

Computation and Language · Computer Science 2026-04-27 Pretam Ray , Pratik Prabhanjan Brahma , Zicheng Liu , Emad Barsoum

Agentic AI systems built on large language models (LLMs) offer significant potential for automating complex workflows, from software development to customer support. However, LLM agents often underperform due to suboptimal configurations;…

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time…

Artificial Intelligence · Computer Science 2026-03-17 Minhua Lin , Hanqing Lu , Zhan Shi , Bing He , Rui Mao , Zhiwei Zhang , Zongyu Wu , Xianfeng Tang , Hui Liu , Zhenwei Dai , Xiang Zhang , Suhang Wang , Benoit Dumoulin , Jian Pei

Large Language Model (LLM)-based optimization has recently shown promise for autonomous problem solving, yet most approaches still cast LLMs as passive constraint checkers rather than proactive strategy designers, limiting their…

Artificial Intelligence · Computer Science 2026-04-06 Beidan Liu , Zhengqiu Zhu , Chen Gao , Tianle Pu , Yong Zhao , Wei Qi , Quanjun Yin

Automated kernel design is critical for overcoming software ecosystem barriers in emerging hardware platforms like RISC-V. While large language models (LLMs) have shown promise for automated kernel optimization, demonstrating success in…

Software Engineering · Computer Science 2025-09-19 Siyuan Chen , Zhichao Lu , Qingfu Zhang

Large language models (LLMs) have shown remarkable performance on various tasks, but existing evaluation benchmarks are often static and insufficient to fully assess their robustness and generalization in realistic scenarios. Prior work…

Computation and Language · Computer Science 2025-07-01 JiaRu Wu , Mingwei Liu

The integration of Large Language Models (LLMs) with evolutionary computation (EC) has introduced a promising paradigm for automating the design of metaheuristic algorithms. However, existing frameworks, such as the Large Language Model…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Haoran Yin , Anna V. Kononova , Thomas Bäck , Niki van Stein

Large Language Models have recently emerged as a promising paradigm for automated heuristic design for NP-hard combinatorial optimization problems. Despite this progress, existing LLM-based methods typically rely on monolithic workflows…

Artificial Intelligence · Computer Science 2026-05-11 Yuping Yan , Jirui Han , Fei Ming , Yuanshuai Li , Yaochu Jin

Integrating Large Language Models (LLMs) and Evolutionary Computation (EC) represents a promising avenue for advancing artificial intelligence by combining powerful natural language understanding with optimization and search capabilities.…

Neural and Evolutionary Computing · Computer Science 2025-05-22 Dikshit Chauhan , Bapi Dutta , Indu Bala , Niki van Stein , Thomas Bäck , Anupam Yadav

Recent work such as AlphaEvolve has shown that combining LLM-driven optimization with evolutionary search can effectively improve programs, prompts, and algorithms across domains. In this paradigm, previously evaluated solutions are reused…

Large Language Models (LLMs) excel at code generation but remain heavily reliant on large-scale annotated solutions and verification-based supervision, which constrains scalability and hinders sustained self-improvement. Recent…

Software Engineering · Computer Science 2026-05-22 Yixu Huang , Xinglei Yu , Zhongyu Wei

We introduce ShinkaEvolve: a new open-source framework leveraging large language models (LLMs) to advance scientific discovery with state-of-the-art performance and unprecedented efficiency. Recent advances in scaling inference time compute…

Computation and Language · Computer Science 2025-09-25 Robert Tjarko Lange , Yuki Imajuku , Edoardo Cetin

The omnipresence of NP-hard combinatorial optimization problems (COPs) compels domain experts to engage in trial-and-error heuristic design. The long-standing endeavor of design automation has gained new momentum with the rise of large…

Neural and Evolutionary Computing · Computer Science 2024-10-15 Haoran Ye , Jiarui Wang , Zhiguang Cao , Federico Berto , Chuanbo Hua , Haeyeon Kim , Jinkyoo Park , Guojie Song

Automatic Heuristic Design (AHD) is an active research area due to its utility in solving complex search and NP-hard combinatorial optimization problems in the real world. The recent advancements in Large Language Models (LLMs) introduce…

Neural and Evolutionary Computing · Computer Science 2024-12-20 Pham Vu Tuan Dat , Long Doan , Huynh Thi Thanh Binh

While combining large language models (LLMs) with evolutionary algorithms (EAs) shows promise for solving complex optimization problems, current approaches typically evolve individual solutions, often incurring high LLM call costs. We…

Artificial Intelligence · Computer Science 2025-08-12 Yi Zhai , Zhiqiang Wei , Ruohan Li , Keyu Pan , Shuo Liu , Lu Zhang , Jianmin Ji , Wuyang Zhang , Yu Zhang , Yanyong Zhang

The tool-using capability of large language models (LLMs) enables them to access up-to-date external information and handle complex tasks. Current approaches to enhancing this capability primarily rely on distilling advanced models by data…

Computation and Language · Computer Science 2025-05-13 Xu Huang , Weiwen Liu , Xingshan Zeng , Yuefeng Huang , Xinlong Hao , Yuxian Wang , Yirong Zeng , Chuhan Wu , Yasheng Wang , Ruiming Tang , Defu Lian

Large Language Models (LLMs) have demonstrated great promise in generating code, especially when used inside an evolutionary computation framework to iteratively optimize the generated algorithms. However, in some cases they fail to…

Neural and Evolutionary Computing · Computer Science 2025-03-24 Niki van Stein , Anna V. Kononova , Lars Kotthoff , Thomas Bäck

Large language models hold promise as scientific assistants, yet existing agents either rely solely on algorithm evolution or on deep research in isolation, both of which face critical limitations. Pure algorithm evolution, as in…

Artificial Intelligence · Computer Science 2025-10-08 Gang Liu , Yihan Zhu , Jie Chen , Meng Jiang

Mixture of Experts (MoE) architectures have recently advanced the scalability and adaptability of large language models (LLMs) for continual multimodal learning. However, efficiently extending these models to accommodate sequential tasks…

Computation and Language · Computer Science 2025-06-26 Hengyuan Zhao , Ziqin Wang , Qixin Sun , Kaiyou Song , Yilin Li , Xiaolin Hu , Qingpei Guo , Si Liu

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard