English
Related papers

Related papers: ShinkaEvolve: Towards Open-Ended And Sample-Effici…

200 papers

Geospatial modeling provides critical solutions for pressing global challenges such as sustainability and climate change. Existing large language model (LLM)-based algorithm discovery frameworks, such as AlphaEvolve, excel at evolving…

Artificial Intelligence · Computer Science 2025-09-29 Peng Luo , Xiayin Lou , Yu Zheng , Zhuo Zheng , Stefano Ermon

Large Language Models (LLMs) have emerged as powerful operators for evolutionary search, yet the design of efficient search scaffolds remains ad hoc. While promising, current LLM-in-the-loop systems lack a systematic approach to managing…

Recent advancements in large language models (LLMs) have significantly enhanced the ability of LLM-based systems to perform complex tasks through natural language processing and tool interaction. However, optimizing these LLM-based systems…

Computation and Language · Computer Science 2025-06-19 Peiyan Zhang , Haibo Jin , Leyang Hu , Xinnuo Li , Liying Kang , Man Luo , Yangqiu Song , Haohan Wang

Autonomous agents powered by large language models (LLMs) have the potential to significantly enhance human productivity by reasoning, using tools, and executing complex tasks in diverse environments. However, current approaches to…

Retrieval algorithms like BM25 and query likelihood with Dirichlet smoothing remain strong and efficient first-stage rankers, yet improvements have mostly relied on parameter tuning and human intuition. We investigate whether a large…

Information Retrieval · Computer Science 2026-02-20 Jinming Nian , Fangchen Li , Dae Hoon Park , Yi Fang

Recent advances in LLM-guided evolutionary computation, particularly AlphaEvolve, have demonstrated remarkable success in discovering novel mathematical constructions and solving challenging optimization problems. In this article, we…

Neural and Evolutionary Computing · Computer Science 2026-02-12 Alexey Kravatskiy , Valentin Khrulkov , Ivan Oseledets

Large language models are transforming systems research by automating the discovery of performance-critical algorithms for computer systems. Despite plausible codes generated by LLMs, producing solutions that meet the stringent correctness…

Machine Learning · Computer Science 2026-02-04 Hongyuan Su , Yu Zheng , Yong Li

Molecular discovery, when formulated as an optimization problem, presents significant computational challenges because optimization objectives can be non-differentiable. Evolutionary Algorithms (EAs), often used to optimize black-box…

We study how large language models can be used to evolve inventory policies in online, non-stationary environments. Our work is motivated by recent advances in LLM-based evolutionary search, such as AlphaEvolve, which demonstrates strong…

Machine Learning · Computer Science 2026-05-12 Chenyu Huang , Jianghao Lin , Zhengyang Tang , Bo Jiang , Ruoqing Jiang , Benyou Wang , Lai Wei

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan

Despite deep learning's success in chemistry, its impact is hindered by a lack of interpretability and an inability to resolve activity cliffs, where minor structural nuances trigger drastic property shifts. Current representation learning,…

Machine Learning · Computer Science 2026-03-26 Xiangsen Chen , Ruilong Wu , Yanyan Lan , Ting Ma , Yang Liu

LLM-guided evolutionary methods such as AlphaEvolve have proven effective in domains like math, systems research, and algorithmic discovery, but their reliance on frontier models makes each run expensive. We argue this is largely an…

Neural and Evolutionary Computing · Computer Science 2026-05-12 Temoor Tanveer

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

Computation and Language · Computer Science 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

LLM-based evolution has emerged as a promising way to improve agents by refining non-parametric artifacts, but its wall-clock cost remains a major bottleneck. We identify that this cost comes from synchronized stage execution and imbalance…

Machine Learning · Computer Science 2026-05-12 Zhengding Hu , Mingge Lu , Zhen Wang , Jixuan Ruan , Chang Chen , Zaifeng Pan , Yue Guan , Ruiyi Wang , Zhongkai Yu , Chao Zhang , Yufei Ding

The rapid advancement of large language models (LLMs) has transformed the landscape of agentic information seeking capabilities through the integration of tools such as search engines and web browsers. However, current mainstream approaches…

Computation and Language · Computer Science 2025-05-29 Dingchu Zhang , Yida Zhao , Jialong Wu , Baixuan Li , Wenbiao Yin , Liwen Zhang , Yong Jiang , Yufeng Li , Kewei Tu , Pengjun Xie , Fei Huang

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time…

Artificial Intelligence · Computer Science 2026-03-17 Minhua Lin , Hanqing Lu , Zhan Shi , Bing He , Rui Mao , Zhiwei Zhang , Zongyu Wu , Xianfeng Tang , Hui Liu , Zhenwei Dai , Xiang Zhang , Suhang Wang , Benoit Dumoulin , Jian Pei

Large Language Model (LLM)-guided evolutionary search is increasingly used for automated algorithm discovery, yet most current methods track search progress primarily through executable programs and scalar fitness. Even when…

Computation and Language · Computer Science 2026-05-11 Sichun Luo , Yi Huang , Haochen Luo , Fengyuan Liu , Guanzhi Deng , Lei Li , Qinghua Yao , Zefa Hu , Junlan Feng , Qi Liu

Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and human-AI…

Computation and Language · Computer Science 2025-09-18 Tianshi Zheng , Zheye Deng , Hong Ting Tsang , Weiqi Wang , Jiaxin Bai , Zihao Wang , Yangqiu Song

Large Language Models (LLMs) have unveiled remarkable capabilities in understanding and generating both natural language and code, but LLM reasoning is prone to hallucination and struggle with complex, novel scenarios, often getting stuck…

Neural and Evolutionary Computing · Computer Science 2025-05-12 Antonio Jimeno Yepes , Pieter Barnard

Large language models (LLMs) have already revolutionized code generation, after being pretrained on publicly available code data. However, while various methods have been proposed to augment LLMs with retrieved knowledge and enhance the…

Computation and Language · Computer Science 2023-06-06 Shuyang Jiang , Yuhao Wang , Yu Wang