English
Related papers

Related papers: CausalEvolve: Towards Open-Ended Discovery with Ca…

200 papers

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

LLM-based evolution has emerged as a promising way to improve agents by refining non-parametric artifacts, but its wall-clock cost remains a major bottleneck. We identify that this cost comes from synchronized stage execution and imbalance…

Machine Learning · Computer Science 2026-05-12 Zhengding Hu , Mingge Lu , Zhen Wang , Jixuan Ruan , Chang Chen , Zaifeng Pan , Yue Guan , Ruiyi Wang , Zhongkai Yu , Chao Zhang , Yufei Ding

Revealing the underlying causal mechanisms in the real world is crucial for scientific and technological progress. Despite notable advances in recent decades, the lack of high-quality data and the reliance of traditional causal discovery…

Machine Learning · Computer Science 2026-02-17 Huaming Du , Tao Hu , Yijie Huang , Yu Zhao , Guisong Liu , Tao Gu , Gang Kou , Carl Yang

Large language models (LLMs) have shown remarkable performance on various tasks, but existing evaluation benchmarks are often static and insufficient to fully assess their robustness and generalization in realistic scenarios. Prior work…

Computation and Language · Computer Science 2025-07-01 JiaRu Wu , Mingwei Liu

Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and human-AI…

Computation and Language · Computer Science 2025-09-18 Tianshi Zheng , Zheye Deng , Hong Ting Tsang , Weiqi Wang , Jiaxin Bai , Zihao Wang , Yangqiu Song

Recent advances in LLM-guided evolutionary computation, particularly AlphaEvolve (Novikov et al., 2025; Georgiev et al., 2025), have demonstrated remarkable success in discovering novel mathematical constructions and solving challenging…

Neural and Evolutionary Computing · Computer Science 2025-11-25 Valentin Khrulkov , Andrey Galichin , Denis Bashkirov , Dmitry Vinichenko , Oleg Travkin , Roman Alferov , Andrey Kuznetsov , Ivan Oseledets

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Optimization can be found in many real-life applications. Designing an effective algorithm for a specific optimization problem typically requires a tedious amount of effort from human experts with domain knowledge and algorithm design…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Fei Liu , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

We develop a general framework to discover scientific algorithms and apply it to three problems in computational cosmology. Our code, MadEvolve, is similar to Google's AlphaEvolve, but places a stronger emphasis on free parameters and their…

Cosmology and Nongalactic Astrophysics · Physics 2026-02-19 Tianyi Li , Shihui Zang , Moritz Münchmeyer

Self-evolving large language model (LLM) agents continually improve by accumulating and reusing past experience, yet it remains unclear whether they faithfully rely on that experience to guide their behavior. We present the first systematic…

Computation and Language · Computer Science 2026-02-10 Weixiang Zhao , Yingshuo Wang , Yichen Zhang , Yang Deng , Yanyan Zhao , Wanxiang Che , Bing Qin , Ting Liu

Large Language Models (LLMs) show promise in biomedicine but lack true causal understanding, relying instead on correlations. This paper envisions causal LLM agents that integrate multimodal data (text, images, genomics, etc.) and perform…

Artificial Intelligence · Computer Science 2025-05-23 Adib Bazgir , Amir Habibdoust Lafmajani , Yuwen Zhang

Artificial intelligence offers powerful new tools for scientific discovery, but the interaction paradigms required to effectively harness these systems remain underexplored. In this paper, we present findings from a formative user study…

Artificial Intelligence · Computer Science 2026-05-08 Alex Bäuerle , Adam Connors , Alexander Novikov , Adam Zsolt Wagner , Ngân Vũ , Fernanda Viegas , Martin Wattenberg , Lucas Dixon

The advent of large language models (LLMs) has catalyzed a transformative shift in artificial intelligence, paving the way for advanced intelligent agents capable of sophisticated reasoning, robust perception, and versatile action across…

As large language models (LLMs) advance their mathematical capabilities toward the IMO level, the scarcity of challenging, high-quality problems for training and evaluation has become a significant bottleneck. Simultaneously, recent code…

Computation and Language · Computer Science 2026-03-05 Dadi Guo , Yuejin Xie , Qingyu Liu , Jiayu Liu , Zhiyuan Fan , Qihan Ren , Shuai Shao , Tianyi Zhou , Dongrui Liu , Yi R. Fung

Causal discovery seeks to uncover causal relations from data, typically represented as causal graphs, and is essential for predicting the effects of interventions. While expert knowledge is required to construct principled causal graphs,…

Artificial Intelligence · Computer Science 2026-02-19 Zihao Li , Fabrizio Russo

The discovery of symbolic solutions -- mathematical expressions, logical rules, and algorithmic structures -- is fundamental to advancing scientific and engineering progress. However, traditional methods often struggle with search…

Artificial Intelligence · Computer Science 2025-11-17 Ping Guo , Qingfu Zhang , Xi Lin

The rapid rise of Large Language Models (LLMs)-based intelligent agents underscores the need for robust, scalable evaluation frameworks. Existing methods rely on static benchmarks and labor-intensive data collection, limiting practical…

Artificial Intelligence · Computer Science 2025-08-05 Zhiwei Liu , Jielin Qiu , Shiyu Wang , Jianguo Zhang , Zuxin Liu , Roshan Ram , Haolin Chen , Weiran Yao , Shelby Heinecke , Silvio Savarese , Huan Wang , Caiming Xiong

Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and…

Artificial Intelligence · Computer Science 2026-03-18 Yulin Peng , Xinxin Zhu , Chenxing Wei , Nianbo Zeng , Leilei Wang , Ying Tiffany He , F. Richard Yu

While witnessing the exceptional success of machine learning (ML) technologies in many applications, users are starting to notice a critical shortcoming of ML: correlation is a poor substitute for causation. The conventional way to discover…

Machine Learning · Computer Science 2024-09-26 Ahmet Kapkiç , Pratanu Mandal , Shu Wan , Paras Sheth , Abhinav Gorantla , Yoonhyuk Choi , Huan Liu , K. Selçuk Candan

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse tasks but remain fundamentally static, unable to adapt their internal parameters to novel tasks, evolving knowledge domains, or dynamic interaction…