English
Related papers

Related papers: GigaEvo: An Open Source Optimization Framework Pow…

200 papers

Many applications seek to optimize LLM outputs at test time by iteratively proposing, scoring, and refining candidates over a discrete output space. Existing methods use a calibrated scalar evaluator for the target objective to guide…

Machine Learning · Computer Science 2026-02-27 Sweta Karlekar , Carolina Zheng , Magnus Saebo , Nicolas Beltran-Velez , Shuyang Yu , John Bowlan , Michal Kucer , David Blei

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, with their performance heavily dependent on the quality of input prompts. While prompt engineering has proven effective, it typically relies on…

Neural and Evolutionary Computing · Computer Science 2025-04-17 Xavier Sécheresse , Jacques-Yves Guilbert--Ly , Antoine Villedieu de Torcy

Agentic evolution has emerged as a powerful paradigm for improving programs, workflows, and scientific solutions by iteratively generating candidates, evaluating them, and using feedback to guide future search. However, existing methods are…

Artificial Intelligence · Computer Science 2026-05-14 Jiayi Zhang , Yongfeng Gu , Jianhao Ruan , Maojia Song , Yiran Peng , Zhiguang Han , Jinyu Xiang , Zhitao Wang , Caiyin Yang , Yixi Ouyang , Bang Liu , Chenglin Wu , Yuyu Luo

Molecular design involves an enormous and irregular search space, where traditional optimizers such as Bayesian optimization, genetic algorithms, and generative models struggle to leverage expert knowledge or handle complex feedback.…

Machine Learning · Computer Science 2025-12-09 Nian Ran , Yue Wang , Xiaoyuan Zhang , Zhongzheng Li , Qingsong Ran , Wenhao Li , Richard Allmendinger

The Hybrid Genetic Optimisation framework (HYGO) is introduced to meet the pressing need for efficient and unified optimisation frameworks that support both parametric and functional learning in complex engineering problems. Evolutionary…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Isaac Robledo , Yiqing Li , Guy Y. Cornejo Maceda , Rodrigo Castellanos

Self-evolution of multimodal large language models (MLLMs) remains a critical challenge: pseudo-label-based methods suffer from progressive quality degradation as model predictions drift, while template-based methods are confined to a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yongrui Heng , Chaoya Jiang , Han Yang , Shikun Zhang , Wei Ye

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Evaluation is pivotal for refining Large Language Models (LLMs), pinpointing their capabilities, and guiding enhancements. The rapid development of LLMs calls for a lightweight and easy-to-use framework for swift evaluation deployment.…

Computation and Language · Computer Science 2024-07-23 Chaoqun He , Renjie Luo , Shengding Hu , Yuanqian Zhao , Jie Zhou , Hanghao Wu , Jiajie Zhang , Xu Han , Zhiyuan Liu , Maosong Sun

The rapid advancement of large language models (LLMs) has transformed the landscape of agentic information seeking capabilities through the integration of tools such as search engines and web browsers. However, current mainstream approaches…

Computation and Language · Computer Science 2025-05-29 Dingchu Zhang , Yida Zhao , Jialong Wu , Baixuan Li , Wenbiao Yin , Liwen Zhang , Yong Jiang , Yufeng Li , Kewei Tu , Pengjun Xie , Fei Huang

Although agentic workflows have demonstrated strong potential for solving complex tasks, existing automated generation methods remain inefficient and underperform, as they rely on predefined operator libraries and homogeneous LLM-only…

Artificial Intelligence · Computer Science 2026-03-23 Beibei Xu , Yutong Ye , Chuyun Shen , Yingbo Zhou , Cheng Chen , Mingsong Chen

The success of metaheuristic optimization methods has led to the development of a large variety of algorithm paradigms. However, no algorithm clearly dominates all its competitors on all problems. Instead, the underlying variety of…

Neural and Evolutionary Computing · Computer Science 2021-05-04 Johann Dreo , Arnaud Liefooghe , Sébastien Verel , Marc Schoenauer , Juan J. Merelo , Alexandre Quemy , Benjamin Bouvier , Jan Gmys

Benchmarking in continuous black-box optimisation is hindered by the limited structural diversity of existing test suites such as BBOB. We explore whether large language models embedded in an evolutionary loop can be used to design…

Artificial Intelligence · Computer Science 2026-01-28 Urban Skvorc , Niki van Stein , Moritz Seiler , Britta Grimme , Thomas Bäck , Heike Trautmann

Optimization algorithms are widely employed to tackle complex problems, but designing them manually is often labor-intensive and requires significant expertise. Global placement is a fundamental step in electronic design automation (EDA).…

Neural and Evolutionary Computing · Computer Science 2025-04-28 Xufeng Yao , Jiaxi Jiang , Yuxuan Zhao , Peiyu Liao , Yibo Lin , Bei Yu

LLM-powered tool-calling agents fulfill user requests by interacting with environments, querying data, and invoking tools in a multi-turn process. Yet, most existing benchmarks evaluate these systems under static environment interfaces,…

Fine-tuning large pre-trained language models with Evol-Instruct has achieved encouraging results across a wide range of tasks. However, designing effective evolving methods for instruction evolution requires substantial human expertise.…

Computation and Language · Computer Science 2024-06-04 Weihao Zeng , Can Xu , Yingxiu Zhao , Jian-Guang Lou , Weizhu Chen

Experienced users often have useful knowledge and intuition in solving real-world optimization problems. User knowledge can be formulated as inter-variable relationships to assist an optimization algorithm in finding good solutions faster.…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Abhiroop Ghosh , Kalyanmoy Deb , Erik Goodman , Ronald Averill

Recent decades have witnessed great advancements in multiobjective evolutionary algorithms (MOEAs) for multiobjective optimization problems (MOPs). However, these progressively improved MOEAs have not necessarily been equipped with scalable…

Neural and Evolutionary Computing · Computer Science 2023-02-28 Songbai Liu , Qiuzhen Lin , Jianqiang Li , Kay Chen Tan

Cooperative Co-evolution, through the decomposition of the problem space, is a primary approach for solving large-scale global optimization problems. Typically, when the subspaces are disjoint, the algorithms demonstrate significantly both…

Neural and Evolutionary Computing · Computer Science 2025-03-31 Wenjie Qiu , Hongshu Guo , Zeyuan Ma , Yue-Jiao Gong

LLM-based evolution has emerged as a promising way to improve agents by refining non-parametric artifacts, but its wall-clock cost remains a major bottleneck. We identify that this cost comes from synchronized stage execution and imbalance…

Machine Learning · Computer Science 2026-05-12 Zhengding Hu , Mingge Lu , Zhen Wang , Jixuan Ruan , Chang Chen , Zaifeng Pan , Yue Guan , Ruiyi Wang , Zhongkai Yu , Chao Zhang , Yufei Ding

Large language models (LLMs) have been widely adopted in mathematical optimization in scientific scenarios for their extensive knowledge and advanced reasoning capabilities. Existing methods mainly focus on utilizing LLMs to solve…

Optimization and Control · Mathematics 2025-03-18 Qitan Lv , Tianyu Liu , Hong Wang