English
Related papers

Related papers: FrontierOR: Benchmarking LLMs' Capacity for Effici…

200 papers

Large language models (LLMs) excel in general tasks but struggle with domain-specific ones, requiring fine-tuning with specific data. With many open-source LLMs available, selecting the best model for fine-tuning downstream tasks is…

Computation and Language · Computer Science 2025-09-05 Wei Huang , Huang Wei , Yinggui Wang

We propose LangProp, a framework for iteratively optimizing code generated by large language models (LLMs), in both supervised and reinforcement learning settings. While LLMs can generate sensible coding solutions zero-shot, they are often…

Software Engineering · Computer Science 2024-05-06 Shu Ishida , Gianluca Corrado , George Fedoseev , Hudson Yeo , Lloyd Russell , Jamie Shotton , João F. Henriques , Anthony Hu

Large language models (LLMs) are increasingly explored for their reasoning capabilities, yet their ability to perform structured, constraint-based optimization from natural language remains insufficiently understood. This study evaluates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Aasish Kumar Sharma , Julian Kunkel

Designing optimization approaches, whether heuristic or meta-heuristic, usually demands extensive manual intervention and has difficulty generalizing across diverse problem domains. The combination of Large Language Models (LLMs) and…

Neural and Evolutionary Computing · Computer Science 2024-10-29 He Yu , Jing Liu

Growing renewable penetration introduces substantial uncertainty into power system operations, necessitating frequent adaptation of dispatch objectives and constraints and challenging expertise-intensive, near-real-time modeling workflows.…

Systems and Control · Electrical Eng. & Systems 2026-05-25 Chao Shen , Zihan Guo , Xu Wan , Zhenghao Yang , Yifan Zhang , Wengi Huang , Jie Song , Zongyan Zhang , Mingyang Sun

Molecular design involves an enormous and irregular search space, where traditional optimizers such as Bayesian optimization, genetic algorithms, and generative models struggle to leverage expert knowledge or handle complex feedback.…

Machine Learning · Computer Science 2025-12-09 Nian Ran , Yue Wang , Xiaoyuan Zhang , Zhongzheng Li , Qingsong Ran , Wenhao Li , Richard Allmendinger

While Large Language Models (LLMs) demonstrate remarkable reasoning, complex optimization tasks remain challenging, requiring domain knowledge and robust implementation. However, existing benchmarks focus narrowly on Mathematical…

Computation and Language · Computer Science 2026-04-24 Xinyu Zhang , Boxuan Zhang , Yuchen Wan , Lingling Zhang , YiXing Yao , Bifan Wei , Yaqiang Wu , Jun Liu

This study introduces a benchmark framework for evaluating the financial decision-making capabilities of large language models (LLMs) through portfolio optimization problems with mathematically explicit solutions. Unlike existing financial…

Portfolio Management · Quantitative Finance 2026-05-28 Hanyong Cho , Jang Ho Kim

Large Language Models (LLMs) have emerged as coding assistants, capable of generating source code from natural language prompts. With the increasing adoption of LLMs in software development, academic research and industry based projects are…

This survey paper explores the transformative influence of frontier AI, foundation models, and Large Language Models (LLMs) in the realm of Intelligent Transportation Systems (ITS), emphasizing their integral role in advancing…

Computation and Language · Computer Science 2024-01-17 Mohamed R. Shoaib , Heba M. Emara , Jun Zhao

Optimization modeling translates real decision-making problems into mathematical optimization models and solver-executable implementations. Although language models are increasingly used to generate optimization formulations and solver…

Artificial Intelligence · Computer Science 2026-05-13 Zhong Li , Qi Huang , Yuxuan Zhu , Mohammad Mohammadi Amiri , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen , Zaiwen Wen , Lincen Yang

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields. Existing work has largely focused on examining their…

Machine Learning · Computer Science 2026-03-04 Qi Huang , Furong Ye , Ananta Shahane , Thomas Bäck , Niki van Stein

Large Language Models (LLMs) struggle to directly generate correct plans for complex multi-constraint planning problems, even with self-verification and self-critique. For example, a U.S. domestic travel planning benchmark TravelPlanner was…

Artificial Intelligence · Computer Science 2025-01-30 Yilun Hao , Yongchao Chen , Yang Zhang , Chuchu Fan

Optimization benchmarks play a fundamental role in assessing algorithm performance; however, existing artificial benchmarks often fail to capture the diversity and irregularity of real-world problem structures, while benchmarks derived from…

Neural and Evolutionary Computing · Computer Science 2026-01-26 Yuhiro Ono , Tomohiro Harada , Yukiya Miura

The rapid development of large language models (LLMs) has significantly transformed the field of artificial intelligence, demonstrating remarkable capabilities in natural language processing and moving towards multi-modal functionality.…

Competitive programming problems increasingly serve as valuable benchmarks to evaluate the coding capabilities of large language models (LLMs) due to their complexity and ease of verification. Yet, current coding benchmarks face limitations…

Artificial Intelligence · Computer Science 2025-12-23 Kaijian Zou , Aaron Xiong , Yunxiang Zhang , Frederick Zhang , Yueqi Ren , Jirong Yang , Ayoung Lee , Shitanshu Bhushan , Lu Wang

Large language models (LLMs) have achieved remarkable advancements in natural language processing, showcasing exceptional performance across various tasks. However, the expensive memory and computational requirements present significant…

Artificial Intelligence · Computer Science 2025-11-13 Ruihao Gong , Yifu Ding , Zining Wang , Chengtao Lv , Xingyu Zheng , Jinyang Du , Haotong Qin , Jinyang Guo , Michele Magno , Xianglong Liu

Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus…

Software Engineering · Computer Science 2025-03-17 Zhe Zhao , Haibin Wen , Pengkun Wang , Ye Wei , Zaixi Zhang , Xi Lin , Fei Liu , Bo An , Hui Xiong , Yang Wang , Qingfu Zhang

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan