English
Related papers

Related papers: Large Scale Global Optimization by Hybrid Evolutio…

200 papers

Directly solving large-scale Integer Linear Programs (ILPs) using traditional solvers is slow due to their NP-hard nature. While recent frameworks based on Large Neighborhood Search (LNS) can accelerate the solving process, their…

Machine Learning · Computer Science 2025-09-23 Ning Xu , Junkai Zhang , Yang Wu , Huigen Ye , Hua Xu , Huiling Xu , Yifan Zhang

Large-scale problems are nonlinear problems that need metaheuristics, or global optimization algorithms. This paper reviews nature-inspired metaheuristics, then it introduces a framework named Competitive Ant Colony Optimization inspired by…

Neural and Evolutionary Computing · Computer Science 2013-12-17 M. A. El-Dosuky

Large Language Models (LLMs) have advanced Automated Heuristic Design (AHD) in combinatorial optimization (CO) in the past few years. However, existing discovery pipelines often require extensive manual trial-and-error or reliance on domain…

Neural and Evolutionary Computing · Computer Science 2026-02-19 Mingxin Yu , Ruixiao Yang , Chuchu Fan

When we manually design an evolutionary optimization algorithm, we implicitly or explicitly assume a set of target optimization problems. In the case of automated algorithm design, target optimization problems are usually explicitly shown.…

Neural and Evolutionary Computing · Computer Science 2025-03-03 Lie Meng Pang , Hisao Ishibuchi

A global optimization framework, acronymed COMBEO (Change OfMeasure Based Evolutionary Optimization), is proposed. An important aspect in the development is a set of derivative-free additive directional terms obtainable through a change of…

Methodology · Statistics 2014-11-10 Saikat Sarkar , Debasish Roy

We introduce an evolutionary stochastic-local-search (SLS) algorithm for addressing a generalized version of the so-called 1/V/D/R cutting-stock problem. Cutting-stock problems are encountered often in industrial environments and the…

Neural and Evolutionary Computing · Computer Science 2017-07-28 Georgios C. Chasparis , Michael Rossbory , Verena Haunschmid

Advances in processing capacity, coupled with the desire to tackle problems where a human subjective judgment plays an important role in determining the value of a proposed solution, has led to a dramatic rise in the number of applications…

Artificial Intelligence · Computer Science 2012-11-15 C. L. Simons , J. E. Smith

Gradient Descent (GD) approximators often fail in the solution space with multiple scales of convexities, i.e., in subspace learning and neural network scenarios. To handle that, one solution is to run GD multiple times from different…

Neural and Evolutionary Computing · Computer Science 2020-05-07 Mojtaba Moattari , Mohammad Hassan Moradi , Reza Boostani

Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize each task independently, even when related tasks share reusable structure. We introduce…

Machine Learning · Computer Science 2026-05-22 Halil Alperen Gozeten , Xuechen Zhang , Emrullah Ildiz , Ege Onur Taga , Tara Javidi , Samet Oymak

Handcrafting heuristics for solving complex optimization tasks (e.g., route planning and task allocation) is a common practice but requires extensive domain knowledge. Recently, Large Language Model (LLM)-based automatic heuristic design…

Artificial Intelligence · Computer Science 2025-02-03 Zhi Zheng , Zhuoliang Xie , Zhenkun Wang , Bryan Hooi

This paper presents a new type of hybrid model for Bayesian optimization (BO) adept at managing mixed variables, encompassing both quantitative (continuous and integer) and qualitative (categorical) types. Our proposed new hybrid models…

Machine Learning · Computer Science 2024-01-22 Hengrui Luo , Younghyun Cho , James W. Demmel , Xiaoye S. Li , Yang Liu

Meta-Black-Box Optimization (MetaBBO) is an emerging avenue within Optimization community, where algorithm design policy could be meta-learned by reinforcement learning to enhance optimization performance. So far, the reward functions in…

Machine Learning · Computer Science 2026-01-30 Zechuan Huang , Zhiguang Cao , Hongshu Guo , Yue-Jiao Gong , Zeyuan Ma

Large Language Models (LLMs) have driven substantial progress in artificial intelligence in recent years, exhibiting impressive capabilities across a wide range of tasks, including mathematical problem-solving. Inspired by the success of…

Computation and Language · Computer Science 2023-10-20 Xueliang Zhao , Xinting Huang , Wei Bi , Lingpeng Kong

While Large Language Models (LLMs) have recently shown promise in Automated Heuristic Design (AHD), existing approaches typically formulate AHD around constructive priority rules or parameterized local search guidance, thereby restricting…

Artificial Intelligence · Computer Science 2026-02-10 Baoyun Zhao , He Wang , Liang Zeng

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

A lot of search approaches have been explored for the selection of features in pattern classification domain in order to discover significant subset of the features which produces better accuracy. In this paper, we introduced a Harmony…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Supratim Das , Pawan Kumar Singh , Showmik Bhowmik , Ram Sarkar , Mita Nasipuri

Swarm optimization algorithms are widely used for feature selection before data mining and machine learning applications. The metaheuristic nature-inspired feature selection approaches are used for single-objective optimization tasks,…

Artificial Intelligence · Computer Science 2021-07-30 Hritam Basak , Mayukhmali Das , Susmita Modak

Training large language models (LLMs) increasingly relies on geographically distributed accelerators, causing prohibitive communication costs across regions and uneven utilization of heterogeneous hardware. We propose HALoS, a hierarchical…

Machine Learning · Computer Science 2025-06-06 Geon-Woo Kim , Junbo Li , Shashidhar Gandham , Omar Baldonado , Adithya Gangidi , Pavan Balaji , Zhangyang Wang , Aditya Akella

Heuristics have achieved great success in solving combinatorial optimization problems~(COPs). However, heuristics designed by humans require too much domain knowledge and testing time. Since Large Language Models~(LLMs) possess strong…

Artificial Intelligence · Computer Science 2025-06-23 Hui Wang , Xufeng Zhang , Chaoxu Mu

This paper presents innovative approaches to optimization problems, focusing on both Single-Objective Multi-Modal Optimization (SOMMOP) and Multi-Objective Optimization (MOO). In SOMMOP, we integrate chaotic evolution with niching…

Neural and Evolutionary Computing · Computer Science 2024-11-13 Xiang Meng