English
Related papers

Related papers: Multi-Objective Hierarchical Optimization with Lar…

200 papers

Large Language Models (LLMs) have recently emerged as effective surrogate models and candidate generators within global optimization frameworks for expensive blackbox functions. Despite promising results, LLM-based methods often struggle in…

Machine Learning · Computer Science 2026-01-28 Andrej Schwanke , Lyubomir Ivanov , David Salinas , Fabio Ferreira , Aaron Klein , Frank Hutter , Arber Zela

This paper explores the use of foundational large language models (LLMs) in hyperparameter optimization (HPO). Hyperparameters are critical in determining the effectiveness of machine learning models, yet their optimization often relies on…

Machine Learning · Computer Science 2024-11-12 Michael R. Zhang , Nishkrit Desai , Juhan Bae , Jonathan Lorraine , Jimmy Ba

Evolutionary algorithms excel in solving complex optimization problems, especially those with multiple objectives. However, their stochastic nature can sometimes hinder rapid convergence to the global optima, particularly in scenarios…

Neural and Evolutionary Computing · Computer Science 2024-05-10 Zeyi Wang , Songbai Liu , Jianyong Chen , Kay Chen Tan

Large Language Models (LLMs) demonstrate robust capabilities across various fields, leading to a paradigm shift in LLM-enhanced Recommender System (RS). Research to date focuses on point-wise and pair-wise recommendation paradigms, which…

Information Retrieval · Computer Science 2024-09-30 Wen-Shuo Chao , Zhi Zheng , Hengshu Zhu , Hao Liu

Large Language Models (LLMs) possess substantial reasoning capabilities and are increasingly applied to optimization tasks, particularly in synergy with evolutionary computation. However, while recent surveys have explored specific aspects…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Yisong Zhang , Ran Cheng , Guoxing Yi , Kay Chen Tan

While systems designed for solving planning tasks vastly outperform Large Language Models (LLMs) in this domain, they usually discard the rich semantic information embedded within task descriptions. In contrast, LLMs possess parametrised…

Computation and Language · Computer Science 2025-02-03 Andrey Borro , Patricia J Riddle , Michael W Barley , Michael J Witbrock

Optimization algorithms and large language models (LLMs) enhance decision-making in dynamic environments by integrating artificial intelligence with traditional techniques. LLMs, with extensive domain knowledge, facilitate intelligent…

Neural and Evolutionary Computing · Computer Science 2024-05-17 Sen Huang , Kaixiang Yang , Sheng Qi , Rui Wang

Recent advances in Large Language Models (LLMs) have opened new perspectives for automation in optimization. While several studies have explored how LLMs can generate or solve optimization models, far less is understood about what these…

Artificial Intelligence · Computer Science 2025-12-16 Francesca Da Ros , Luca Di Gaspero , Kevin Roitero

The rise of Large Language Models (LLMs) has driven progress in reasoning tasks -- from program synthesis to scientific hypothesis generation -- yet their ability to handle ranked preferences and structured algorithms in combinatorial…

Artificial Intelligence · Computer Science 2025-12-09 Hadi Hosseini , Samarth Khanna , Ronak Singh

Large Language Models (LLMs) have shown impressive abilities in many applications. When a concrete and precise answer is desired, it is important to have a quantitative estimation of the potential error rate. However, this can be…

Computation and Language · Computer Science 2024-12-20 Theodore Zhao , Mu Wei , J. Samuel Preston , Hoifung Poon

Multi-objective alignment from human feedback (MOAHF) in large language models (LLMs) is a challenging problem as human preferences are complex, multifaceted, and often conflicting. Recent works on MOAHF considered a-priori multi-objective…

Machine Learning · Computer Science 2024-12-10 Subhojyoti Mukherjee , Anusha Lalitha , Sailik Sengupta , Aniket Deshmukh , Branislav Kveton

Large language models (LLMs) can handle a wide variety of general tasks with simple prompts, without the need for task-specific training. Multimodal Large Language Models (MLLMs), built upon LLMs, have demonstrated impressive potential in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tao Yu , Yi-Fan Zhang , Chaoyou Fu , Junkang Wu , Jinda Lu , Kun Wang , Xingyu Lu , Yunhang Shen , Guibin Zhang , Dingjie Song , Yibo Yan , Tianlong Xu , Qingsong Wen , Zhang Zhang , Yan Huang , Liang Wang , Tieniu Tan

Large Language Models (LLMs) demonstrate exceptional reasoning abilities, enabling strong generalization across diverse tasks such as commonsense reasoning and instruction following. However, as LLMs scale, inference costs become…

Computation and Language · Computer Science 2025-02-06 Rhea Sanjay Sukthanker , Benedikt Staffler , Frank Hutter , Aaron Klein

The planning ability of Large Language Models (LLMs) has garnered increasing attention in recent years due to their remarkable capacity for multi-step reasoning and their ability to generalize across a wide range of domains. While some…

Artificial Intelligence · Computer Science 2025-02-19 Mohamed Aghzal , Erion Plaku , Gregory J. Stein , Ziyu Yao

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

Recent advancements in artificial intelligence have sparked interest in the parallels between large language models (LLMs) and human neural processing, particularly in language comprehension. While prior research has established…

Computation and Language · Computer Science 2024-12-10 Gavin Mischler , Yinghao Aaron Li , Stephan Bickel , Ashesh D. Mehta , Nima Mesgarani

Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical…

Information Retrieval · Computer Science 2025-04-22 Wentao Cheng , Zhida Qin , Zexue Wu , Pengzhan Zhou , Tianyu Huang

Due to the advantages of hypergraphs in modeling high-order relationships in complex systems, they have been applied to higher-order clustering, hypergraph neural networks and computer vision. These applications rely heavily on access to…

Social and Information Networks · Computer Science 2025-10-15 Bingqiao Gu , Jiale Zeng , Xingqin Qi , Dong Li

Large Language Models (LLMs) have achieved remarkable success across diverse applications, yet their deployment remains challenging due to substantial computational costs, memory requirements, and energy consumption. Recent empirical…

Machine Learning · Computer Science 2026-03-24 Kaito Tanaka , Masato Ito , Yuji Nishimura , Keisuke Matsuda , Aya Nakayama

Recent advances in reasoning with large language models (LLMs) have demonstrated strong performance on complex mathematical tasks, including combinatorial optimization. Techniques such as Chain-of-Thought and In-Context Learning have…

Artificial Intelligence · Computer Science 2025-09-17 Marylou Fauchard , Florian Carichon , Margarida Carvalho , Golnoosh Farnadi
‹ Prev 1 2 3 10 Next ›