English
Related papers

Related papers: Large Language Model-Based Benchmarking Experiment…

200 papers

We consider the protein sequence engineering problem, which aims to find protein sequences with high fitness levels, starting from a given wild-type sequence. Directed evolution has been a dominating paradigm in this field which has an…

Machine Learning · Computer Science 2025-01-20 Yinkai Wang , Jiaxing He , Yuanqi Du , Xiaohui Chen , Jianan Canal Li , Li-Ping Liu , Xiaolin Xu , Soha Hassoun

The advent of large language models (LLMs) has gained tremendous attention over the past year. Previous studies have shown the astonishing performance of LLMs not only in other tasks but also in emotion recognition in terms of accuracy,…

Computation and Language · Computer Science 2023-10-24 Liyizhe Peng , Zixing Zhang , Tao Pang , Jing Han , Huan Zhao , Hao Chen , Björn W. Schuller

Recent research explores optimization using large language models (LLMs) by either iteratively seeking next-step solutions from LLMs or directly prompting LLMs for an optimizer. However, these approaches exhibit inherent limitations,…

Optimization and Control · Mathematics 2024-03-06 Zeyuan Ma , Hongshu Guo , Jiacheng Chen , Guojun Peng , Zhiguang Cao , Yining Ma , Yue-Jiao Gong

Large Language Model (LLM) leaderboards based on benchmark rankings are regularly used to guide practitioners in model selection. Often, the published leaderboard rankings are taken at face value - we show this is a (potentially costly)…

Multiobjective evolutionary algorithms (MOEAs) are major methods for solving multiobjective optimization problems (MOPs). Many MOEAs have been proposed in the past decades, of which the search operators need a carefully handcrafted design…

Neural and Evolutionary Computing · Computer Science 2024-03-27 Fei Liu , Xi Lin , Zhenkun Wang , Shunyu Yao , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

Machine Learning · Computer Science 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

Large Language Models (LLMs) have demonstrated remarkable performance across various domains, motivating researchers to investigate their potential use in recommendation systems. However, directly applying LLMs to recommendation tasks has…

Information Retrieval · Computer Science 2024-06-21 Zhuoxi Bai , Ning Wu , Fengyu Cai , Xinyi Zhu , Yun Xiong

Recent advances in Large Language Models (LLMs) have opened new perspectives for automation in optimization. While several studies have explored how LLMs can generate or solve optimization models, far less is understood about what these…

Artificial Intelligence · Computer Science 2025-12-16 Francesca Da Ros , Luca Di Gaspero , Kevin Roitero

Large Language Models (LLMs) have already been widely adopted for automated algorithm design, demonstrating strong abilities in generating and evolving algorithms across various fields. Existing work has largely focused on examining their…

Machine Learning · Computer Science 2026-03-04 Qi Huang , Furong Ye , Ananta Shahane , Thomas Bäck , Niki van Stein

Optimization can be found in many real-life applications. Designing an effective algorithm for a specific optimization problem typically requires a tedious amount of effort from human experts with domain knowledge and algorithm design…

Neural and Evolutionary Computing · Computer Science 2023-11-28 Fei Liu , Xialiang Tong , Mingxuan Yuan , Qingfu Zhang

Large language models (LLMs) have revolutionized algorithm development, yet their application in symbolic regression, where algorithms automatically discover symbolic expressions from data, remains limited. In this paper, we propose a…

Neural and Evolutionary Computing · Computer Science 2026-04-01 Hengzhe Zhang , Qi Chen , Bing Xue , Wolfgang Banzhaf , Mengjie Zhang

Large language models (LLMs) have revolutionized natural language processing by achieving state-of-the-art performance across various tasks. Recently, their effectiveness as embedding models has gained attention, marking a paradigm shift…

Computation and Language · Computer Science 2025-07-28 Chongyang Tao , Tao Shen , Shen Gao , Junshuo Zhang , Zhen Li , Kai Hua , Wenpeng Hu , Zhengwei Tao , Shuai Ma

Large language models~(LLMs) have greatly advanced the frontiers of artificial intelligence, attaining remarkable improvement in model capacity. To assess the model performance, a typical approach is to construct evaluation benchmarks for…

Computation and Language · Computer Science 2023-11-06 Kun Zhou , Yutao Zhu , Zhipeng Chen , Wentong Chen , Wayne Xin Zhao , Xu Chen , Yankai Lin , Ji-Rong Wen , Jiawei Han

Large Language Models (LLMs) can benefit from useful experiences to improve their performance on specific tasks. However, finding helpful experiences for different LLMs is not obvious, since it is unclear what experiences suit specific…

Computation and Language · Computer Science 2025-01-09 Jitao Xu , Hongyun Zhou , Lei Shen , Conghui Zhu , Jin Huang , Yitao Duan

Recent LLM-guided evolutionary search methods have shown that iterative program mutation can discover strong algorithms, but they typically optimize each task independently, even when related tasks share reusable structure. We introduce…

Machine Learning · Computer Science 2026-05-22 Halil Alperen Gozeten , Xuechen Zhang , Emrullah Ildiz , Ege Onur Taga , Tara Javidi , Samet Oymak

This paper addresses the critical disconnect between prediction and decision quality in portfolio optimization by integrating Large Language Models (LLMs) with decision-focused learning. We demonstrate both theoretically and empirically…

Portfolio Management · Quantitative Finance 2025-02-04 Yoontae Hwang , Yaxuan Kong , Stefan Zohren , Yongjae Lee

The rapid evolution of Large Language Models (LLMs) has markedly expanded their application across diverse domains, transforming how complex problems are approached and solved. Initially conceived to predict subsequent words in texts, these…

Artificial Intelligence · Computer Science 2024-07-11 Sumedh Rasal , E. J. Hauer

Large Language Models (LLMs) have made significant strides in the field of artificial intelligence, showcasing their ability to interact with humans and influence human cognition through information dissemination. However, recent studies…

Computation and Language · Computer Science 2024-11-25 Qingquan Zhang , Qiqi Duan , Bo Yuan , Yuhui Shi , Jialin Liu

Aligning the output of Large Language Models (LLMs) with human preferences (e.g., by means of reinforcement learning with human feedback, or RLHF) is essential for ensuring their effectiveness in real-world scenarios. Despite significant…

Artificial Intelligence · Computer Science 2024-10-23 Pietro Bernardelle , Gianluca Demartini

Algorithm selection, a critical process of automated machine learning, aims to identify the most suitable algorithm for solving a specific problem prior to execution. Mainstream algorithm selection techniques heavily rely on problem…

Machine Learning · Computer Science 2024-05-17 Xingyu Wu , Yan Zhong , Jibin Wu , Bingbing Jiang , Kay Chen Tan