English
Related papers

Related papers: Can LLMs Beat Classical Hyperparameter Optimizatio…

200 papers

Large language models (LLMs) have shown remarkable performance across various tasks, yet their ability to handle long-context reading remains challenging. This study explores the effectiveness of leveraging high-quality academic peer review…

Computation and Language · Computer Science 2024-11-11 Shengzhi Li , Kittipat Kampa , Rongyu Lin , Bohang Li , Shichao Pei

Evaluation of large language models for code has primarily relied on static benchmarks, including HumanEval (Chen et al., 2021), or more recently using human preferences of LLM responses. As LLMs are increasingly used as programmer…

Language models have become increasingly powerful tools for formal mathematical reasoning. However, most existing approaches rely exclusively on either large general-purpose models or smaller specialized models, each with distinct…

Artificial Intelligence · Computer Science 2025-07-22 Nicolas Wischermann , Claudio Mayrink Verdun , Gabriel Poesia , Francesco Noseda

With the advent of large language models (LLMs), there has been a great deal of interest in applying them to solve difficult programming tasks. Recent work has demonstrated their potential at program optimization, a key challenge in…

Machine Learning · Computer Science 2025-02-03 Sagnik Anupam , Alexander Shypula , Osbert Bastani

This study introduces SLLMBO, an innovative framework leveraging large language models (LLMs) for hyperparameter optimization (HPO), incorporating dynamic search space adaptability, enhanced parameter space exploitation, and a novel…

Machine Learning · Computer Science 2025-01-06 Kanan Mahammadli , Seyda Ertekin

Large Language Models (LLMs), when used in educational settings without pedagogical fine-tuning, often provide immediate answers rather than guiding students through the problem-solving process. This approach falls short of pedagogically…

Computation and Language · Computer Science 2024-10-08 Shashank Sonkar , Kangqi Ni , Sapana Chaudhary , Richard G. Baraniuk

Large language models (LLMs) have recently reshaped Automated Essay Scoring (AES), yet prior studies typically examine individual techniques in isolation, limiting understanding of their relative merits for English as a Second Language (L2)…

Computation and Language · Computer Science 2026-03-09 Minh Hoang Nguyen , Vu Hoang Pham , Xuan Thanh Huynh , Phuc Hong Mai , Vinh The Nguyen , Quang Nhut Huynh , Huy Tien Nguyen , Tung Le

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our…

Computation and Language · Computer Science 2025-02-21 Teo Susnjak , Peter Hwang , Napoleon H. Reyes , Andre L. C. Barczak , Timothy R. McIntosh , Surangika Ranathunga

Large Language Models (LLMs) are increasingly utilized in scientific research assessment, particularly in automated paper review. However, existing LLM-based review systems face significant challenges, including limited domain expertise,…

Computation and Language · Computer Science 2025-03-12 Minjun Zhu , Yixuan Weng , Linyi Yang , Yue Zhang

Motivated by the potential of large language models (LLMs) as optimizers for solving combinatorial optimization problems, this paper proposes a novel LLM-assisted optimizer (LLMO) to address adversarial robustness neural architecture search…

Neural and Evolutionary Computing · Computer Science 2024-06-11 Rui Zhong , Yang Cao , Jun Yu , Masaharu Munetomo

Translating programs between various parallel programming languages is an important problem in the high-performance computing (HPC) community. Existing tools for this problem are either too narrow in scope and/or outdated. Recent explosive…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-16 Tomer Bitan , Tal Kadosh , Erel Kaplan , Shira Meiri , Le Chen , Peter Morales , Niranjan Hasabnis , Gal Oren

Critiques are important for enhancing the performance of Large Language Models (LLMs), enabling both self-improvement and constructive feedback for others by identifying flaws and suggesting improvements. However, evaluating the critique…

Computation and Language · Computer Science 2025-01-27 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

Pre-trained large language models (LLMs) exhibit powerful capabilities for generating natural text. Evolutionary algorithms (EAs) can discover diverse solutions to complex real-world problems. Motivated by the common collective and…

Neural and Evolutionary Computing · Computer Science 2025-03-10 Chao Wang , Jiaxuan Zhao , Licheng Jiao , Lingling Li , Fang Liu , Shuyuan Yang

Query optimization is a critical task in database systems, focused on determining the most efficient way to execute a query from an enormous set of possible strategies. Traditional approaches rely on heuristic search methods and cost…

Databases · Computer Science 2025-03-11 Zhiming Yao , Haoyang Li , Jing Zhang , Cuiping Li , Hong Chen

Assessing student's answers and in particular natural language answers is a crucial challenge in the field of education. Advances in machine learning, including transformer-based models such as Large Language Models(LLMs), have led to…

Computers and Society · Computer Science 2024-01-12 Priti Oli , Rabin Banjade , Jeevan Chapagain , Vasile Rus

Text preprocessing is a fundamental component of Natural Language Processing, involving techniques such as stopword removal, stemming, and lemmatization to prepare text as input for further processing and analysis. Despite the…

Computation and Language · Computer Science 2025-10-14 Marco Braga , Gian Carlo Milanese , Gabriella Pasi

Large Language Models (LLMs) have made significant strides in various intelligent tasks but still struggle with complex action reasoning tasks that require systematic search. To address this limitation, we propose a method that bridges the…

Computation and Language · Computer Science 2025-02-05 Adam Ishay , Joohyung Lee

This paper deals with improving querying large language models (LLMs). It is well-known that without relevant contextual information, LLMs can provide poor quality responses or tend to hallucinate. Several initiatives have proposed…

Computation and Language · Computer Science 2025-07-14 Nripesh Niketan , Hadj Batatia

In software engineering, the meticulous configuration of software tools is crucial in ensuring optimal performance within intricate systems. However, the complexity inherent in selecting optimal configurations is exacerbated by the…

Software Engineering · Computer Science 2023-12-12 Jai Kannan

This study examines the potential of large language models (LLMs) to augment the academic peer review process by reliably evaluating the quality of economics research without introducing systematic bias. We conduct one of the first…

Computers and Society · Computer Science 2025-04-04 Pat Pataranutaporn , Nattavudh Powdthavee , Chayapatr Achiwaranguprok , Pattie Maes