English
Related papers

Related papers: Structured Prompts Improve Evaluation of Language …

200 papers

Large language models excel on static benchmarks, but their ability as self-learning agents in dynamic environments remains unclear. We evaluate three prompting strategies: self-reflection, heuristic mutation, and planning across dynamic…

Artificial Intelligence · Computer Science 2025-08-12 Annie Wong , Thomas Bäck , Aske Plaat , Niki van Stein , Anna V. Kononova

It has been demonstrated that the art of prompt tuning is highly effective in efficiently extracting knowledge from pretrained foundation models, encompassing pretrained language models (PLMs), vision pretrained models, and vision-language…

Computation and Language · Computer Science 2023-05-30 Xianjun Yang , Wei Cheng , Xujiang Zhao , Wenchao Yu , Linda Petzold , Haifeng Chen

In the realm of Large Language Models (LLMs), prompt optimization is crucial for model performance. Although previous research has explored aspects like rephrasing prompt contexts, using various prompting techniques (like in-context…

Computation and Language · Computer Science 2024-11-19 Jia He , Mukund Rungta , David Koleczek , Arshdeep Sekhon , Franklin X Wang , Sadid Hasan

Travel choice analysis is crucial for understanding individual travel behavior to develop appropriate transport policies and recommendation systems in Intelligent Transportation Systems (ITS). Despite extensive research, this domain faces…

Artificial Intelligence · Computer Science 2024-06-25 Xuehao Zhai , Hanlin Tian , Lintong Li , Tianyu Zhao

Large language models are increasingly used for code generation, yet the correctness of their outputs depends not only on model capability but also on how tasks are specified. Prior studies demonstrate that small changes in natural language…

Software Engineering · Computer Science 2026-04-28 Amal AKLI , Mike PAPADAKIS , Maxime CORDY , Yves Le TRAON

Prompt engineering has emerged as an integral technique for extending the strengths and abilities of Large Language Models (LLMs) to gain significant performance gains in various Natural Language Processing (NLP) tasks. This approach, which…

Computation and Language · Computer Science 2026-02-13 Munazza Zaib , Elaf Alhazmi

Large Language Models (LLMs) have advanced Automated Heuristic Design (AHD) in combinatorial optimization (CO) in the past few years. However, existing discovery pipelines often require extensive manual trial-and-error or reliance on domain…

Neural and Evolutionary Computing · Computer Science 2026-02-19 Mingxin Yu , Ruixiao Yang , Chuchu Fan

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

LLMs have demonstrated commendable performance across diverse domains. Nevertheless, formulating high-quality prompts to instruct LLMs proficiently poses a challenge for non-AI experts. Existing research in prompt engineering suggests…

Traditional methods for evaluating the robustness of large language models (LLMs) often rely on standardized benchmarks, which can escalate costs and limit evaluations across varied domains. This paper introduces a novel framework designed…

Computation and Language · Computer Science 2024-12-03 Aihua Pei , Zehua Yang , Shunan Zhu , Ruoxi Cheng , Ju Jia

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

Computation and Language · Computer Science 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West

Large Language Models (LLMs) are central to reasoning, writing, and decision-support workflows, yet users lack consistent control over how they reason and express outputs. Conventional prompt engineering relies on verbose natural-language…

Programming Languages · Computer Science 2025-10-24 Mostapha Kalami Heris

Systematic reviews require the use of rigorously designed search strategies to ensure both comprehensive retrieval and minimization of bias. Conventional manual approaches, although methodologically systematic, are resource-intensive and…

Information Retrieval · Computer Science 2026-02-03 Fatima Nasser , Fouad Trad , Ammar Mohanna , Ghada El-Hajj Fuleihan , Ali Chehab

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch

The shift from cloud-hosted Large Language Models (LLMs) to locally deployed open-source Small Language Models (SLMs) has democratized AI-assisted coding; however, it has also decentralized the environmental footprint of AI. While prompting…

Software Engineering · Computer Science 2026-04-06 Md Afif Al Mamun , Sayan Nath , Gias Uddin , Novarun Deb

Many recent prompting strategies for large language models (LLMs) query the model multiple times sequentially -- first to produce intermediate results and then the final answer. However, using these methods, both decoder and model are…

Computation and Language · Computer Science 2023-11-10 Luca Beurer-Kellner , Mark Niklas Müller , Marc Fischer , Martin Vechev

In many real-world applications, large language models (LLMs) operate as independent agents without interaction, thereby limiting coordination. In this setting, we examine how prompt framing influences decisions in a threshold voting task…

Computation and Language · Computer Science 2026-04-08 Zice Wang , Zhenyu Zhang

Prompts have been shown to be an effective method to adapt a frozen Pretrained Language Model (PLM) to perform well on downstream tasks. Prompts can be represented by a human-engineered word sequence or by a learned continuous embedding. In…

Computation and Language · Computer Science 2023-07-06 Jonathan Pilault , Can Liu , Mohit Bansal , Markus Dreyer

Large Language Models (LLMs) have emerged as a new paradigm for multi-agent systems. However, existing research on the behaviour of LLM-based multi-agents relies on ad hoc prompts and lacks a principled policy perspective. Different from…

Artificial Intelligence · Computer Science 2026-03-11 Hongbo Bo , Jingyu Hu , Weiru Liu

Large Language Models (LLMs) have shown impressive capabilities in many scenarios, but their performance depends, in part, on the choice of prompt. Past research has focused on optimizing prompts specific to a task. However, much less…

Computation and Language · Computer Science 2026-04-07 Lechen Zhang , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens