English
Related papers

Related papers: Language Model Prompt Selection via Simulation Opt…

200 papers

Interaction with Large Language Models (LLMs) is primarily carried out via prompting. A prompt is a natural language instruction designed to elicit certain behaviour or output from a model. In theory, natural language prompts enable…

Human-Computer Interaction · Computer Science 2024-03-15 Michael Desmond , Michelle Brachman

This research investigates prompt designs of evaluating generated texts using large language models (LLMs). While LLMs are increasingly used for scoring various inputs, creating effective prompts for open-ended text evaluation remains…

Computation and Language · Computer Science 2024-06-28 KuanChao Chu , Yi-Pei Chen , Hideki Nakayama

Prompt optimization aims to find the best prompt to a large language model (LLM) for a given task. LLMs have been successfully used to help find and improve prompt candidates for single-step tasks. However, realistic tasks for agents are…

Computation and Language · Computer Science 2024-10-04 Yongchao Chen , Jacob Arkin , Yilun Hao , Yang Zhang , Nicholas Roy , Chuchu Fan

Prompt engineering is crucial for achieving reliable and effective outputs from large language models (LLMs), but its design requires specialized knowledge of prompting techniques and a deep understanding of target tasks. To address this…

Computation and Language · Computer Science 2025-10-22 Yohei Ikenoue , Hitomi Tashiro , Shigeru Kuroyanagi

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

In large language models (LLM)-based recommendation systems (LLM-RSs), accurately predicting user preferences by leveraging the general knowledge of LLMs is possible without requiring extensive training data. By converting recommendation…

Information Retrieval · Computer Science 2024-12-20 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Large Language Models (LLMs) have shown impressive capabilities in many scenarios, but their performance depends, in part, on the choice of prompt. Past research has focused on optimizing prompts specific to a task. However, much less…

Computation and Language · Computer Science 2026-04-07 Lechen Zhang , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

By simply composing prompts, developers can prototype novel generative applications with Large Language Models (LLMs). To refine prototypes into products, however, developers must iteratively revise prompts by evaluating outputs to diagnose…

Human-Computer Interaction · Computer Science 2024-02-28 Tae Soo Kim , Yoonjoo Lee , Jamin Shin , Young-Ho Kim , Juho Kim

Prompt engineering is a technique that involves augmenting a large pre-trained model with task-specific hints, known as prompts, to adapt the model to new tasks. Prompts can be created manually as natural language instructions or generated…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Jindong Gu , Zhen Han , Shuo Chen , Ahmad Beirami , Bailan He , Gengyuan Zhang , Ruotong Liao , Yao Qin , Volker Tresp , Philip Torr

The rise of large language models (LLMs) has highlighted the importance of prompt engineering as a crucial technique for optimizing model outputs. While experimentation with various prompting methods, such as Few-shot, Chain-of-Thought, and…

Artificial Intelligence · Computer Science 2026-03-27 Michael Hewing , Vincent Leinhos

Large language models can perform various reasoning tasks by using chain-of-thought prompting, which guides them to find answers through step-by-step demonstrations. However, the quality of the prompts depends on the demonstrations given to…

Computation and Language · Computer Science 2023-02-02 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

Large Language Models have recently been applied to text annotation tasks from social sciences, equalling or surpassing the performance of human workers at a fraction of the cost. However, no inquiry has yet been made on the impact of…

Computation and Language · Computer Science 2025-03-11 Louis Abraham , Charles Arnal , Antoine Marie

Highly effective, task-specific prompts are often heavily engineered by experts to integrate detailed instructions and domain insights based on a deep understanding of both instincts of large language models (LLMs) and the intricacies of…

Computation and Language · Computer Science 2023-12-08 Xinyuan Wang , Chenxi Li , Zhen Wang , Fan Bai , Haotian Luo , Jiayou Zhang , Nebojsa Jojic , Eric P. Xing , Zhiting Hu

The notable gap between user-provided and model-preferred prompts poses a significant challenge for generating high-quality images with text-to-image models, compelling the need for prompt engineering. Current studies on prompt engineering…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Shiyu Wu , Mingzhen Sun , Weining Wang , Yequan Wang , Jing Liu

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Prompt engineering is a challenging and important task due to the high sensitivity of Large Language Models (LLMs) to the given prompt and the inherent ambiguity of a textual task instruction. Automatic prompt engineering is essential to…

Computation and Language · Computer Science 2024-02-06 Elad Levi , Eli Brosh , Matan Friedmann

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

Prompt quality plays a central role in controlling the behavior, reliability, and reasoning performance of large language models (LLMs), particularly for smaller open-source instruction-tuned models that depend heavily on explicit…

Computation and Language · Computer Science 2026-01-08 Prith Sharma , Austin Z. Henley

Large language models (LLMs) have shown remarkable success across a wide range of natural language generation tasks, where proper prompt designs make great impacts. While existing prompting methods are normally restricted to providing…

Computation and Language · Computer Science 2023-06-01 Bei Li , Rui Wang , Junliang Guo , Kaitao Song , Xu Tan , Hany Hassan , Arul Menezes , Tong Xiao , Jiang Bian , JingBo Zhu

Large Language Models (LLMs) have shown prominent performance in various downstream tasks and prompt engineering plays a pivotal role in optimizing LLMs' performance. This paper, not only as an overview of current prompt engineering…

Computation and Language · Computer Science 2024-09-18 Haochen Li , Jonathan Leung , Zhiqi Shen