English
Related papers

Related papers: PACE: Improving Prompt with Actor-Critic Editing f…

200 papers

Prompt engineering is critical for the development of LLM-based applications. However, it is usually done manually in a "trial and error" fashion that can be time consuming, ineffective, and sub-optimal. Even for the prompts which seemingly…

Artificial Intelligence · Computer Science 2024-06-11 Weize Kong , Spurthi Amba Hombaiah , Mingyang Zhang , Qiaozhu Mei , Michael Bendersky

Facilitated by large language models (LLMs), personalized text generation has become a rapidly growing research direction. Most existing studies focus on designing specialized models for a particular domain, or they require fine-tuning the…

Computation and Language · Computer Science 2024-02-09 Cheng Li , Mingyang Zhang , Qiaozhu Mei , Weize Kong , Michael Bendersky

Large language model (LLM) agents -- LLMs that dynamically interact with an environment over long horizons -- have become an increasingly important area of research, enabling automation in complex tasks involving tool-use, web browsing, and…

Machine Learning · Computer Science 2026-02-04 Joey Hong , Kang Liu , Zhan Ling , Jiecao Chen , Sergey Levine

Prompting serves as the major way humans interact with Large Language Models (LLM). Commercial AI systems commonly define the role of the LLM in system prompts. For example, ChatGPT uses ``You are a helpful assistant'' as part of its…

Computation and Language · Computer Science 2024-10-10 Mingqian Zheng , Jiaxin Pei , Lajanugen Logeswaran , Moontae Lee , David Jurgens

With the growing capabilities of large language models (LLMs), they are increasingly applied in areas like intelligent customer service, code generation, and knowledge management. Natural language (NL) prompts act as the ``APIs'' for…

Software Engineering · Computer Science 2025-08-12 Zhenchang Xing , Yang Liu , Zhuo Cheng , Qing Huang , Dehai Zhao , Daniel Sun , Chenhua Liu

Large Language Models (LLMs) have shown impressive capabilities in many scenarios, but their performance depends, in part, on the choice of prompt. Past research has focused on optimizing prompts specific to a task. However, much less…

Computation and Language · Computer Science 2026-04-07 Lechen Zhang , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

Warning: This paper contains examples of stereotypes and biases. Large Language Models (LLMs) exhibit considerable social biases, and various studies have tried to evaluate and mitigate these biases accurately. Previous studies use…

Computation and Language · Computer Science 2024-07-04 Rem Hida , Masahiro Kaneko , Naoaki Okazaki

The use of large language models (LLMs) in natural language processing (NLP) tasks is rapidly increasing, leading to changes in how researchers approach problems in the field. To fully utilize these models' abilities, a better understanding…

Computation and Language · Computer Science 2023-11-07 Bishal Santra , Sakya Basak , Abhinandan De , Manish Gupta , Pawan Goyal

Prompt engineering is essential for optimizing large language models (LLMs), yet the link between prompt structures and task performance remains underexplored. This work introduces an evolutionary approach that combines context-free grammar…

Computation and Language · Computer Science 2025-04-22 Gabriel Machado Santos , Rita Maria da Silva Julia , Marcelo Zanchetta do Nascimento

As large language models (LLMs) have progressed towards more human-like and human--AI communications have become prevalent, prompting has emerged as a decisive component. However, there is limited conceptual consensus on what exactly…

Computation and Language · Computer Science 2025-06-10 Do Xuan Long , Duy Dinh , Ngoc-Hai Nguyen , Kenji Kawaguchi , Nancy F. Chen , Shafiq Joty , Min-Yen Kan

Large Language Models (LLMs) have shown prominent performance in various downstream tasks and prompt engineering plays a pivotal role in optimizing LLMs' performance. This paper, not only as an overview of current prompt engineering…

Computation and Language · Computer Science 2024-09-18 Haochen Li , Jonathan Leung , Zhiqi Shen

Large Language Models (LLMs) are integral to applications such as conversational agents and content creation, where precise control over a model's personality is essential for maintaining tone, consistency, and user engagement. However,…

Computation and Language · Computer Science 2026-01-22 Seojin Hwang , Yumin Kim , Byeongjeong Kim , Donghoon Shin , Hwanhee Lee

Polite speech poses a fundamental alignment challenge for large language models (LLMs). Humans deploy a rich repertoire of linguistic strategies to balance informational and social goals -- from positive approaches that build rapport…

Computation and Language · Computer Science 2025-10-31 Haoran Zhao , Robert D. Hawkins

Today's large language models (LLMs) are capable of supporting multilingual scenarios, allowing users to interact with LLMs in their native languages. When LLMs respond to subjective questions posed by users, they are expected to align with…

Computation and Language · Computer Science 2025-11-20 Yang Liu , Masahiro Kaneko , Chenhui Chu

Recent developments in large language models (LLMs) have been impressive. However, these models sometimes show inconsistencies and problematic behavior, such as hallucinating facts, generating flawed code, or creating offensive and toxic…

Computation and Language · Computer Science 2024-02-22 Zhibin Gou , Zhihong Shao , Yeyun Gong , Yelong Shen , Yujiu Yang , Nan Duan , Weizhu Chen

Prompt engineering has made significant contributions to the era of large language models, yet its effectiveness depends on the skills of a prompt author. This paper introduces $\textit{iPrOp}$, a novel interactive prompt optimization…

Computation and Language · Computer Science 2025-06-30 Jiahui Li , Roman Klinger

Large language models (LLMs) demonstrate their promise in tackling complicated practical challenges by combining action-based policies with chain of thought (CoT) reasoning. Having high-quality prompts on hand, however, is vital to the…

Machine Learning · Computer Science 2024-03-01 Xue Yan , Yan Song , Xinyu Cui , Filippos Christianos , Haifeng Zhang , David Henry Mguni , Jun Wang

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Despite their remarkable capabilities, Large Language Models (LLMs) are found to be surprisingly sensitive to minor variations in prompts, often generating significantly divergent outputs in response to minor variations in the prompts, such…

Computation and Language · Computer Science 2024-10-07 Anwoy Chatterjee , H S V N S Kowndinya Renduchintala , Sumit Bhatia , Tanmoy Chakraborty

Prompting has become a practical method for utilizing pre-trained language models (LMs). This approach offers several advantages. It allows an LM to adapt to new tasks with minimal training and parameter updates, thus achieving efficiency…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-26 Kai-Wei Chang , Haibin Wu , Yu-Kai Wang , Yuan-Kuei Wu , Hua Shen , Wei-Cheng Tseng , Iu-thing Kang , Shang-Wen Li , Hung-yi Lee