English
Related papers

Related papers: Meta Prompting for AI Systems

200 papers

Large language models (LLMs) have shown remarkable performance on many different Natural Language Processing (NLP) tasks. Prompt engineering plays a key role in adding more to the already existing abilities of LLMs to achieve significant…

Computation and Language · Computer Science 2024-07-25 Shubham Vatsal , Harsh Dubey

Existing debiasing techniques are typically training-based or require access to the model's internals and output distributions, so they are inaccessible to end-users looking to adapt LLM outputs for their particular needs. In this study, we…

Computation and Language · Computer Science 2024-05-20 Shaz Furniturewala , Surgan Jandial , Abhinav Java , Pragyan Banerjee , Simra Shahid , Sumit Bhatia , Kokil Jaidka

Prompting LLMs for complex tasks (e.g., building a trip advisor chatbot) needs humans to clearly articulate customized requirements (e.g., "start the response with a tl;dr"). However, existing prompt engineering instructions often lack…

Human-Computer Interaction · Computer Science 2025-04-29 Qianou Ma , Weirui Peng , Chenyang Yang , Hua Shen , Kenneth Koedinger , Tongshuang Wu

Large Language Models (LLMs) have shown great ability in solving traditional natural language tasks and elementary reasoning tasks with appropriate prompting techniques. However, their ability is still limited in solving complicated science…

Computation and Language · Computer Science 2024-04-30 Pei Chen , Boran Han , Shuai Zhang

Large language models (LLMs) transfer well to new tasks out-of-the-box simply given a natural language prompt that demonstrates how to perform the task and no additional training. Prompting is a brittle process wherein small modifications…

Computation and Language · Computer Science 2022-11-22 Simran Arora , Avanika Narayan , Mayee F. Chen , Laurel Orr , Neel Guha , Kush Bhatia , Ines Chami , Frederic Sala , Christopher Ré

The springing up of Large Language Models (LLMs) has shifted the community from single-task-orientated natural language processing (NLP) research to a holistic end-to-end multi-task learning paradigm. Along this line of research endeavors…

Computation and Language · Computer Science 2023-10-31 Yuanfeng Song , Yuanqin He , Xuefang Zhao , Hanlin Gu , Di Jiang , Haijun Yang , Lixin Fan , Qiang Yang

Large Language Models are transforming software engineering, yet prompt management in practice remains ad hoc, hindering reliability, reuse, and integration into industrial workflows. We present Prompt-with-Me, a practical solution for…

Software Engineering · Computer Science 2025-09-23 Ziyou Li , Agnia Sergeyuk , Maliheh Izadi

A popular method to adapt large language models (LLMs) to new tasks is in-context learning (ICL), which is effective but incurs high inference costs as context length grows. In this paper we propose a method to perform instruction…

Computation and Language · Computer Science 2025-11-03 Emily Xiao , Yixiao Zeng , Ada Chen , Chin-Jou Li , Amanda Bertsch , Graham Neubig

Requirements classification assigns natural language requirements to predefined classes, such as functional and non functional. Accurate classification reduces risk and improves software quality. Most existing models rely on supervised…

Software Engineering · Computer Science 2025-09-18 Manal Binkhonain , Reem Alfayaz

Large Language Models (LLMs) exhibit strong generalization capabilities to novel tasks when prompted with language instructions and in-context demos. Since this ability sensitively depends on the quality of prompts, various methods have…

Artificial Intelligence · Computer Science 2024-07-02 Ruochen Wang , Sohyun An , Minhao Cheng , Tianyi Zhou , Sung Ju Hwang , Cho-Jui Hsieh

Large Language Models (LLMs) have shown remarkable capabilities, with optimizing their input prompts playing a pivotal role in maximizing their performance. However, while LLM prompts consist of both the task-agnostic system prompts and…

Computation and Language · Computer Science 2025-10-13 Yumin Choi , Jinheon Baek , Sung Ju Hwang

This paper proposes Memory-Augmented State Machine Prompting (MASMP), a novel framework for LLM agents in real-time strategy games. Addressing key challenges like hallucinations and fragmented decision-making in existing approaches, MASMP…

Artificial Intelligence · Computer Science 2025-10-22 Runnan Qi , Yanan Ni , Lumin Jiang , Zongyuan Li , Kuihua Huang , Xian Guo

Large language models (LLMs) have achieved remarkable performance in generating human-like text and solving reasoning tasks of moderate complexity, such as question-answering and mathematical problem-solving. However, their capabilities in…

Computation and Language · Computer Science 2025-02-21 Cole Gawin , Yidan Sun , Mayank Kejriwal

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Large language models (LLMs) have demonstrated remarkable potential in natural language understanding and generation, making them valuable tools for enhancing conversational interactions. However, LLMs encounter challenges such as lacking…

Human-Computer Interaction · Computer Science 2023-11-10 Guinan Su , Yanwu Yang , Jie Guo

Prompt engineering has emerged as an integral technique for extending the strengths and abilities of Large Language Models (LLMs) to gain significant performance gains in various Natural Language Processing (NLP) tasks. This approach, which…

Computation and Language · Computer Science 2026-02-13 Munazza Zaib , Elaf Alhazmi

By conditioning on natural language instructions, large language models (LLMs) have displayed impressive capabilities as general-purpose computers. However, task performance depends significantly on the quality of the prompt used to steer…

Machine Learning · Computer Science 2023-03-13 Yongchao Zhou , Andrei Ioan Muresanu , Ziwen Han , Keiran Paster , Silviu Pitis , Harris Chan , Jimmy Ba

Recent advances in large language models (LLMs) have led to their popularity across multiple use-cases. However, prompt engineering, the process for optimally utilizing such models, remains approximation-driven and subjective. Most of the…

Computational Complexity · Computer Science 2025-04-29 Aashutosh Nema , Samaksh Gulati , Evangelos Giakoumakis , Bipana Thapaliya

Large language models (LLMs) are incredibly powerful at comprehending and generating data in the form of text, but are brittle and error-prone. There has been an advent of toolkits and recipes centered around so-called prompt…

Databases · Computer Science 2023-08-09 Aditya G. Parameswaran , Shreya Shankar , Parth Asawa , Naman Jain , Yujie Wang

In robot task planning, large language models (LLMs) have shown significant promise in generating complex and long-horizon action sequences. However, it is observed that LLMs often produce responses that sound plausible but are not…

Robotics · Computer Science 2025-03-11 Jiho Lee , Hayun Lee , Jonghyeon Kim , Kyungjae Lee , Eunwoo Kim