English
Related papers

Related papers: PromptTailor: Multi-turn Intent-Aligned Prompt Syn…

200 papers

Large Language Models (LLMs) such as GPT-4o can handle a wide range of complex tasks with the right prompt. As per token costs are reduced, the advantages of fine-tuning Small Language Models (SLMs) for real-world applications -- faster…

Machine Learning · Computer Science 2025-07-18 Orlando Marquez Ayala , Patrice Bechard , Emily Chen , Maggie Baird , Jingfei Chen

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

Computation and Language · Computer Science 2024-10-08 Ziyang Chen , Stylios Moscholios

Large Language Models (LLMs) have revolutionized various applications by generating outputs based on given prompts. However, achieving the desired output requires iterative prompt refinement. This paper presents a novel approach that draws…

Machine Learning · Computer Science 2025-01-22 Rupesh Raj Karn

Prompt-tuning has emerged as a promising method for adapting pre-trained models to downstream tasks or aligning with human preferences. Prompt learning is widely used in NLP but has limited applicability to RL due to the complex physical…

Machine Learning · Computer Science 2023-05-17 Shengchao Hu , Li Shen , Ya Zhang , Dacheng Tao

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

In large language models (LLM)-based recommendation systems (LLM-RSs), accurately predicting user preferences by leveraging the general knowledge of LLMs is possible without requiring extensive training data. By converting recommendation…

Information Retrieval · Computer Science 2024-12-20 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

The rapid advancement of generative AI has democratized access to powerful tools such as Text-to-Image models. However, to generate high-quality images, users must still craft detailed prompts specifying scene, style, and context-often…

Multiagent Systems · Computer Science 2025-09-25 Dawei Xiang , Wenyan Xu , Kexin Chu , Tianqi Ding , Zixu Shen , Yiming Zeng , Jianchang Su , Wei Zhang

Large Language Models (LLMs) have recently demonstrated impressive few-shot learning capabilities through in-context learning (ICL). However, ICL performance is highly dependent on the choice of few-shot demonstrations, making the selection…

Computation and Language · Computer Science 2025-06-03 Soumya Suvra Ghosal , Soumyabrata Pal , Koyel Mukherjee , Dinesh Manocha

While the numerous parameters in Large Language Models (LLMs) contribute to their superior performance, this massive scale makes them inefficient and memory-hungry. Thus, they are hard to deploy on commodity hardware, such as one single…

Computation and Language · Computer Science 2023-10-11 Zhaozhuo Xu , Zirui Liu , Beidi Chen , Yuxin Tang , Jue Wang , Kaixiong Zhou , Xia Hu , Anshumali Shrivastava

The effectiveness of large language models (LLMs) is closely tied to the design of prompts, making prompt optimization essential for enhancing their performance across a wide range of tasks. Many existing approaches to automating prompt…

Computation and Language · Computer Science 2025-04-08 Sarkar Snigdha Sarathi Das , Ryo Kamoi , Bo Pang , Yusen Zhang , Caiming Xiong , Rui Zhang

Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step…

Computation and Language · Computer Science 2023-08-24 Vijay Viswanathan , Chenyang Zhao , Amanda Bertsch , Tongshuang Wu , Graham Neubig

In large-scale industrial LLM systems, prompt templates often expand to thousands of tokens as teams iteratively incorporate sections such as task instructions, few-shot examples, and heuristic rules to enhance robustness and coverage. This…

Computation and Language · Computer Science 2025-10-09 Zhentao Xu , Fengyi Li , Albert Chen , Xiaofeng Wang

Despite the success of Large Multimodal Models (LMMs) in recent years, prompt design for LMMs in Multiple-Choice Question Answering (MCQA) remains poorly understood. We show that even minor variations in prompt phrasing and structure can…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Mohamed Insaf Ismithdeen , Muhammad Uzair Khattak , Salman Khan

Objective To develop soft prompt-based learning algorithms for large language models (LLMs), examine the shape of prompts, prompt-tuning using frozen/unfrozen LLMs, transfer learning, and few-shot learning abilities. Methods We developed a…

Computation and Language · Computer Science 2024-04-16 Cheng Peng , Xi Yang , Kaleb E Smith , Zehao Yu , Aokun Chen , Jiang Bian , Yonghui Wu

As large language models (LLMs) are adopted as a fundamental component of language technologies, it is crucial to accurately characterize their performance. Because choices in prompt design can strongly influence model behavior, this design…

Computation and Language · Computer Science 2024-07-03 Melanie Sclar , Yejin Choi , Yulia Tsvetkov , Alane Suhr

Transformer-based Large Language Models (LLMs) have shown exceptional language generation capabilities in response to text-based prompts. However, controlling the direction of generation via textual prompts has been challenging, especially…

Computation and Language · Computer Science 2024-04-09 Rohan Deepak Ajwani , Zining Zhu , Jonathan Rose , Frank Rudzicz

Conditional graphic layout generation, which automatically maps user constraints to high-quality layouts, has attracted widespread attention today. Although recent works have achieved promising performance, the lack of versatility and data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Jiawei Lin , Jiaqi Guo , Shizhao Sun , Zijiang James Yang , Jian-Guang Lou , Dongmei Zhang

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

In recent years, the growing interest in Large Language Models (LLMs) has significantly advanced prompt engineering, transitioning from manual design to model-based optimization. Prompts for LLMs generally comprise two components: the…

Computation and Language · Computer Science 2025-10-09 Qinhao Zhou , Xiang Xiang , Kun He , John E. Hopcroft

Large Language Models are transforming software engineering, yet prompt management in practice remains ad hoc, hindering reliability, reuse, and integration into industrial workflows. We present Prompt-with-Me, a practical solution for…

Software Engineering · Computer Science 2025-09-23 Ziyou Li , Agnia Sergeyuk , Maliheh Izadi