English
Related papers

Related papers: Bi-Level Prompt Optimization for Multimodal LLM-as…

200 papers

Large Language Models (LLMs) have shown remarkable success, and their multimodal expansions (MLLMs) further unlock capabilities spanning images, videos, and other modalities beyond text. However, despite this shift, prompt optimization…

Machine Learning · Computer Science 2026-02-20 Yumin Choi , Dongki Kim , Jinheon Baek , Sung Ju Hwang

Large Language Models (LLMs) have shown impressive performance as general purpose agents, but their abilities remain highly dependent on prompts which are hand written with onerous trial-and-error effort. We propose a simple and…

Computation and Language · Computer Science 2023-10-20 Reid Pryzant , Dan Iter , Jerry Li , Yin Tat Lee , Chenguang Zhu , Michael Zeng

Large Language Models (LLMs) have achieved remarkable success across diverse tasks, largely driven by well-designed prompts. However, crafting and selecting such prompts often requires considerable human effort, significantly limiting its…

Computation and Language · Computer Science 2025-03-20 Dengyun Peng , Yuhang Zhou , Qiguang Chen , Jinhao Liu , Jingjing Chen , Libo Qin

Automatic prompt optimization is an important approach to improving the performance of large language models (LLMs). Recent research demonstrates the potential of using LLMs as prompt optimizers, which can generate improved task prompts via…

Computation and Language · Computer Science 2025-01-28 Xinyu Tang , Xiaolei Wang , Wayne Xin Zhao , Siyuan Lu , Yaliang Li , Ji-Rong Wen

Large Language Models (LLMs) are increasingly embedded in enterprise workflows, yet their performance remains highly sensitive to prompt design. Automatic Prompt Optimization (APO) seeks to mitigate this instability, but existing approaches…

Artificial Intelligence · Computer Science 2026-02-03 Wei Chen , Yanbin Fang , Shuran Fu , Fasheng Xu , Xuan Wei

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

In recent years, the use of prompts to guide the output of Large Language Models have increased dramatically. However, even the best of experts struggle to choose the correct words to stitch up a prompt for the desired task. To solve this,…

Computation and Language · Computer Science 2025-04-30 Yash Jain , Vishal Chowdhary

Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an impediment for end…

Large Language Models (LLMs) have shown significant capability across various tasks, with their real-world effectiveness often driven by prompt design. While recent research has focused on optimizing prompt content, the role of prompt…

Computation and Language · Computer Science 2025-05-22 Yuanye Liu , Jiahang Xu , Li Lyna Zhang , Qi Chen , Xuan Feng , Yang Chen , Zhongxin Guo , Yuqing Yang , Peng Cheng

Large language models (LLMs) have exhibited impressive abilities for multimodal content comprehension and reasoning with proper prompting in zero- or few-shot settings. Despite the proliferation of interactive systems developed to support…

Human-Computer Interaction · Computer Science 2024-10-01 Jianben He , Xingbo Wang , Shiyi Liu , Guande Wu , Claudio Silva , Huamin Qu

Large language models (LLMs) have achieved great success across diverse tasks, and fine-tuning is sometimes needed to further enhance generation quality. Most existing methods rely on human supervision or parameter retraining, both of which…

Computation and Language · Computer Science 2025-05-27 Zhen-Yu Zhang , Jiandong Zhang , Huaxiu Yao , Gang Niu , Masashi Sugiyama

Pre-trained vision-language models like CLIP have remarkably adapted to various downstream tasks. Nonetheless, their performance heavily depends on the specificity of the input text prompts, which requires skillful prompt template…

Machine Learning · Computer Science 2024-10-22 Yingjun Du , Wenfang Sun , Cees G. M. Snoek

The remarkable performance of Large Language Models (LLMs) highly relies on crafted prompts. However, manual prompt engineering is a laborious process, creating a core bottleneck for practical application of LLMs. This phenomenon has led to…

Computation and Language · Computer Science 2025-11-21 Qing Zhang , Bing Xu , Xudong Zhang , Yifan Shi , Yang Li , Chen Zhang , Yik Chung Wu , Ngai Wong , Yijie Chen , Hong Dai , Xiansen Chen , Mian Zhang

Prompt engineering is very important to enhance the performance of large language models (LLMs). When dealing with complex issues, prompt engineers tend to distill multiple patterns from examples and inject relevant solutions to optimize…

Computation and Language · Computer Science 2024-10-14 Sheng Yang , Yurong Wu , Yan Gao , Zineng Zhou , Bin Benjamin Zhu , Xiaodi Sun , Jian-Guang Lou , Zhiming Ding , Anbang Hu , Yuan Fang , Yunsong Li , Junyan Chen , Linjun Yang

Recent advancements in large language models (LLMs) have enabled a wide range of natural language processing (NLP) tasks to be performed through simple prompt-based interactions. Consequently, several approaches have been proposed to…

Computation and Language · Computer Science 2025-08-14 Artem Chernodub , Aman Saini , Yejin Huh , Vivek Kulkarni , Vipul Raheja

Prompt optimization (PO) provides a practical way to improve response quality when users lack the time or expertise to manually craft effective prompts. Existing methods typically rely on LLMs' self-generation ability to optimize prompts.…

Computation and Language · Computer Science 2026-01-13 Zixiao Zhu , Hanzhang Zhou , Zijian Feng , Tianjiao Li , Chua Jia Jim Deryl , Mak Lee Onn , Gee Wah Ng , Kezhi Mao

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

Direct Preference Optimization (DPO) has gained significant attention for its simplicity and computational efficiency in aligning large language models (LLMs). Recent advancements have extended DPO to multimodal scenarios, achieving strong…

Computation and Language · Computer Science 2025-05-27 Yeyuan Wang , Dehong Gao , Rujiao Long , Lei Yi , Linbo Jin , Libin Yang , Xiaoyan Cai

Large language models (LLMs) are highly sensitive to prompts, but most automatic prompt optimization (APO) methods assume access to ground-truth references (e.g., labeled validation data) that are costly to obtain. We propose the Prompt…

Computation and Language · Computer Science 2026-04-10 Yuanchen Wu , Saurabh Verma , Justin Lee , Fangzhou Xiong , Poppy Zhang , Amel Awadelkarim , Xu Chen , Yubai Yuan , Shawndra Hill

Prompt quality plays a central role in controlling the behavior, reliability, and reasoning performance of large language models (LLMs), particularly for smaller open-source instruction-tuned models that depend heavily on explicit…

Computation and Language · Computer Science 2026-01-08 Prith Sharma , Austin Z. Henley
‹ Prev 1 2 3 10 Next ›