English
Related papers

Related papers: FIPO: Free-form Instruction-oriented Prompt Optimi…

200 papers

Offline preference alignment for language models such as Direct Preference Optimization (DPO) is favored for its effectiveness and simplicity, eliminating the need for costly reinforcement learning. Various offline algorithms have been…

Machine Learning · Computer Science 2025-07-28 Junbo Li , Zhangyang Wang , Qiang Liu

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

Computation and Language · Computer Science 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien

Prompt Optimization has emerged as a crucial approach due to its capabilities in steering Large Language Models to solve various tasks. However, current works mainly rely on the random rewriting ability of LLMs, and the optimization process…

Computation and Language · Computer Science 2025-10-22 Tao Tao , Guanghui Zhu , Lang Guo , Hongyi Chen , Chunfeng Yuan , Yihua Huang

Large language models (LLMs) have shown great potential in natural language processing tasks, but their application to machine translation (MT) remains challenging due to pretraining on English-centric data and the complexity of…

Computation and Language · Computer Science 2025-01-24 Guofeng Cui , Pichao Wang , Yang Liu , Zemian Ke , Zhu Liu , Vimal Bhat

Instruction fine-tuning has conventionally been employed to adapt Large Language Models (LLMs) to a variety of tasks. Nonetheless, this technique often necessitates substantial computational resources, making it impractical for deployment…

Computation and Language · Computer Science 2024-10-08 Zhenting Qi , Xiaoyu Tan , Shaojie Shi , Chao Qu , Yinghui Xu , Yuan Qi

Automatic prompt optimization (APO) hinges on the quality of its evaluation signal, yet scoring every prompt candidate on the full training set is prohibitively expensive. Existing methods either fix a single evaluation subset before…

Artificial Intelligence · Computer Science 2026-04-14 Xiaoyu Ma , Yiwen Li , Haoyue Liu , Zhichao Wang , Ye Chen , Yongxin Guo , Xiaoying Tang

Prompt design plays a crucial role in text-to-video (T2V) generation, yet user-provided prompts are often short, unstructured, and misaligned with training data, limiting the generative potential of diffusion-based T2V models. We present…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Bingjie Gao , Qianli Ma , Xiaoxue Wu , Shuai Yang , Guanzhou Lan , Haonan Zhao , Jiaxuan Chen , Qingyang Liu , Yu Qiao , Xinyuan Chen , Yaohui Wang , Li Niu

How can Large Language Models (LLMs) be aligned with human intentions and values? A typical solution is to gather human preference on model outputs and finetune the LLMs accordingly while ensuring that updates do not deviate too far from a…

Computation and Language · Computer Science 2024-05-28 Hung Le , Quan Tran , Dung Nguyen , Kien Do , Saloni Mittal , Kelechi Ogueji , Svetha Venkatesh

As the era of large language models (LLMs) unfolds, Preference Optimization (PO) methods have become a central approach to aligning LLMs with human preferences and improving performance. We propose Maximum a Posteriori Preference…

Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks. DPO optimizes for the likelihood of generating preferred over…

Artificial Intelligence · Computer Science 2026-04-23 Darsh Kachroo , Adriana Caraeni , Arjun Prasaath Anbazhagan , Brennan Lagasse , Kevin Zhu

Preference alignment is pivotal for empowering large language models (LLMs) to generate helpful and harmless responses. However, the performance of preference alignment is highly sensitive to the prevalent noise in the preference data.…

Machine Learning · Computer Science 2024-05-29 Xize Liang , Chao Chen , Shuang Qiu , Jie Wang , Yue Wu , Zhihang Fu , Zhihao Shi , Feng Wu , Jieping Ye

Large language models (LLMs) are highly sensitive to prompts, but most automatic prompt optimization (APO) methods assume access to ground-truth references (e.g., labeled validation data) that are costly to obtain. We propose the Prompt…

Computation and Language · Computer Science 2026-04-10 Yuanchen Wu , Saurabh Verma , Justin Lee , Fangzhou Xiong , Poppy Zhang , Amel Awadelkarim , Xu Chen , Yubai Yuan , Shawndra Hill

Large Language Models (LLMs) have shown remarkable success, and their multimodal expansions (MLLMs) further unlock capabilities spanning images, videos, and other modalities beyond text. However, despite this shift, prompt optimization…

Machine Learning · Computer Science 2026-02-20 Yumin Choi , Dongki Kim , Jinheon Baek , Sung Ju Hwang

In abstractive summarization, the challenge of producing concise and accurate summaries arises from the vast amount of information contained in the source document. Consequently, although Large Language Models (LLMs) can generate fluent…

Computation and Language · Computer Science 2024-10-03 Jaepill Choi , Kyubyung Chae , Jiwoo Song , Yohan Jo , Taesup Kim

Large Vision-Language Models (LVLMs) hold immense potential for complex multimodal instruction following, yet their development is often hindered by the high cost and inconsistency of human annotation required for effective fine-tuning and…

Computation and Language · Computer Science 2025-08-19 Ruirui Gao , Emily Johnson , Bowen Tan , Yanfei Qian

Preference optimization methods typically begin training with a well-trained SFT model as a reference model. In RLHF and DPO, a regularization term is used during the preference optimization process to prevent the policy model from…

Computation and Language · Computer Science 2024-09-30 Cheolhun Jang

Integrating human feedback to align text-to-speech (TTS) system outputs with human preferences has proven to be an effective approach for enhancing the robustness of language model-based TTS systems. Current approaches primarily focus on…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-29 Jixun Yao , Yuguang Yang , Yu Pan , Yuan Feng , Ziqian Ning , Jianhao Ye , Hongbin Zhou , Lei Xie

Automated theorem proving (ATP) is one of the most challenging mathematical reasoning tasks for Large Language Models (LLMs). Most existing LLM-based ATP methods rely on supervised fine-tuning, which results in a limited alignment between…

Artificial Intelligence · Computer Science 2025-02-27 Shuming Shi , Ruobing Zuo , Gaolei He , Jianlin Wang , Chenyang Xu , Zhengfeng Yang

Vision-language models (VLMs) have made significant progress in image classification by training with large-scale paired image-text data. Their performances largely depend on the prompt quality. While recent methods show that visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Xiangyan Qu , Gaopeng Gou , Jiamin Zhuang , Jing Yu , Kun Song , Qihao Wang , Yili Li , Gang Xiong

Direct Preference Optimization (DPO) has gained significant attention for its simplicity and computational efficiency in aligning large language models (LLMs). Recent advancements have extended DPO to multimodal scenarios, achieving strong…

Computation and Language · Computer Science 2025-05-27 Yeyuan Wang , Dehong Gao , Rujiao Long , Lei Yi , Linbo Jin , Libin Yang , Xiaoyan Cai