English
Related papers

Related papers: Retrieval-Augmented Fine-Tuning With Preference Op…

200 papers

Large language models achieve state-of-the-art performance but are increasingly costly to fine-tune. Prompt tuning is a parameter-efficient fine-tuning method that addresses parameter-efficiency by learning prompt embeddings, but these…

Computation and Language · Computer Science 2026-04-14 Zijun Wu , Yongchang Hao , Lili Mou

Supervised fine-tuning (SFT) is a standard approach for adapting large language models to specialized domains, yet its application to protein sequence modeling and protein language models (PLMs) remains ad hoc. This is in part because…

Machine Learning · Computer Science 2025-12-11 Amin Tavakoli , Raswanth Murugan , Ozan Gokdemir , Arvind Ramanathan , Frances Arnold , Anima Anandkumar

Text-to-video models have made remarkable advancements through optimization on high-quality text-video pairs, where the textual prompts play a pivotal role in determining quality of output videos. However, achieving the desired output often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Yatai Ji , Jiacheng Zhang , Jie Wu , Shilong Zhang , Shoufa Chen , Chongjian GE , Peize Sun , Weifeng Chen , Wenqi Shao , Xuefeng Xiao , Weilin Huang , Ping Luo

The evolution of Text-to-video (T2V) generative models, trained on large-scale datasets, has been marked by significant progress. However, the sensitivity of T2V generative models to input prompts highlights the critical role of prompt…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Bingjie Gao , Xinyu Gao , Xiaoxue Wu , Yujie Zhou , Yu Qiao , Li Niu , Xinyuan Chen , Yaohui Wang

In the field of large language models (LLMs), aligning models with the diverse preferences of users is a critical challenge. Direct Preference Optimization (DPO) has played a key role in this area. It works by using pairs of preferences…

Computation and Language · Computer Science 2024-05-29 Yueqin Yin , Zhendong Wang , Yi Gu , Hai Huang , Weizhu Chen , Mingyuan Zhou

Language model (LM) post-training (or alignment) involves maximizing a reward function that is derived from preference annotations. Direct Preference Optimization (DPO) is a popular offline alignment method that trains a policy directly on…

Machine Learning · Computer Science 2025-03-04 Adam Fisch , Jacob Eisenstein , Vicky Zayats , Alekh Agarwal , Ahmad Beirami , Chirag Nagpal , Pete Shaw , Jonathan Berant

Direct Preference Optimisation (DPO) is effective at significantly improving the performance of large language models (LLMs) on downstream tasks such as reasoning, summarisation, and alignment. Using pairs of preferred and dispreferred…

Computation and Language · Computer Science 2024-07-04 Arka Pal , Deep Karkhanis , Samuel Dooley , Manley Roberts , Siddartha Naidu , Colin White

Visual preference alignment involves training Large Vision-Language Models (LVLMs) to predict human preferences between visual inputs. This is typically achieved by using labeled datasets of chosen/rejected pairs and employing optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ziyu Liu , Yuhang Zang , Xiaoyi Dong , Pan Zhang , Yuhang Cao , Haodong Duan , Conghui He , Yuanjun Xiong , Dahua Lin , Jiaqi Wang

Using tools by Large Language Models (LLMs) is a promising avenue to extend their reach beyond language or conversational settings. The number of tools can scale to thousands as they enable accessing sensory information, fetching updated…

Information Retrieval · Computer Science 2024-12-06 Mohammad Kachuee , Sarthak Ahuja , Vaibhav Kumar , Puyang Xu , Xiaohu Liu

Recent advances in large language models (LLMs) have significantly improved the alignment of models with general human preferences. However, a major challenge remains in adapting LLMs to individual preferences, which are not only diverse…

Computation and Language · Computer Science 2026-04-15 Shanyong Wang , Shuhang Lin , Yining Zhao , Xi Zhu , Yongfeng Zhang

Fine-tuning vision-language models (VLMs) with abundant unlabeled data recently has attracted increasing attention. Existing methods that resort to the pseudolabeling strategy would suffer from heavily incorrect hard pseudolabels when VLMs…

Machine Learning · Computer Science 2024-06-18 Jiahan Zhang , Qi Wei , Feng Liu , Lei Feng

Large Language Models (LLMs) have gained widespread popularity due to their ability to perform ad-hoc Natural Language Processing (NLP) tasks with a simple natural language prompt. Part of the appeal for LLMs is their approachability to the…

Human-Computer Interaction · Computer Science 2025-02-25 Aditi Mishra , Utkarsh Soni , Anjana Arunkumar , Jinbin Huang , Bum Chul Kwon , Chris Bryan

Direct Preference Optimization (DPO) trains a language model using human preference data, bypassing the explicit reward modeling phase of Reinforcement Learning from Human Feedback (RLHF). By iterating over sentence pairs in a preference…

Machine Learning · Computer Science 2024-10-31 Jae Hyeon Cho , Minkyung Park , Byung-Jun Lee

Supervised fine-tuning (SFT) has become a crucial step for aligning pretrained large language models (LLMs) using supervised datasets of input-output pairs. However, despite being supervised, SFT is inherently limited by its generative…

Computation and Language · Computer Science 2025-07-25 Siqi Guo , Ilgee Hong , Vicente Balmaseda , Changlong Yu , Liang Qiu , Xin Liu , Haoming Jiang , Tuo Zhao , Tianbao Yang

The significant increase in software production, driven by the acceleration of development cycles over the past two decades, has led to a steady rise in software vulnerabilities, as shown by statistics published yearly by the CVE program.…

Software Engineering · Computer Science 2025-12-11 Dyna Soumhane Ouchebara , Stéphane Dupont

Pre-trained language models (PLMs) have become a prevalent technique in deep learning for code, utilizing a two-stage pre-training and fine-tuning procedure to acquire general knowledge about code and specialize in a variety of downstream…

Software Engineering · Computer Science 2024-01-05 Martin Weyssow , Xin Zhou , Kisub Kim , David Lo , Houari Sahraoui

Direct Preference Optimization (DPO) has become a widely used training method for the instruction fine-tuning of large language models (LLMs). In this work, we explore an under-investigated aspect of DPO - its dependency on the reference…

Computation and Language · Computer Science 2024-08-23 Yixin Liu , Pengfei Liu , Arman Cohan

Fine-tuning Large Language Models (LLMs) with downstream data is often considered time-consuming and expensive. Structured pruning methods are primarily employed to improve the inference efficiency of pre-trained models. Meanwhile, they…

Computation and Language · Computer Science 2026-01-28 Wei Huang , Anda Cheng , Yinggui Wang

Large Vision-Language Models (LVLMs) typically follow a two-stage training paradigm-pretraining and supervised fine-tuning. Recently, preference optimization, derived from the language domain, has emerged as an effective post-training…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yufei Zhan , Yousong Zhu , Shurong Zheng , Hongyin Zhao , Fan Yang , Ming Tang , Jinqiao Wang

Preference optimization is widely used to align Large Language Models (LLMs) with preference feedback. However, most existing methods train on a single positive-negative pair per prompt, discarding additional supervision available in…

Computation and Language · Computer Science 2026-04-20 Jixuan Leng , Si Si , Hsiang-Fu Yu , Vinod Raman , Inderjit S. Dhillon