English
Related papers

Related papers: Task Preference Optimization: Improving Multimodal…

200 papers

Tabular data contains rich structural semantics and plays a crucial role in organizing and manipulating information. Recent methods employ Multi-modal Large Language Models (MLLMs) to address table-related tasks across various modalities of…

Computation and Language · Computer Science 2026-02-17 Haolan Wang , Zhenghao Liu , Xinze Li , Xiaocui Yang , Yu Gu , Yukun Yan , Qi Shi , Fangfang Li , Chong Chen , Ge Yu

Direct Preference Optimization (DPO) has emerged as an effective approach for mitigating hallucination in Multimodal Large Language Models (MLLMs). Although existing methods have achieved significant progress by utilizing vision-oriented…

Artificial Intelligence · Computer Science 2025-12-23 Wenqi Liu , Xuemeng Song , Jiaxi Li , Yinwei Wei , Na Zheng , Jianhua Yin , Liqiang Nie

Preference alignment has become a crucial component in enhancing the performance of Large Language Models (LLMs), yet its impact in Multimodal Large Language Models (MLLMs) remains comparatively underexplored. Similar to language models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Elmira Amirloo , Jean-Philippe Fauconnier , Christoph Roesmann , Christian Kerl , Rinu Boney , Yusu Qian , Zirui Wang , Afshin Dehghan , Yinfei Yang , Zhe Gan , Peter Grasch

Large Language Models (LLMs) have demonstrated unprecedented generative capabilities, yet their alignment with human values remains critical for ensuring helpful and harmless deployments. While Reinforcement Learning from Human Feedback…

Preference optimization has made significant progress recently, with numerous methods developed to align language models with human preferences. This paper introduces $f$-divergence Preference Optimization ($f$-PO), a novel framework that…

Computation and Language · Computer Science 2025-02-18 Jiaqi Han , Mingjian Jiang , Yuxuan Song , Stefano Ermon , Minkai Xu

Despite advances in pretraining with extended context lengths, large language models (LLMs) still face challenges in effectively utilizing real-world long-context information, primarily due to insufficient long-context alignment caused by…

Computation and Language · Computer Science 2025-10-14 Huashan Sun , Shengyi Liao , Yansen Han , Yu Bai , Yang Gao , Cheng Fu , Weizhou Shen , Fanqi Wan , Ming Yan , Ji Zhang , Fei Huang

Large Language Models (LLMs) have demonstrated remarkable proficiency in English mathematical reasoning, yet a significant performance disparity persists in multilingual contexts, largely attributed to deficiencies in language…

Computation and Language · Computer Science 2026-03-27 Xu Huang , Zhejian Lai , Zixian Huang , Jiajun Chen , Shujian Huang

The alignment of Large Language Models (LLMs) is crucial for ensuring their safety and reliability in practical applications. Direct Preference Optimization (DPO) has emerged as an efficient method that directly optimizes models using…

Computation and Language · Computer Science 2025-10-30 Jie Sun , Junkang Wu , Jiancan Wu , Zhibo Zhu , Xingyu Lu , Jun Zhou , Lintao Ma , Xiang Wang

Mathematical reasoning is a fundamental capability for large language models (LLMs), yet achieving high performance in this domain remains a significant challenge. The auto-regressive generation process often makes LLMs susceptible to…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoxuan Lou , Chaojie Wang , Bo An

Large Language Models (LLMs) have demonstrated remarkable potential in automating software development tasks. While recent advances leverage Supervised Fine-Tuning (SFT) and Direct Preference Optimization (DPO) to align models with human…

Software Engineering · Computer Science 2025-12-09 Xin Yin , Chao Ni , Xiaohu Yang

Unified multimodal pretraining has emerged as a promising paradigm for jointly modeling language and vision within a single foundation model. However, existing approaches largely rely on implicit or indirect alignment signals and remain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Shentong Mo , Sukmin Yun

As the era of large language models (LLMs) unfolds, Preference Optimization (PO) methods have become a central approach to aligning LLMs with human preferences and improving performance. We propose Maximum a Posteriori Preference…

Aligning large language models (LLMs) with human intent is critical for enhancing their performance across a variety of tasks. Standard alignment techniques, such as Direct Preference Optimization (DPO), often rely on the binary…

Computation and Language · Computer Science 2025-04-01 Yuxiang Guo , Lu Yin , Bo Jiang , Jiaqi Zhang

In the realm of large language models (LLMs), the ability of models to accurately follow instructions is paramount as more agents and applications leverage LLMs for construction, where the complexity of instructions are rapidly increasing.…

Computation and Language · Computer Science 2025-07-18 Xinghua Zhang , Haiyang Yu , Cheng Fu , Fei Huang , Yongbin Li

Lead optimization in drug discovery requires efficiently navigating vast chemical space through iterative cycles to enhance molecular properties while preserving structural similarity to the original lead compound. Despite recent advances,…

Machine Learning · Computer Science 2025-09-29 Ziqing Wang , Yibo Wen , William Pattie , Xiao Luo , Weimin Wu , Jerry Yao-Chieh Hu , Abhishek Pandey , Han Liu , Kaize Ding

Large language models (LLMs) have shown great potential in natural language processing tasks, but their application to machine translation (MT) remains challenging due to pretraining on English-centric data and the complexity of…

Computation and Language · Computer Science 2025-01-24 Guofeng Cui , Pichao Wang , Yang Liu , Zemian Ke , Zhu Liu , Vimal Bhat

Adapting Large Language Models (LLMs) for agent tasks is critical in developing language agents. Direct Preference Optimization (DPO) is a promising technique for this adaptation with the alleviation of compounding errors, offering a means…

Computation and Language · Computer Science 2025-02-25 Wentao Shi , Mengqi Yuan , Junkang Wu , Qifan Wang , Fuli Feng

Visual-Language-Action (VLA) models have demonstrated strong cross-scenario generalization capabilities in various robotic tasks through large-scale pre-training and task-specific fine-tuning. However, their training paradigm mainly relies…

Robotics · Computer Science 2025-09-30 Zengjue Chen , Runliang Niu , He Kong , Qi Wang , Qianli Xing , Zipei Fan

Alignment of large language models (LLMs) has predominantly relied on pairwise preference optimization, where annotators select the better of two responses to a prompt. While simple, this approach overlooks the opportunity to learn from…

Machine Learning · Computer Science 2026-02-11 Yuxuan Tang , Yifan Feng

Matching job descriptions (JDs) with suitable talent requires models capable of understanding not only textual similarities between JDs and candidate resumes but also contextual factors such as geographical location and academic seniority.…

Computation and Language · Computer Science 2025-03-17 Yafei Zhang , Murray Wang , Yu Wang , Xiaohui Wang