English
Related papers

Related papers: Context-DPO: Aligning Language Models for Context-…

200 papers

Large language models (LLMs) often exhibit Context Faithfulness Hallucinations, where outputs deviate from retrieved information due to incomplete context integration. Our analysis reveals a strong correlation between token-level…

Computation and Language · Computer Science 2025-02-26 Yanwen Huang , Yong Zhang , Ning Cheng , Zhitao Li , Shaojun Wang , Jing Xiao

For aligning large language models (LLMs), prior work has leveraged reinforcement learning via human feedback (RLHF) or variations of direct preference optimization (DPO). While DPO offers a simpler framework based on maximum likelihood…

Artificial Intelligence · Computer Science 2025-05-27 Anirudhan Badrinath , Prabhat Agarwal , Jiajing Xu

Reinforcement learning from human feedback (RLHF) has been extensively employed to align large language models with user intent. However, proximal policy optimization (PPO) based RLHF is occasionally unstable requiring significant…

Computation and Language · Computer Science 2024-04-02 Saeed Khaki , JinJin Li , Lan Ma , Liu Yang , Prathap Ramachandra

Large language models (LLMs) have demonstrated remarkable capabilities in complex reasoning and text generation. However, these models can inadvertently generate unsafe or biased responses when prompted with problematic inputs, raising…

Computation and Language · Computer Science 2024-12-03 Avinash Amballa , Durga Sandeep Saluru , Gayathri Akkinapalli , Abhishek Sureddy , Akshay Kumar Sureddy

Reinforcement Learning from Human Feedback (RLHF) is currently the most widely used method to align large language models (LLMs) with human preferences. Existing RLHF methods can be roughly categorized as either reward-based or reward-free.…

Computation and Language · Computer Science 2024-10-11 Shusheng Xu , Wei Fu , Jiaxuan Gao , Wenjie Ye , Weilin Liu , Zhiyu Mei , Guangju Wang , Chao Yu , Yi Wu

Augmenting LLMs with context leads to improved performance across many applications. Despite much research on Retrieval Augmented Generation (RAG) systems, an open question is whether errors arise because LLMs fail to utilize the context…

Computation and Language · Computer Science 2025-04-24 Hailey Joren , Jianyi Zhang , Chun-Sung Ferng , Da-Cheng Juan , Ankur Taly , Cyrus Rashtchian

Multi-modal large language models (MLLMs) are expected to support multi-turn queries of interchanging image and text modalities in production. However, the current MLLMs trained with visual-question-answering (VQA) datasets could suffer…

Computation and Language · Computer Science 2024-11-06 Shengzhi Li , Rongyu Lin , Shichao Pei

The integration of large language models (LLMs) into recommendation systems has revealed promising potential through their capacity to extract world knowledge for enhanced reasoning capabilities. However, current methodologies that adopt…

Information Retrieval · Computer Science 2025-10-17 Lingyu Mu , Hao Deng , Haibo Xing , Kaican Lin , Zhitong Zhu , Yu Zhang , Xiaoyi Zeng , Zhengxiao Liu , Zheng Lin , Jinxin Hu

The influence of contextual input on the behavior of large language models (LLMs) has prompted the development of context attribution methods that aim to quantify each context span's effect on an LLM's generations. The leave-one-out (LOO)…

Machine Learning · Computer Science 2025-03-24 Fengyuan Liu , Nikhil Kandpal , Colin Raffel

Large Language Models (LLMs) often struggle to maintain their original performance when faced with semantically coherent but task-irrelevant contextual information. Although prior studies have explored this issue using fixed-template or…

Computation and Language · Computer Science 2025-09-23 Yanbo Wang , Zixiang Xu , Yue Huang , Chujie Gao , Siyuan Wu , Jiayi Ye , Pin-Yu Chen , Xiuying Chen , Xiangliang Zhang

As large language models (LLMs) see greater use in academic and commercial settings, there is increasing interest in methods that allow language models to generate texts aligned with human preferences. In this paper, we present an initial…

Machine Learning · Computer Science 2024-06-07 Victoria Lin , Eli Ben-Michael , Louis-Philippe Morency

Large Language Models (LLMs) have revolutionized artificial intelligence with capabilities in reasoning, coding, and communication, driving innovation across industries. Their true potential depends on effective alignment to ensure correct,…

Computation and Language · Computer Science 2025-07-25 Bowen Jin , Jinsung Yoon , Zhen Qin , Ziqi Wang , Wei Xiong , Yu Meng , Jiawei Han , Sercan O. Arik

Accurate confidence estimation is essential for trustworthy large language models (LLMs) systems, as it empowers the user to determine when to trust outputs and enables reliable deployment in safety-critical applications. Current confidence…

Computation and Language · Computer Science 2026-01-28 Mingruo Yuan , Shuyi Zhang , Ben Kao

By integrating external knowledge, Retrieval-Augmented Generation (RAG) has become an effective strategy for mitigating the hallucination problems that large language models (LLMs) encounter when dealing with knowledge-intensive tasks.…

Computation and Language · Computer Science 2024-08-20 Ruizhe Zhang , Yongxin Xu , Yuzhen Xiao , Runchuan Zhu , Xinke Jiang , Xu Chu , Junfeng Zhao , Yasha Wang

Real-world forecasting requires models to integrate not only historical data but also relevant contextual information provided in textual form. While large language models (LLMs) show promise for context-aided forecasting, critical…

The Neural Contextual Reinforcement Framework introduces an innovative approach to enhancing the logical coherence and structural consistency of text generated by large language models. Leveraging reinforcement learning principles, the…

Computation and Language · Computer Science 2025-08-11 Marcus Irvin , William Cooper , Edward Hughes , Jessica Morgan , Christopher Hamilton

This paper proposes a novel approach to semantic ontology alignment using contextual descriptors. A formalization was developed that enables the integration of essential and contextual descriptors to create a comprehensive knowledge model.…

Computation and Language · Computer Science 2024-12-02 Eduard Manziuk , Oleksander Barmak , Pavlo Radiuk , Vladislav Kuznetsov , Iurii Krak , Sergiy Yakovlev

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

Computation and Language · Computer Science 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

The context window of large language models (LLMs) has been extended significantly in recent years. However, while the context length that the LLM can process has grown, the capability of the model to accurately reason over that context…

Computation and Language · Computer Science 2024-10-07 Huayang Li , Pat Verga , Priyanka Sen , Bowen Yang , Vijay Viswanathan , Patrick Lewis , Taro Watanabe , Yixuan Su

Instruction tuning is a widely used approach to improve the instruction-following ability of large language models (LLMs). Instruction-tuning datasets typically include a mixture of context-augmented and context-free examples, yet prior…

Computation and Language · Computer Science 2026-01-09 Hyunji Lee , Seunghyun Yoon , Yunjae Won , Hanseok Oh , Geewook Kim , Trung Bui , Franck Dernoncourt , Elias Stengel-Eskin , Mohit Bansal , Minjoon Seo