English
Related papers

Related papers: StoryAlign: Evaluating and Training Reward Models …

200 papers

Process Reward Models (PRMs) have emerged as a promising approach to enhance the reasoning capabilities of large language models (LLMs) by guiding their step-by-step reasoning toward a final answer. However, existing PRMs either treat each…

Machine Learning · Computer Science 2026-03-02 Zheng Zhang , Ziwei Shan , Kaitao Song , Yexin Li , Kan Ren

Data-driven storytelling is a powerful method for conveying insights by combining narrative techniques with visualizations and text. These stories integrate visual aids, such as highlighted bars and lines in charts, along with textual…

Computation and Language · Computer Science 2024-10-07 Mohammed Saidul Islam , Md Tahmid Rahman Laskar , Md Rizwan Parvez , Enamul Hoque , Shafiq Joty

Vision-language generative reward models (VL-GenRMs) play a crucial role in aligning and evaluating multimodal AI systems, yet their own evaluation remains under-explored. Current assessment methods primarily rely on AI-annotated preference…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Lei Li , Yuancheng Wei , Zhihui Xie , Xuqing Yang , Yifan Song , Peiyi Wang , Chenxin An , Tianyu Liu , Sujian Li , Bill Yuchen Lin , Lingpeng Kong , Qi Liu

Although humans inherently have diverse values, current large language model (LLM) alignment methods often assume that aligning LLMs with the general public's preferences is optimal. A major challenge in adopting a more individualized…

Computation and Language · Computer Science 2024-11-06 Seongyun Lee , Sue Hyun Park , Seungone Kim , Minjoon Seo

Preference alignment in Large Language Models (LLMs) has significantly improved their ability to adhere to human instructions and intentions. However, existing direct alignment algorithms primarily focus on relative preferences and often…

Machine Learning · Computer Science 2025-05-13 Shenao Zhang , Zhihan Liu , Boyi Liu , Yufeng Zhang , Yingxiang Yang , Yongfei Liu , Liyu Chen , Tao Sun , Zhaoran Wang

Reward models are central to large language model (LLM) post-training. However, past work has shown that they can reward spurious or undesirable attributes such as length, format, hallucinations, and sycophancy. In this work, we introduce…

Machine Learning · Computer Science 2026-02-18 Atticus Wang , Iván Arcuschin , Arthur Conmy

Large language models (LLMs) have been widely deployed across numerous fields. Reinforcement Learning from Human Feedback (RLHF) leverages reward models (RMs) as proxies for human preferences to align LLM behaviors with human values, making…

Machine Learning · Computer Science 2025-11-26 Shuyi Zhang , Wei Shi , Sihang Li , Jiayi Liao , Hengxing Cai , Xiang Wang

Large language models (LLMs) are increasingly deployed via public-facing interfaces to interact with millions of users, each with diverse preferences. Despite this, preference tuning of LLMs predominantly relies on reward models trained…

Computation and Language · Computer Science 2024-12-06 Vishakh Padmakumar , Chuanyang Jin , Hannah Rose Kirk , He He

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Reward modeling represents a long-standing challenge in reinforcement learning from human feedback (RLHF) for aligning language models. Current reward modeling is heavily contingent upon experimental feedback data with high collection…

Computation and Language · Computer Science 2026-03-25 Hao Wang , Haocheng Yang , Licheng Pan , Lei Shen , Xiaoxi Li , Yinuo Wang , Zhichao Chen , Yuan Lu , Haoxuan Li , Zhouchen Lin

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify…

Neural and Evolutionary Computing · Computer Science 2025-05-26 Rishi Hazra , Alkis Sygkounas , Andreas Persson , Amy Loutfi , Pedro Zuidberg Dos Martires

Large language models (LLMs) inevitably make mistakes when performing step-by-step mathematical reasoning. Process Reward Models (PRMs) have emerged as a promising solution by evaluating each reasoning step. However, existing PRMs typically…

Computation and Language · Computer Science 2025-03-28 Shuaijie She , Junxiao Liu , Yifeng Liu , Jiajun Chen , Xin Huang , Shujian Huang

Learning reward models from human preference datasets and subsequently optimizing language models via reinforcement learning has emerged as a fundamental paradigm for aligning LLMs with human preferences. The performance of the reward model…

Computation and Language · Computer Science 2025-06-12 Wenjie Qiu , Yi-Chen Li , Xuqin Zhang , Tianyi Zhang , Yihang Zhang , Zongzhang Zhang , Yang Yu

Human evaluation has been the gold standard for checking faithfulness in abstractive summarization. However, with a challenging source domain like narrative, multiple annotators can agree a summary is faithful, while missing details that…

Artificial Intelligence · Computer Science 2025-04-02 Melanie Subbiah , Faisal Ladhak , Akankshya Mishra , Griffin Adams , Lydia B. Chilton , Kathleen McKeown

Evaluating speech generation still relies heavily on human judgments, such as Mean Opinion Score (MOS), which are expensive, subjective, and difficult to reproduce at scale. While a few recent studies have begun to explore AudioLLM-based…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-25 Yuanyuan Wang , Dongchao Yang , Yayue Deng , Zhiyong Wu , Yiwen Guo , Helen Meng , Xixin Wu

Recent research has increasingly focused on evaluating large language models' (LLMs) alignment with diverse human values and preferences, particularly for open-ended tasks like story generation. Traditional evaluation metrics rely heavily…

Computation and Language · Computer Science 2024-10-07 Danqing Wang , Kevin Yang , Hanlin Zhu , Xiaomeng Yang , Andrew Cohen , Lei Li , Yuandong Tian

Instruction-tuned large language models (LLMs) are capable of generating stories in response to open-ended user requests, but the resulting stories tend to be limited in their diversity. Older, symbolic approaches to story generation (such…

Computation and Language · Computer Science 2024-07-23 Phoebe J. Wang , Max Kreminski

Story understanding and generation have long been a challenging task in natural language processing (NLP), especially when dealing with various levels of instruction specificity. In this paper, we propose a novel approach called "Weak to…

Computation and Language · Computer Science 2025-01-28 Yangshu Yuan , Heng Chen , Christian Ng

ChatGLM is a free-to-use AI service powered by the ChatGLM family of large language models (LLMs). In this paper, we present the ChatGLM-RLHF pipeline -- a reinforcement learning from human feedback (RLHF) system -- designed to enhance…

Computation and Language · Computer Science 2024-04-04 Zhenyu Hou , Yilin Niu , Zhengxiao Du , Xiaohan Zhang , Xiao Liu , Aohan Zeng , Qinkai Zheng , Minlie Huang , Hongning Wang , Jie Tang , Yuxiao Dong

The paradigm shift from item-centric ranking to answer-centric synthesis is redefining the role of search engines. While recent industrial progress has applied generative techniques to closed-set item ranking in e-commerce, research and…

Computation and Language · Computer Science 2026-03-12 Wei Wu , Peilun Zhou , Liyi Chen , Qimeng Wang , Chengqiang Lu , Yan Gao , Yi Wu , Yao Hu , Hui Xiong