English
Related papers

Related papers: PosterReward: Unlocking Accurate Evaluation for Hi…

200 papers

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

Reward modeling has become a cornerstone of aligning large language models (LLMs) with human preferences. Yet, when extended to subjective and open-ended domains such as role play, existing reward models exhibit severe degradation,…

Computation and Language · Computer Science 2025-12-12 Hang Ding , Qiming Feng , Dongqi Liu , Qi Zhao , Tao Yao , Shuo Wang , Dongsheng Chen , Jian Li , Zhenye Gan , Jiangning Zhang , Chengjie Wang , Yabiao Wang

Recent advancements in multimodal reward models (RMs) have significantly propelled the development of visual generation. Existing frameworks typically adopt Bradley-Terry-style preference modeling or leverage generative VLMs as judges, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Yibin Wang , Yuhang Zang , Feng Han , Jiazi Bu , Yujie Zhou , Cheng Jin , Jiaqi Wang

Reward models are used throughout the post-training of language models to capture nuanced signals from preference data and provide a training target for optimization across instruction following, reasoning, safety, and more domains. The…

Computation and Language · Computer Science 2026-04-24 Saumya Malik , Valentina Pyatkin , Sander Land , Jacob Morrison , Noah A. Smith , Hannaneh Hajishirzi , Nathan Lambert

Academic poster generation is a crucial yet challenging task in scientific communication, requiring the compression of long-context interleaved documents into a single, visually coherent page. To address this challenge, we introduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Wei Pang , Kevin Qinghong Lin , Xiangru Jian , Xi He , Philip Torr

The rapid advancement of Multimodal Large Language Models (MLLMs) has made aligning them with human preferences a critical challenge. Reward Models (RMs) are a core technology for achieving this goal, but a systematic guide for building…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yi-Fan Zhang , Haihua Yang , Huanyu Zhang , Yang Shi , Zezhou Chen , Haochen Tian , Chaoyou Fu , Haotian Wang , Kai Wu , Bo Cui , Xu Wang , Jianfei Pan , Haotian Wang , Zhang Zhang , Liang Wang

Large Language Models have demonstrated outstanding performance across various downstream tasks and have been widely applied in multiple scenarios. Human-annotated preference data is used for training to further improve LLMs' performance,…

Computation and Language · Computer Science 2025-03-06 Shimao Zhang , Xiao Liu , Xin Zhang , Junxiao Liu , Zheheng Luo , Shujian Huang , Yeyun Gong

Text design is one of the most critical procedures in poster design, as it relies heavily on the creativity and expertise of humans to design text images considering the visual harmony and text-semantic. This study introduces TextPainter, a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Yifan Gao , Jinpeng Lin , Min Zhou , Chuanbin Liu , Hongtao Xie , Tiezheng Ge , Yuning Jiang

Most reward models for visual generation reduce rich human judgments to a single unexplained score, discarding the reasoning that underlies preference. We show that teaching reward models to produce explicit, multi-dimensional critiques…

Artificial Intelligence · Computer Science 2026-04-15 Haozhe Wang , Cong Wei , Weiming Ren , Jiaming Liu , Fangzhen Lin , Wenhu Chen

3D content creation from text prompts has shown remarkable success recently. However, current text-to-3D methods often generate 3D results that do not align well with human preferences. In this paper, we present a comprehensive framework,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Junliang Ye , Fangfu Liu , Qixiu Li , Zhengyi Wang , Yikai Wang , Xinzhou Wang , Yueqi Duan , Jun Zhu

Large Language Models (LLMs) have achieved remarkable success across diverse natural language tasks, yet the reward models employed for aligning LLMs often encounter challenges of reward hacking, where the approaches predominantly rely on…

Computation and Language · Computer Science 2026-03-06 Biao Liu , Ning Xu , Junming Yang , Hao Xu , Xin Geng

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Graphic design forms the cornerstone of modern visual communication, serving as a vital medium for promoting cultural and commercial events. Recent advances have explored automating this process using Large Multimodal Models (LMMs), yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Jiazhe Wei , Ken Li , Tianyu Lao , Haofan Wang , Liang Wang , Caifeng Shan , Chenyang Si

Imaging and hyperspectral data analysis is central to progress across biology, medicine, chemistry, and physics. The core challenge lies in converting high-resolution or high-dimensional datasets into interpretable representations that…

Image and Video Processing · Electrical Eng. & Systems 2025-12-29 Kamyar Barakati , Yu Liu , Utkarsh Pratiush , Boris N. Slautin , Sergei V. Kalinin

Academic posters are vital for scholarly communication, yet their manual creation is time-consuming. However, automated academic poster generation faces significant challenges in preserving intricate scientific details and achieving…

Computation and Language · Computer Science 2025-05-26 Tao Sun , Enhao Pan , Zhengkai Yang , Kaixin Sui , Jiajun Shi , Xianfu Cheng , Tongliang Li , Wenhao Huang , Ge Zhang , Jian Yang , Zhoujun Li

In this paper, we introduce OneReward, a unified reinforcement learning framework that enhances the model's generative capabilities across multiple tasks under different evaluation criteria using only \textit{One Reward} model. By employing…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Gong , Xionghui Wang , Jie Wu , Shiyin Wang , Yitong Wang , Xinglong Wu

Recent advances in generative super-resolution (SR) have greatly improved visual realism, yet existing evaluation and optimization frameworks remain misaligned with human perception. Full-Reference and No-Reference metrics often fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Yushuai Song , Weize Quan , Weining Wang , Jiahui Sun , Jing Liu , Meng Li , Pengbin Yu , Zhentao Chen , Wei Shen , Lunxi Yuan , Dong-ming Yan

Recent approaches in personalized reward modeling have primarily focused on leveraging user interaction history to align model judgments with individual preferences. However, existing approaches largely treat user context as a static or…

Computation and Language · Computer Science 2026-04-21 Kwangwook Seo , Dongha Lee

As Multimodal Large Language Models (MLLMs) advance, multimodal agents show promise in real-world tasks like web navigation and embodied intelligence. However, due to limitations in a lack of external feedback, these agents struggle with…

Computation and Language · Computer Science 2025-06-27 Tianyi Men , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

A well-designed reward is critical for effective reinforcement learning-based policy improvement. In real-world robotics, obtaining such rewards typically requires either labor-intensive human labeling or brittle, handcrafted objectives.…

Robotics · Computer Science 2026-01-09 Tony Lee , Andrew Wagenmaker , Karl Pertsch , Percy Liang , Sergey Levine , Chelsea Finn