English
Related papers

Related papers: PosterReward: Unlocking Accurate Evaluation for Hi…

200 papers

Video generation has witnessed significant advancements, yet evaluating these models remains a challenge. A comprehensive evaluation benchmark for video generation is indispensable for two reasons: 1) Existing metrics do not fully align…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Ziqi Huang , Fan Zhang , Xiaojie Xu , Yinan He , Jiashuo Yu , Ziyue Dong , Qianli Ma , Nattapol Chanpaisit , Chenyang Si , Yuming Jiang , Yaohui Wang , Xinyuan Chen , Ying-Cong Chen , Limin Wang , Dahua Lin , Yu Qiao , Ziwei Liu

Text rendering has recently emerged as one of the most challenging frontiers in visual generation, drawing significant attention from large-scale diffusion and multimodal models. However, text editing within images remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Rui Gui , Yang Wan , Haochen Han , Dongxing Mao , Fangming Liu , Min Li , Alex Jinpeng Wang

Process-level Reward Models (PRMs) are crucial for complex reasoning and decision-making tasks, where each intermediate step plays an important role in the reasoning process. Since language models are prone to various types of errors during…

Computation and Language · Computer Science 2025-07-01 Mingyang Song , Zhaochen Su , Xiaoye Qu , Jiawei Zhou , Yu Cheng

Anime video generation faces significant challenges due to the scarcity of anime data and unusual motion patterns, leading to issues such as motion distortion and flickering artifacts, which result in misalignment with human preferences.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Bingwen Zhu , Yudong Jiang , Baohan Xu , Siqian Yang , Mingyu Yin , Yidi Wu , Huyang Sun , Zuxuan Wu

The rapid evolution of Large Language Models (LLMs) has fostered diverse paradigms for automated slide generation, ranging from code-driven layouts to image-centric synthesis. However, evaluating these heterogeneous systems remains…

Computation and Language · Computer Science 2026-01-15 Yunqiao Yang , Wenbo Li , Houxing Ren , Zimu Lu , Ke Wang , Zhiyuan Huang , Zhuofan Zong , Mingjie Zhan , Hongsheng Li

This paper presents Perceptual Preference Optimization (PerPO), a perception alignment method aimed at addressing the visual discrimination challenges in generative pre-trained multimodal large language models (MLLMs). To align MLLMs with…

Artificial Intelligence · Computer Science 2025-02-10 Zining Zhu , Liang Zhao , Kangheng Lin , Jinze Yang , En Yu , Chenglong Liu , Haoran Wei , Jianjian Sun , Zheng Ge , Xiangyu Zhang

Recent agentic workflows automate professional document generation but focus narrowly on textual quality, overlooking structural and stylistic professionalism, which is equally critical for readability. This gap stems mainly from a lack of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Junpeng Liu , Yuzhong Zhao , Bowen Cao , Jiayu Ding , Yilin Jia , Tengchao Lv , Yupan Huang , Wenshan Wu , Shaohan Huang , Nan Yang , Li Dong , Lei Cui , Tao Ge , Xun Wang , Huitian Jiao , Sun Mao , FNU Kartik , Si-Qing Chen , Wai Lam , Furu Wei

Aligning large vision-language models (LVLMs) with human preferences is challenging due to the scarcity of fine-grained, high-quality, and multimodal preference data without human annotations. Existing methods relying on direct distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Muzhi Dai , Jiashuo Sun , Zhiyuan Zhao , Shixuan Liu , Rui Li , Junyu Gao , Xuelong Li

Recent years have seen impressive advances in text-to-image generation, with image generative or unified models producing high-quality images from text. Yet these models still struggle with fine-grained color controllability, often failing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Muhammad Atif Butt , Alexandra Gomez-Villa , Tao Wu , Javier Vazquez-Corral , Joost Van De Weijer , Kai Wang

Multimodal reward models (MRMs) play a crucial role in the training, inference, and evaluation of Large Vision Language Models (LVLMs) by assessing response quality. However, existing benchmarks for evaluating MRMs in the video domain…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhihong Zhang , Xiaojian Huang , Jin Xu , Zhuodong Luo , Xinzhi Wang , Jiansheng Wei , Xuejin Chen

Reward models (RMs), which are central to existing post-training methods, aim to align LLM outputs with human values by providing feedback signals during fine-tuning. However, existing RMs struggle to capture nuanced, user-specific…

Machine Learning · Computer Science 2025-08-21 Mengdi Li , Guanqiao Chen , Xufeng Zhao , Haochen Wen , Shu Yang , Di Wang

Over-aligning image generation models to a generalized aesthetic preference conflicts with user intent, particularly when "anti-aesthetic" outputs are requested for artistic or critical purposes. This adherence prioritizes…

Computers and Society · Computer Science 2026-05-13 Wenqi Marshall Guo , Qingyun Qian , Khalad Hasan , Shan Du

Reward modeling is essential for aligning large language models with human preferences, yet predominant architectures rely on a static pooling strategy to condense sequences into scalar scores. This paradigm, however, suffers from two key…

Computation and Language · Computer Science 2026-01-14 Yongliang Miao , Yangyang Liang , Mengnan Du

Personalized content filtering, such as recommender systems, has become a critical infrastructure to alleviate information overload. However, these systems merely filter existing content and are constrained by its limited diversity, making…

Information Retrieval · Computer Science 2025-02-05 Yiyan Xu , Wenjie Wang , Yang Zhang , Biao Tang , Peng Yan , Fuli Feng , Xiangnan He

Human feedback plays a critical role in learning and refining reward models for text-to-image generation, but the optimal form the feedback should take for learning an accurate reward function has not been conclusively established. This…

Can Visual Language Models (VLMs) effectively capture human visual preferences? This work addresses this question by training VLMs to think about preferences at test time, employing reinforcement learning methods inspired by DeepSeek R1 and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Alexander Gambashidze , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

Recent text-guided image editing (TIE) models have achieved remarkable progress, however, many edited results still suffer from artifacts, unintended modifications, and suboptimal aesthetics. Although several benchmarks and evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Honghua Chen , Zitong Xu , Huiyu Duan , Xinyun Zhang , Xiongkuo Min , Guangtao Zhai

Different users find different images generated for the same prompt desirable. This gives rise to personalized image generation which involves creating images aligned with an individual's visual preference. Current generative models are,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Sogand Salehi , Mahdi Shafiei , Teresa Yeo , Roman Bachmann , Amir Zamir

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

Recent image editing models have achieved remarkable progress in instruction following, multimodal understanding, and complex visual editing. However, existing benchmarks often fail to faithfully reflect human judgment, especially for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Xuehai Bai , Yang Shi , Yi-Fan Zhang , Xuanyu Zhu , Yuran Wang , Yifan Dai , Xinyu Liu , Yiyan Ji , Xiaoling Gu , Yuanxing Zhang