English
Related papers

Related papers: VisionReward: Fine-Grained Multi-Dimensional Human…

200 papers

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

360-degree panoramic videos have gained considerable attention in recent years due to the rapid development of head-mounted displays (HMDs) and panoramic cameras. One major problem in streaming panoramic videos is that panoramic videos are…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Yuang Jiang , Konstantinos Poularakis , Diego Kiedanski , Sastry Kompella , Leandros Tassiulas

The current reward learning from human preferences could be used to resolve complex reinforcement learning (RL) tasks without access to a reward function by defining a single fixed preference between pairs of trajectory segments. However,…

Artificial Intelligence · Computer Science 2020-12-29 Zehong Cao , KaiChiu Wong , Chin-Teng Lin

Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Ziyu Liu , Shengyuan Ding , Xinyu Fang , Xuanlang Dai , Penghui Yang , Jianze Liang , Jiaqi Wang , Kai Chen , Dahua Lin , Yuhang Zang

Human vision models are at the core of image processing. For instance, classical approaches to the problem of image quality are based on models that include knowledge about human vision. However, nowadays, deep learning approaches have…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jorge Vila-Tomás , Pablo Hernández-Cámara , Valero Laparra , Jesús Malo

Reward finetuning has emerged as a promising approach to aligning foundation models with downstream objectives. Remarkable success has been achieved in the language domain by using reinforcement learning (RL) to maximize rewards that…

Machine Learning · Computer Science 2024-03-29 Fei Deng , Qifei Wang , Wei Wei , Matthias Grundmann , Tingbo Hou

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Reward feedback learning (ReFL) has proven effective for aligning image generation with human preferences. However, its extension to video generation faces significant challenges. Existing video reward models rely on vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Xiaoyue Mi , Wenqing Yu , Jiesong Lian , Shibo Jie , Ruizhe Zhong , Zijun Liu , Guozhen Zhang , Zixiang Zhou , Zhiyong Xu , Yuan Zhou , Qinglin Lu , Fan Tang

In the last few years the systematic adoption of deep learning to visual generation has produced impressive results that, amongst others, definitely benefit from the massive exploration of convolutional architectures. In this paper, we…

Machine Learning · Computer Science 2020-02-10 Giuseppe Marra , Francesco Giannini , Michelangelo Diligenti , Marco Gori

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

Information Retrieval · Computer Science 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zhenyu Tang , Chaoran Feng , Yufan Deng , Jie Wu , Xiaojie Li , Rui Wang , Yunpeng Chen , Daquan Zhou

View-invariant object recognition is a challenging problem, which has attracted much attention among the psychology, neuroscience, and computer vision communities. Humans are notoriously good at it, even if some variations are presumably…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Saeed Reza Kheradpisheh , Masoud Ghodrati , Mohammad Ganjtabesh , Timothée Masquelier

Can humans identify AI-generated (fake) videos and provide grounded reasons? While video generation models have advanced rapidly, a critical dimension -- whether humans can detect deepfake traces within a generated video, i.e.,…

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Evaluating instruction-guided image edits requires rewards that reflect subtle human preferences, yet current reward models typically depend on large-scale preference annotation and additional model training. This creates a data-efficiency…

Reward design in reinforcement learning and optimal control is challenging. Preference-based alignment addresses this by enabling agents to learn rewards from ranked trajectory pairs provided by humans. However, existing methods often…

Machine Learning · Computer Science 2025-05-29 Zhixian Xie , Haode Zhang , Yizhe Feng , Wanxin Jin

Personalized alignment of large language models seeks to adapt responses to individual user preferences, typically via reinforcement learning. A key challenge is obtaining accurate, user-specific reward signals in open-ended scenarios.…

Computation and Language · Computer Science 2026-02-13 Pinyi Zhang , Ting-En Lin , Yuchuan Wu , Jingyang Chen , Zongqi Wang , Hua Yang , Ze Xu , Fei Huang , Kai Zhang , Yongbin Li

Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

Large vision-language models (LVLMs) perform outstandingly across various multimodal tasks. However, their ability to evaluate generated content remains limited, and training vision-language reward models (VLRMs) with preference data is…

Computation and Language · Computer Science 2025-05-23 Chen-An Li , Tzu-Han Lin , Yun-Nung Chen , Hung-yi Lee