中文
相关论文

相关论文: VisionReward: Fine-Grained Multi-Dimensional Human…

200 篇论文

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

360-degree panoramic videos have gained considerable attention in recent years due to the rapid development of head-mounted displays (HMDs) and panoramic cameras. One major problem in streaming panoramic videos is that panoramic videos are…

计算机视觉与模式识别 · 计算机科学 2022-12-21 Yuang Jiang , Konstantinos Poularakis , Diego Kiedanski , Sastry Kompella , Leandros Tassiulas

The current reward learning from human preferences could be used to resolve complex reinforcement learning (RL) tasks without access to a reward function by defining a single fixed preference between pairs of trajectory segments. However,…

人工智能 · 计算机科学 2020-12-29 Zehong Cao , KaiChiu Wong , Chin-Teng Lin

Vision-to-code tasks require models to reconstruct structured visual inputs, such as charts, tables, and SVGs, into executable or structured representations with high visual fidelity. While recent Large Vision Language Models (LVLMs)…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Ziyu Liu , Shengyuan Ding , Xinyu Fang , Xuanlang Dai , Penghui Yang , Jianze Liang , Jiaqi Wang , Kai Chen , Dahua Lin , Yuhang Zang

Human vision models are at the core of image processing. For instance, classical approaches to the problem of image quality are based on models that include knowledge about human vision. However, nowadays, deep learning approaches have…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Jorge Vila-Tomás , Pablo Hernández-Cámara , Valero Laparra , Jesús Malo

Reward finetuning has emerged as a promising approach to aligning foundation models with downstream objectives. Remarkable success has been achieved in the language domain by using reinforcement learning (RL) to maximize rewards that…

机器学习 · 计算机科学 2024-03-29 Fei Deng , Qifei Wang , Wei Wei , Matthias Grundmann , Tingbo Hou

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

人工智能 · 计算机科学 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

Reward feedback learning (ReFL) has proven effective for aligning image generation with human preferences. However, its extension to video generation faces significant challenges. Existing video reward models rely on vision-language models…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Xiaoyue Mi , Wenqing Yu , Jiesong Lian , Shibo Jie , Ruizhe Zhong , Zijun Liu , Guozhen Zhang , Zixiang Zhou , Zhiyong Xu , Yuan Zhou , Qinglin Lu , Fan Tang

In the last few years the systematic adoption of deep learning to visual generation has produced impressive results that, amongst others, definitely benefit from the massive exploration of convolutional architectures. In this paper, we…

机器学习 · 计算机科学 2020-02-10 Giuseppe Marra , Francesco Giannini , Michelangelo Diligenti , Marco Gori

Recent advances in video generation have been dominated by diffusion and flow-matching models, which produce high-quality results but remain computationally intensive and difficult to scale. In this work, we introduce VideoAR, the first…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Longbin Ji , Xiaoxiong Liu , Junyuan Shang , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

The emergence of generative models enables the creation of texts and images tailored to users' preferences. Existing personalized generative models have two critical limitations: lacking a dedicated paradigm for accurate preference…

信息检索 · 计算机科学 2026-04-23 Yuting Zhang , Ying Sun , Dazhong Shen , Ziwei Xie , Feng Liu , Changwang Zhang , Xiang Liu , Jun Wang , Hui Xiong

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Zhenyu Tang , Chaoran Feng , Yufan Deng , Jie Wu , Xiaojie Li , Rui Wang , Yunpeng Chen , Daquan Zhou

View-invariant object recognition is a challenging problem, which has attracted much attention among the psychology, neuroscience, and computer vision communities. Humans are notoriously good at it, even if some variations are presumably…

计算机视觉与模式识别 · 计算机科学 2016-09-13 Saeed Reza Kheradpisheh , Masoud Ghodrati , Mohammad Ganjtabesh , Timothée Masquelier

Can humans identify AI-generated (fake) videos and provide grounded reasons? While video generation models have advanced rapidly, a critical dimension -- whether humans can detect deepfake traces within a generated video, i.e.,…

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Evaluating instruction-guided image edits requires rewards that reflect subtle human preferences, yet current reward models typically depend on large-scale preference annotation and additional model training. This creates a data-efficiency…

Reward design in reinforcement learning and optimal control is challenging. Preference-based alignment addresses this by enabling agents to learn rewards from ranked trajectory pairs provided by humans. However, existing methods often…

机器学习 · 计算机科学 2025-05-29 Zhixian Xie , Haode Zhang , Yizhe Feng , Wanxin Jin

Personalized alignment of large language models seeks to adapt responses to individual user preferences, typically via reinforcement learning. A key challenge is obtaining accurate, user-specific reward signals in open-ended scenarios.…

计算与语言 · 计算机科学 2026-02-13 Pinyi Zhang , Ting-En Lin , Yuchuan Wu , Jingyang Chen , Zongqi Wang , Hua Yang , Ze Xu , Fei Huang , Kai Zhang , Yongbin Li

Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

Large vision-language models (LVLMs) perform outstandingly across various multimodal tasks. However, their ability to evaluate generated content remains limited, and training vision-language reward models (VLRMs) with preference data is…

计算与语言 · 计算机科学 2025-05-23 Chen-An Li , Tzu-Han Lin , Yun-Nung Chen , Hung-yi Lee