中文
相关论文

相关论文: ImageReward: Learning and Evaluating Human Prefere…

200 篇论文

Generating images with a Text-to-Image model often requires multiple trials, where human users iteratively update their prompt based on feedback, namely the output image. Taking inspiration from cognitive work on reference games and…

计算与语言 · 计算机科学 2023-11-22 Shachar Don-Yehiya , Leshem Choshen , Omri Abend

Text-to-image generative models often reflect the biases of the training data, leading to unequal representations of underrepresented groups. This study investigates inclusive text-to-image generative models that generate images based on…

计算机视觉与模式识别 · 计算机科学 2023-09-12 Cheng Zhang , Xuanbai Chen , Siqi Chai , Chen Henry Wu , Dmitry Lagun , Thabo Beeler , Fernando De la Torre

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Reinforcement learning from human feedback (RLHF) has become a key factor in aligning model behavior with users' goals. However, while humans integrate multiple strategies when making decisions, current RLHF approaches often simplify this…

机器学习 · 计算机科学 2025-06-19 Mingkang Wu , Devin White , Evelyn Rose , Vernon Lawhern , Nicholas R Waytowich , Yongcan Cao

Video generation has achieved significant advances through rectified flow techniques, but issues like unsmooth motion and misalignment between videos and prompts persist. In this work, we develop a systematic pipeline that harnesses human…

Recent progress in generative models, especially in text-guided diffusion models, has enabled the production of aesthetically-pleasing imagery resembling the works of professional human artists. However, one has to carefully compose the…

人机交互 · 计算机科学 2023-06-05 Nikita Pavlichenko , Dmitry Ustalov

Re-inforcement learning from human feedback (RLHF) has been effective in the task of AI alignment. However, one of the key assumptions of RLHF is that the annotators (referred to as workers from here on out) have a homogeneous response…

人机交互 · 计算机科学 2026-01-29 Sarvesh Shashidhar , Abhishek Mishra , Madhav Kotecha

Reinforcement Learning from Human Feedback (RLHF) facilitates the alignment of large language models (LLMs) with human preferences, thereby enhancing the quality of responses generated. A critical component of RLHF is the reward model,…

人工智能 · 计算机科学 2024-06-25 Yulan Hu , Qingyang Li , Sheng Ouyang , Ge Chen , Kaihui Chen , Lijun Mei , Xucheng Ye , Fuzheng Zhang , Yong Liu

Personalization is central to human-AI interaction, yet current diffusion-based image generation systems remain largely insensitive to user diversity. Existing attempts to address this often rely on costly paired preference data or…

信息检索 · 计算机科学 2025-11-27 Gabriel Patron , Zhiwei Xu , Ishan Kapnadak , Felipe Maia Polo

Diffusion models excel at modeling complex data distributions, including those of images, proteins, and small molecules. However, in many cases, our goal is to model parts of the distribution that maximize certain properties: for example,…

Diffusion models have become a central paradigm for image and multimodal generation, yet their deployment raises persistent questions about alignment, safety, preference satisfaction, and robustness to misuse. This survey reviews recent…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Preeti Lamba , Kiran Ravish , Ankita Kushwaha , Pawan Kumar

Retweet prediction is a challenging problem in social media sites (SMS). In this paper, we study the problem of image retweet prediction in social media, which predicts the image sharing behavior that the user reposts the image tweets from…

信息检索 · 计算机科学 2018-10-25 Zhou Zhao , Hanbing Zhan , Lingtao Meng , Jun Xiao , Jun Yu , Min Yang , Fei Wu , Deng Cai

Infrared and visible image fusion (IVIF) integrates complementary modalities to enhance scene perception. Current methods predominantly focus on optimizing handcrafted losses and objective metrics, often resulting in fusion outcomes that do…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Jinyuan Liu , Xingyuan Li , Qingyun Mei , Haoyuan Xu , Zhiying Jiang , Long Ma , Risheng Liu , Xin Fan

Text-to-image diffusion models have recently emerged at the forefront of image generation, powered by very large-scale unsupervised or weakly supervised text-to-image training datasets. Due to their unsupervised training, controlling their…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Mihir Prabhudesai , Anirudh Goyal , Deepak Pathak , Katerina Fragkiadaki

Text-to-image (T2I) diffusion models have become prominent tools for generating high-fidelity images from text prompts. However, when trained on unfiltered internet data, these models can produce unsafe, incorrect, or stylistically…

计算机视觉与模式识别 · 计算机科学 2024-09-11 Rohit Jena , Ali Taghibakhshi , Sahil Jain , Gerald Shen , Nima Tajbakhsh , Arash Vahdat

Designing reward functions is a longstanding challenge in reinforcement learning (RL); it requires specialized knowledge or domain data, leading to high costs for development. To address this, we introduce Text2Reward, a data-free framework…

机器学习 · 计算机科学 2024-05-28 Tianbao Xie , Siheng Zhao , Chen Henry Wu , Yitao Liu , Qian Luo , Victor Zhong , Yanchao Yang , Tao Yu

Reinforcement learning from human feedback (RLHF) has emerged as a key technique for aligning the output of large language models (LLMs) with human preferences. To learn the reward function, most existing RLHF algorithms use the…

机器学习 · 统计学 2026-02-11 Kai Ye , Hongyi Zhou , Jin Zhu , Francesco Quinzan , Chengchun Shi

With the continuous advancement of image generation technology, advanced models such as GPT-Image-1 and Qwen-Image have achieved remarkable text-to-image consistency and world knowledge However, these models still fall short in…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Junyan Ye , Leiqi Zhu , Yuncheng Guo , Dongzhi Jiang , Zilong Huang , Yifan Zhang , Zhiyuan Yan , Haohuan Fu , Conghui He , Weijia Li

Faithful text rendering remains a persistent weakness of large text-to-image generative models, as it requires both semantic instruction following and fine-grained glyph-level structure. Prior methods often improve this ability through…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Mingxuan Cui , Jingpu Yang , Fengxian Ji , Qian Jiang , Zhecheng Shi , Jiaming Wang , Zirui Song , Fajri Koto , Xiuying Chen

While Reinforcement Learning from Human Feedback (RLHF) has become a pivotal paradigm for text-to-image generation, its application to image editing remains largely unexplored. A key bottleneck is the lack of a robust general reward model…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Hanzhong Guo , Jie Wu , Jie Liu , Yu Gao , Zilyu Ye , Linxiao Yuan , Xionghui Wang , Yizhou Yu , Weilin Huang