English
Related papers

Related papers: Cycle Consistency as Reward: Learning Image-Text A…

200 papers

Matching objects across partially overlapping camera views is crucial in multi-camera systems and requires a view-invariant feature extraction network. Training such a network with cycle-consistency circumvents the need for labor-intensive…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Fedor Taggenbrock , Gertjan Burghouts , Ronald Poppe

Generative AI has significantly changed industries by enabling text-driven image generation, yet challenges remain in achieving high-resolution outputs that align with fine-grained user preferences. Consequently, multi-round interactions…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Kun Li , Jianhui Wang , Yangfan He , Xinyuan Song , Ruoyu Wang , Hongyang He , Wenxin Zhang , Jiaqi Chen , Keqin Li , Sida Li , Miao Zhang , Tianyu Shi , Xueqian Wang

Recent advances in diffusion models have led to impressive image generation capabilities, but aligning these models with human preferences remains challenging. Reward-based fine-tuning using models trained on human feedback improves…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Dmitrii Sorokin , Maksim Nakhodnov , Andrey Kuznetsov , Aibek Alanov

Visual perception entails solving a wide set of tasks, e.g., object detection, depth estimation, etc. The predictions made for multiple tasks from the same image are not independent, and therefore, are expected to be consistent. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Amir Zamir , Alexander Sax , Teresa Yeo , Oğuzhan Kar , Nikhil Cheerla , Rohan Suri , Zhangjie Cao , Jitendra Malik , Leonidas Guibas

Language models trained on large-scale corpus often generate content that is harmful, toxic, or contrary to human preferences, making their alignment with human values a critical concern. Reinforcement learning from human feedback (RLHF)…

Computation and Language · Computer Science 2023-10-26 Jixiang Hong , Quan Tu , Changyu Chen , Xing Gao , Ji Zhang , Rui Yan

Visual generative models have achieved remarkable progress in synthesizing photorealistic images and videos, yet aligning their outputs with human preferences across critical dimensions remains a persistent challenge. Though reinforcement…

Consistent image generation requires faithfully preserving identities, styles, and logical coherence across multiple images, which is essential for applications such as storytelling and character design. Supervised training approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Changliang Xia , Xin Shen , Zhuohang Dang , Hangwei Qian

Recently, we have witnessed great progress in image editing with natural language instructions. Several closed-source models like GPT-Image-1, Seedream, and Google-Nano-Banana have shown highly promising progress. However, the open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Keming Wu , Sicong Jiang , Max Ku , Ping Nie , Minghao Liu , Wenhu Chen

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

3D content creation from text prompts has shown remarkable success recently. However, current text-to-3D methods often generate 3D results that do not align well with human preferences. In this paper, we present a comprehensive framework,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Junliang Ye , Fangfu Liu , Qixiu Li , Zhengyi Wang , Yikai Wang , Xinzhou Wang , Yueqi Duan , Jun Zhu

Diffusion models generate highly realistic images but often struggle with precise text-image alignment. While recent post-training methods improve alignment using external rewards or human preference signals, their performance heavily…

Machine Learning · Computer Science 2026-05-29 Jaa-Yeon Lee , Yeobin Hong , Taesung Kwon , Jong Chul Ye

Cross-domain image-to-image translation should satisfy two requirements: (1) preserve the information that is common to both domains, and (2) generate convincing images covering variations that appear in the target domain. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Adam W. Harley , Shih-En Wei , Jason Saragih , Katerina Fragkiadaki

Learning from human feedback has been shown to improve text-to-image models. These techniques first learn a reward function that captures what humans care about in the task and then improve the models based on the learned reward function.…

Recent advances in human preference alignment have significantly improved multimodal generation and understanding. A key approach is to train reward models that provide supervision signals for preference optimization. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Yibin Wang , Yuhang Zang , Hao Li , Cheng Jin , Jiaqi Wang

Recent advances in text-to-image (T2I) generation via reinforcement learning (RL) have benefited from reward models that assess semantic alignment and visual quality. However, most existing reward models pay limited attention to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Sashuai Zhou , Qiang Zhou , Junpeng Ma , Yue Cao , Ruofan Hu , Ziang Zhang , Xiaoda Yang , Zhibin Wang , Jun Song , Cheng Yu , Bo Zheng , Zhou Zhao

Text-to-image diffusion models have advanced towards more controllable generation via supporting various additional conditions (e.g.,depth map, bounding box) beyond text. However, these models are learned based on the premise of perfect…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Luozhou Wang , Guibao Shen , Wenhang Ge , Guangyong Chen , Yijun Li , Ying-cong Chen

Well-designed prompts can guide text-to-image models to generate amazing images. However, the performant prompts are often model-specific and misaligned with user input. Instead of laborious human engineering, we propose prompt adaptation,…

Computation and Language · Computer Science 2024-01-01 Yaru Hao , Zewen Chi , Li Dong , Furu Wei

Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Owen Oertell , Jonathan D. Chang , Yiyi Zhang , Kianté Brantley , Wen Sun