English
Related papers

Related papers: Correlation-Weighted Multi-Reward Optimization for…

200 papers

The strength of modern generative models lies in their ability to be controlled through text-based prompts. Typical "hard" prompts are made from interpretable words and tokens, and must be hand-crafted by humans. There are also "soft"…

Machine Learning · Computer Science 2023-06-02 Yuxin Wen , Neel Jain , John Kirchenbauer , Micah Goldblum , Jonas Geiping , Tom Goldstein

Faithful text rendering remains a persistent weakness of large text-to-image generative models, as it requires both semantic instruction following and fine-grained glyph-level structure. Prior methods often improve this ability through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Mingxuan Cui , Jingpu Yang , Fengxian Ji , Qian Jiang , Zhecheng Shi , Jiaming Wang , Zirui Song , Fajri Koto , Xiuying Chen

Generating long, coherent text remains a challenge for large language models (LLMs), as they lack hierarchical planning and structured organization in discourse generation. We introduce Structural Alignment, a novel method that aligns LLMs…

Computation and Language · Computer Science 2026-02-04 Zae Myung Kim , Anand Ramachandran , Farideh Tavazoee , Joo-Kyung Kim , Oleg Rokhlenko , Dongyeop Kang

Recent advances in text-to-image customization have enabled high-fidelity, context-rich generation of personalized images, allowing specific concepts to appear in a variety of scenarios. However, current methods struggle with combining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Enis Simsar , Thomas Hofmann , Federico Tombari , Pinar Yanardag

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

Video generation models trained on heterogeneous data with likelihood-surrogate objectives can produce visually plausible rollouts that violate physical constraints in embodied manipulation. Although reinforcement-learning post-training…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zhenyang Ni , Yijiang Li , Ruochen Jiao , Simon Sinong Zhan , Sipeng Chen , Zhenfei Yin , Minshuo Chen , Philip Torr , Zhaoran Wang , Qi Zhu

Current visual evaluation approaches are typically constrained to a single task. To address this, we propose OmniQuality-R, a unified reward modeling framework that transforms multi-task quality reasoning into continuous and interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Yiting Lu , Fengbin Guan , Yixin Gao , Yan Zhong , Xinge Peng , Jiakang Yuan , Yihao Liu , Bo Zhang , Xin Li , Zhibo Chen , Weisi Lin

Personalized generation models for a single subject have demonstrated remarkable effectiveness, highlighting their significant potential. However, when extended to multiple subjects, existing models often exhibit degraded performance,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Shulei Wang , Longhui Wei , Xin He , Jianbo Ouyang , Hui Lu , Zhou Zhao , Qi Tian

Text-to-image generative models have achieved remarkable visual quality but still struggle with compositionality$-$accurately capturing object relationships, attribute bindings, and fine-grained details in prompts. A key limitation is that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Arman Zarei , Jiacheng Pan , Matthew Gwilliam , Soheil Feizi , Zhenheng Yang

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Xin Gu , Ming Li , Libo Zhang , Fan Chen , Longyin Wen , Tiejian Luo , Sijie Zhu

We propose to improve multi-concept prompt fidelity in text-to-image diffusion models. We begin with common failure cases - prompts like "a cat and a dog" that sometimes yields images where one concept is missing, faint, or colliding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Debottam Dutta , Jianchong Chen , Rajalaxmi Rajagopalan , Yu-Lin Wei , Romit Roy Choudhury

While there has been significant progress in customizing text-to-image generation models, generating images that combine multiple personalized concepts remains challenging. In this work, we introduce Concept Weaver, a method for composing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Gihyun Kwon , Simon Jenni , Dingzeyu Li , Joon-Young Lee , Jong Chul Ye , Fabian Caba Heilbron

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

Most reward models for visual generation reduce rich human judgments to a single unexplained score, discarding the reasoning that underlies preference. We show that teaching reward models to produce explicit, multi-dimensional critiques…

Artificial Intelligence · Computer Science 2026-04-15 Haozhe Wang , Cong Wei , Weiming Ren , Jiaming Liu , Fangzhen Lin , Wenhu Chen

Text-to-image diffusion models, such as Stable Diffusion, can produce high-quality and diverse images but often fail to achieve compositional alignment, particularly when prompts describe complex object relationships, attributes, or spatial…

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Junhao Li , Xinhao Zhong , Yi sun , Yuxia Qiao , Bin Chen , Shu-Tao Xia , Yaowei Wang

Despite their impressive realism, modern text-to-image models still struggle with compositionality, often failing to render accurate object counts, attributes, and spatial relations. To address this challenge, we present a training-free…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Minsuk Ji , Sanghyeok Lee , Namhyuk Ahn

There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies…

Machine Learning · Computer Science 2024-10-10 Julian Dierkes , Emma Cramer , Holger H. Hoos , Sebastian Trimpe

Text-to-image generation models have achieved remarkable progress in preference optimization, yet achieving robust alignment across diverse reward models remains a significant challenge. Existing multi-reward fusion approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Ying Ba , Tianyu Zhang , Mohan Zhou , Yalong Bai , Wenyi Mo , Guiwei Zhang , Bing Su , Ji-Rong Wen
‹ Prev 1 3 4 5 6 7 10 Next ›