中文
相关论文

相关论文: Correlation-Weighted Multi-Reward Optimization for…

200 篇论文

The strength of modern generative models lies in their ability to be controlled through text-based prompts. Typical "hard" prompts are made from interpretable words and tokens, and must be hand-crafted by humans. There are also "soft"…

机器学习 · 计算机科学 2023-06-02 Yuxin Wen , Neel Jain , John Kirchenbauer , Micah Goldblum , Jonas Geiping , Tom Goldstein

Faithful text rendering remains a persistent weakness of large text-to-image generative models, as it requires both semantic instruction following and fine-grained glyph-level structure. Prior methods often improve this ability through…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Mingxuan Cui , Jingpu Yang , Fengxian Ji , Qian Jiang , Zhecheng Shi , Jiaming Wang , Zirui Song , Fajri Koto , Xiuying Chen

Generating long, coherent text remains a challenge for large language models (LLMs), as they lack hierarchical planning and structured organization in discourse generation. We introduce Structural Alignment, a novel method that aligns LLMs…

计算与语言 · 计算机科学 2026-02-04 Zae Myung Kim , Anand Ramachandran , Farideh Tavazoee , Joo-Kyung Kim , Oleg Rokhlenko , Dongyeop Kang

Recent advances in text-to-image customization have enabled high-fidelity, context-rich generation of personalized images, allowing specific concepts to appear in a variety of scenarios. However, current methods struggle with combining…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Enis Simsar , Thomas Hofmann , Federico Tombari , Pinar Yanardag

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

计算机视觉与模式识别 · 计算机科学 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

Video generation models trained on heterogeneous data with likelihood-surrogate objectives can produce visually plausible rollouts that violate physical constraints in embodied manipulation. Although reinforcement-learning post-training…

计算机视觉与模式识别 · 计算机科学 2026-05-15 Zhenyang Ni , Yijiang Li , Ruochen Jiao , Simon Sinong Zhan , Sipeng Chen , Zhenfei Yin , Minshuo Chen , Philip Torr , Zhaoran Wang , Qi Zhu

Current visual evaluation approaches are typically constrained to a single task. To address this, we propose OmniQuality-R, a unified reward modeling framework that transforms multi-task quality reasoning into continuous and interpretable…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Yiting Lu , Fengbin Guan , Yixin Gao , Yan Zhong , Xinge Peng , Jiakang Yuan , Yihao Liu , Bo Zhang , Xin Li , Zhibo Chen , Weisi Lin

Personalized generation models for a single subject have demonstrated remarkable effectiveness, highlighting their significant potential. However, when extended to multiple subjects, existing models often exhibit degraded performance,…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Shulei Wang , Longhui Wei , Xin He , Jianbo Ouyang , Hui Lu , Zhou Zhao , Qi Tian

Text-to-image generative models have achieved remarkable visual quality but still struggle with compositionality$-$accurately capturing object relationships, attribute bindings, and fine-grained details in prompts. A key limitation is that…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Arman Zarei , Jiacheng Pan , Matthew Gwilliam , Soheil Feizi , Zhenheng Yang

High-quality training triplets (instruction, original image, edited image) are essential for instruction-based image editing. Predominant training datasets (e.g., InsPix2Pix) are created using text-to-image generative models (e.g., Stable…

计算机视觉与模式识别 · 计算机科学 2025-03-21 Xin Gu , Ming Li , Libo Zhang , Fan Chen , Longyin Wen , Tiejian Luo , Sijie Zhu

We propose to improve multi-concept prompt fidelity in text-to-image diffusion models. We begin with common failure cases - prompts like "a cat and a dog" that sometimes yields images where one concept is missing, faint, or colliding…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Debottam Dutta , Jianchong Chen , Rajalaxmi Rajagopalan , Yu-Lin Wei , Romit Roy Choudhury

While there has been significant progress in customizing text-to-image generation models, generating images that combine multiple personalized concepts remains challenging. In this work, we introduce Concept Weaver, a method for composing…

计算机视觉与模式识别 · 计算机科学 2024-04-08 Gihyun Kwon , Simon Jenni , Dingzeyu Li , Joon-Young Lee , Jong Chul Ye , Fabian Caba Heilbron

Bilingual text-to-motion generation, which synthesizes 3D human motions from bilingual text inputs, holds immense potential for cross-linguistic applications in gaming, film, and robotics. However, this task faces critical challenges: the…

计算机视觉与模式识别 · 计算机科学 2025-08-04 Wanjiang Weng , Xiaofeng Tan , Hongsong Wang , Pan Zhou

Most reward models for visual generation reduce rich human judgments to a single unexplained score, discarding the reasoning that underlies preference. We show that teaching reward models to produce explicit, multi-dimensional critiques…

人工智能 · 计算机科学 2026-04-15 Haozhe Wang , Cong Wei , Weiming Ren , Jiaming Liu , Fangzhen Lin , Wenhu Chen

Text-to-image diffusion models, such as Stable Diffusion, can produce high-quality and diverse images but often fail to achieve compositional alignment, particularly when prompts describe complex object relationships, attributes, or spatial…

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Visual autoregressive (VAR) models have recently emerged as an efficient paradigm for text-to-image generation. Despite their strong generative capability, existing VAR-based personalization methods remain limited to static settings,…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Junhao Li , Xinhao Zhong , Yi sun , Yuxia Qiao , Bin Chen , Shu-Tao Xia , Yaowei Wang

Despite their impressive realism, modern text-to-image models still struggle with compositionality, often failing to render accurate object counts, attributes, and spatial relations. To address this challenge, we present a training-free…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Minsuk Ji , Sanghyeok Lee , Namhyuk Ahn

There has been significant progress in deep reinforcement learning (RL) in recent years. Nevertheless, finding suitable hyperparameter configurations and reward functions remains challenging even for experts, and performance heavily relies…

机器学习 · 计算机科学 2024-10-10 Julian Dierkes , Emma Cramer , Holger H. Hoos , Sebastian Trimpe

Text-to-image generation models have achieved remarkable progress in preference optimization, yet achieving robust alignment across diverse reward models remains a significant challenge. Existing multi-reward fusion approaches rely on…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Ying Ba , Tianyu Zhang , Mohan Zhou , Yalong Bai , Wenyi Mo , Guiwei Zhang , Bing Su , Ji-Rong Wen