中文
相关论文

相关论文: DreamSync: Aligning Text-to-Image Generation with …

200 篇论文

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee

A significant ``modality gap" exists between the abundance of text-only data and the increasing power of multimodal models. This work systematically investigates whether images generated on-the-fly by Text-to-Image (T2I) models can serve as…

多媒体 · 计算机科学 2026-03-04 Yuesheng Huang , Peng Zhang , Xiaoxin Wu , Riliang Liu , Jiaqi Liang

The revolution of artificial intelligence content generation has been rapidly accelerated with the booming text-to-image (T2I) diffusion models. Within just two years of development, it was unprecedentedly of high-quality, diversity, and…

人工智能 · 计算机科学 2023-10-16 Zeqiang Lai , Xizhou Zhu , Jifeng Dai , Yu Qiao , Wenhai Wang

Text-to-3D generation, which synthesizes 3D assets according to an overall text description, has significantly progressed. However, a challenge arises when the specific appearances need customizing at designated viewpoints but referring…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Junkai Yan , Yipeng Gao , Qize Yang , Xihan Wei , Xuansong Xie , Ancong Wu , Wei-Shi Zheng

Text-to-Image (T2I) synthesis is a challenging task that requires modeling complex interactions between two modalities ( i.e., text and image). A common framework adopted in recent state-of-the-art approaches to achieving such multimodal…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Yeruru Asrar Ahmed , Anurag Mittal

Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zhiheng Li , Martin Renqiang Min , Kai Li , Chenliang Xu

Despite recent progress in text-to-image (T2I) generation, existing models often struggle to faithfully capture user intentions from short and under-specified prompts. While prior work has attempted to enhance prompts using large language…

The rapid advancement of text-to-image (T2I) models has increased the need for reliable human preference modeling, a demand further amplified by recent progress in reinforcement learning for preference alignment. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Yuxiang Guo , Jiang Liu , Ze Wang , Hao Chen , Ximeng Sun , Yang Zhao , Jialian Wu , Xiaodong Yu , Zicheng Liu , Emad Barsoum

Recent text-to-image (T2I) diffusion models have achieved remarkable advancement, yet faithfully following complex textual descriptions remains challenging due to insufficient interactions between textual and visual features. Prior…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Binglei Li , Mengping Yang , Zhiyu Tan , Junping Zhang , Hao Li

In text-to-image (T2I) generation, a prevalent training technique involves utilizing Vision Language Models (VLMs) for image re-captioning. Even though VLMs are known to exhibit hallucination, generating descriptive content that deviates…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Weichen Yu , Ziyan Yang , Shanchuan Lin , Qi Zhao , Jianyi Wang , Liangke Gui , Matt Fredrikson , Lu Jiang

Diffusion models have revolutionized text-to-image (T2I) synthesis, producing high-quality, photorealistic images. However, they still struggle to properly render the spatial relationships described in text prompts. To address the lack of…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Andrea Rigo , Luca Stornaiuolo , Mauro Martino , Bruno Lepri , Nicu Sebe

Text-to-image (T2I) models based on diffusion and transformer architectures advance rapidly. They are often pretrained on large corpora, and openly shared on a model platform, such as HuggingFace. Users can then build up AI applications,…

机器学习 · 计算机科学 2025-08-18 Basile Lewandowski , Robert Birke , Lydia Y. Chen

Recent text-to-image (T2I) diffusion and flow-matching models can produce highly realistic images from natural language prompts. In practical scenarios, T2I systems are often run in a ``generate--then--select'' mode: many seeds are sampled…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Huanlei Guo , Hongxin Wei , Bingyi Jing

Text-to-image (T2I) models have recently experienced rapid development, achieving astonishing performance in terms of fidelity and textual alignment capabilities. However, given a long paragraph (up to 512 words), these generation models…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Weijia Wu , Zhuang Li , Yefei He , Mike Zheng Shou , Chunhua Shen , Lele Cheng , Yan Li , Tingting Gao , Di Zhang

Text-to-image models are known to struggle with generating images that perfectly align with textual prompts. Several previous studies have focused on evaluating image-text alignment in text-to-image generation. However, these evaluations…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Huixuan Zhang , Xiaojun Wan

High-quality and open datasets remain a major bottleneck for text-to-image (T2I) fine-tuning. Despite rapid progress in model architectures and training pipelines, most publicly available fine-tuning datasets suffer from low resolution,…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Xu Ma , Yitian Zhang , Qihua Dong , Yun Fu

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

机器学习 · 计算机科学 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Despite the rapid adoption of text-to-image (T2I) diffusion models, causal and representation-level analysis remains fragmented and largely limited to isolated probing techniques. To address this gap, we introduce DreamReader: a unified…

Recent progress in text-to-3D generation has been achieved through the utilization of score distillation methods: they make use of the pre-trained text-to-image (T2I) diffusion models by distilling via the diffusion model training…

计算机视觉与模式识别 · 计算机科学 2024-03-25 Kyungmin Lee , Kihyuk Sohn , Jinwoo Shin