中文
相关论文

相关论文: Ranni: Taming Text-to-Image Diffusion for Accurate…

200 篇论文

Text-to-image (T2I) models have gained significant popularity. Most of these are diffusion models with unique computational characteristics, distinct from both traditional small-scale ML models and large language models. They are highly…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Shubham Agarwal , Subrata Mitra , Saud Iqbal

We investigate the generation of minority samples using pretrained text-to-image (T2I) latent diffusion models. Minority instances, in the context of T2I generation, can be defined as ones living on low-density regions of text-conditional…

计算机视觉与模式识别 · 计算机科学 2025-04-07 Soobin Um , Jong Chul Ye

The rapid advancement of text-to-image (T2I) models, such as Stable Diffusion, has enhanced their capability to synthesize images from textual prompts. However, this progress also raises significant risks of misuse, including the generation…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Yu Xie , Chengjie Zeng , Lingyun Zhang , Yanwei Fu

Text-to-image (T2I) diffusion models have demonstrated impressive performance in generating high-fidelity images, largely enabled by text-guided inference. However, this advantage often comes with a critical drawback: limited diversity, as…

图形学 · 计算机科学 2026-03-17 Byungjun Kim , Soobin Um , Jong Chul Ye

Previous work on augmenting large multimodal models (LMMs) for text-to-image (T2I) generation has focused on enriching the input space of in-context learning (ICL). This includes providing a few demonstrations and optimizing image…

计算与语言 · 计算机科学 2025-01-14 Yongyu Mu , Hengyu Li , Junxin Wang , Xiaoxuan Zhou , Chenglong Wang , Yingfeng Luo , Qiaozhi He , Tong Xiao , Guocheng Chen , Jingbo Zhu

We propose SANA-I2I, a text-free high-resolution image-to-image generation framework that extends the SANA family by removing textual conditioning entirely. In contrast to SanaControlNet, which combines text and image-based control,…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Italo Felix Santos , Gilson Antonio Giraldi , Heron Werner Junior

Large-scale Text-to-Image (T2I) models have rapidly gained prominence across creative fields, generating visually compelling outputs from textual prompts. However, controlling these models to ensure consistent style remains challenging,…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Amir Hertz , Andrey Voynov , Shlomi Fruchter , Daniel Cohen-Or

Stable Diffusion has advanced text-to-image synthesis, but training models to generate images with accurate object quantity is still difficult due to the high computational cost and the challenge of teaching models the abstract concept of…

计算机视觉与模式识别 · 计算机科学 2025-05-08 Yanyu Li , Pencheng Wan , Liang Han , Yaowei Wang , Liqiang Nie , Min Zhang

Text-to-image (T2I) diffusion models such as SDXL and FLUX have achieved impressive photorealism, yet small-scale distortions remain pervasive in limbs, face, text and so on. Existing refinement approaches either perform costly iterative…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Shaocheng Shen , Jianfeng Liang , Chunlei Cai , Cong Geng , Huiyu Duan , Xiaoyun Zhang , Qiang Hu , Guangtao Zhai

Despite significant progress in Text-to-Image (T2I) generative models, even lengthy and complex text descriptions still struggle to convey detailed controls. In contrast, Layout-to-Image (L2I) generation, aiming to generate realistic and…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Chengyou Jia , Minnan Luo , Zhuohang Dang , Guang Dai , Xiaojun Chang , Mengmeng Wang , Jingdong Wang

Text-to-image (T2I) models based on diffusion processes have achieved remarkable success in controllable image generation using user-provided captions. However, the tight coupling between the current text encoder and image decoder in T2I…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Can Qin , Ning Yu , Chen Xing , Shu Zhang , Zeyuan Chen , Stefano Ermon , Yun Fu , Caiming Xiong , Ran Xu

While Text-To-Video (T2V) models have advanced rapidly, they continue to struggle with generating legible and coherent text within videos. In particular, existing models often fail to render correctly even short phrases or words and…

计算机视觉与模式识别 · 计算机科学 2025-11-11 Ziyang Liu , Kevin Valencia , Justin Cui

Text-to-Image (T2I) synthesis is a challenging task that requires modeling complex interactions between two modalities ( i.e., text and image). A common framework adopted in recent state-of-the-art approaches to achieving such multimodal…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Yeruru Asrar Ahmed , Anurag Mittal

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

Applying diffusion models to image-to-image translation (I2I) has recently received increasing attention due to its practical applications. Previous attempts inject information from the source image into each denoising step for an iterative…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Mengfei Xia , Yu Zhou , Ran Yi , Yong-Jin Liu , Wenping Wang

Despite impressive visual fidelity, current text-to-image (T2I) diffusion models struggle to depict rare, complex, or culturally nuanced concepts due to training data limitations. We introduce RAVEL, a training-free framework that…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Kavana Venkatesh , Yusuf Dalva , Ismini Lourentzou , Pinar Yanardag

Recent advancements in text-to-image (T2I) have improved synthesis results, but challenges remain in layout control and generating omnidirectional panoramic images. Dense T2I (DT2I) and spherical T2I (ST2I) models address these issues, but…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Timon Winter , Stanislav Frolov , Brian Bernhard Moser , Andreas Dengel

Text-to-Image (T2I) models have made remarkable progress in generating images from text prompts, but their output quality and safety still depend heavily on how prompts are phrased. Existing safety methods typically refine prompts using…

计算机视觉与模式识别 · 计算机科学 2025-09-18 Jinwoo Jeon , JunHyeok Oh , Hayeong Lee , Byung-Jun Lee

Text-to-image (T2I) diffusion models rely on encoded prompts to guide the image generation process. Typically, these prompts are extended to a fixed length by adding padding tokens before text encoding. Despite being a default practice, the…

计算与语言 · 计算机科学 2025-03-04 Michael Toker , Ido Galil , Hadas Orgad , Rinon Gal , Yoad Tewel , Gal Chechik , Yonatan Belinkov

Image-to-image translation (I2I) aims at transferring the content representation from an input domain to an output one, bouncing along different target domains. Recent I2I generative models, which gain outstanding results in this task,…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Eleonora Grassucci , Luigi Sigillo , Aurelio Uncini , Danilo Comminiello