中文
相关论文

相关论文: Mini-DALLE3: Interactive Text to Image by Promptin…

200 篇论文

Text-to-image (T2I) generation has advanced rapidly, yet faithfully capturing spatial relationships described in natural language prompts remains a major challenge. Prior efforts have addressed this issue through prompt optimization,…

人工智能 · 计算机科学 2025-09-22 Sander Schildermans , Chang Tian , Ying Jiao , Marie-Francine Moens

In this paper, we introduce LDGen, a novel method for integrating large language models (LLMs) into existing text-to-image diffusion models while minimizing computational demands. Traditional text encoders, such as CLIP and T5, exhibit…

计算机视觉与模式识别 · 计算机科学 2025-02-26 Pengzhi Li , Pengfei Yu , Zide Liu , Wei He , Xuhao Pan , Xudong Rao , Tao Wei , Wei Chen

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often…

人机交互 · 计算机科学 2023-04-20 Stephen Brade , Bryan Wang , Mauricio Sousa , Sageev Oore , Tovi Grossman

Explanatory images play a pivotal role in accessible and easy-to-read (E2R) texts. However, the images available in online databases are not tailored toward the respective texts, and the creation of customized images is expensive. In this…

计算机视觉与模式识别 · 计算机科学 2024-10-07 Miriam Anschütz , Tringa Sylaj , Georg Groh

Text-to-image AI are capable of generating novel images for inspiration, but their applications for 3D design workflows and how designers can build 3D models using AI-provided inspiration have not yet been explored. To investigate this, we…

人机交互 · 计算机科学 2023-08-02 Vivian Liu , Jo Vermeulen , George Fitzmaurice , Justin Matejka

Recent advances in diffusion models can generate high-quality and stunning images from text. However, multi-turn image generation, which is of high demand in real-world scenarios, still faces challenges in maintaining semantic consistency…

计算机视觉与模式识别 · 计算机科学 2025-06-02 Junhao Cheng , Baiqiao Yin , Kaixin Cai , Minbin Huang , Hanhui Li , Yuxin He , Xi Lu , Yue Li , Yifei Li , Yuhao Cheng , Yiqiang Yan , Xiaodan Liang

Recent advancements in text-to-image models have significantly enhanced image generation capabilities, yet a notable gap of open-source models persists in bilingual or Chinese language support. To address this need, we present…

计算与语言 · 计算机科学 2024-06-19 Xiaojun Wu , Dixiang Zhang , Ruyi Gan , Junyu Lu , Ziwei Wu , Renliang Sun , Jiaxing Zhang , Pingjian Zhang , Yan Song

Although text-to-image (T2I) models have recently thrived as visual generative priors, their reliance on high-quality text-image pairs makes scaling up expensive. We argue that grasping the cross-modality alignment is not a necessity for a…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shuailei Ma , Kecheng Zheng , Ying Wei , Wei Wu , Fan Lu , Yifei Zhang , Chen-Wei Xie , Biao Gong , Jiapeng Zhu , Yujun Shen

Text-to-image (T2I) diffusion models such as SDXL and FLUX have achieved impressive photorealism, yet small-scale distortions remain pervasive in limbs, face, text and so on. Existing refinement approaches either perform costly iterative…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Shaocheng Shen , Jianfeng Liang , Chunlei Cai , Cong Geng , Huiyu Duan , Xiaoyun Zhang , Qiang Hu , Guangtao Zhai

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Recent advances in Machine-Learning have led to the development of models that generate images based on a text description.Such large prompt-based text to image models (TTIs), trained on a considerable amount of data, allow the creation of…

人机交互 · 计算机科学 2023-03-23 Chinmay Kulkarni , Stefania Druga , Minsuk Chang , Alex Fiannaca , Carrie Cai , Michael Terry

Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Sedat Porikli , Vedat Porikli

Since the advent of GANs and VAEs, image generation models have continuously evolved, opening up various real-world applications with the introduction of Stable Diffusion and DALL-E models. These text-to-image models can generate…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Hyunwoo Yoo

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

Text-to-image (T2I) generative diffusion models have demonstrated outstanding performance in synthesizing diverse, high-quality visuals from text captions. Several layout-to-image models have been developed to control the generation process…

计算机视觉与模式识别 · 计算机科学 2025-02-11 Ahmad Süleyman , Göksel Biricik

Text-to-image models have made significant strides, producing impressive results in generating images from textual descriptions. However, creating a scalable pipeline for deploying these models in production remains a challenge. Achieving…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Parmida Atighehchian , Henry Wang , Andrei Kapustin , Boris Lerner , Tiancheng Jiang , Taylor Jensen , Negin Sokhandan

Despite the impressive synthesis quality of text-to-image (T2I) diffusion models, their black-box deployment poses significant regulatory challenges: Malicious actors can fine-tune these models to generate illegal content, circumventing…

计算机视觉与模式识别 · 计算机科学 2025-03-31 Zhuomeng Zhang , Fangqi Li , Chong Di , Hongyu Zhu , Hanyi Wang , Shilin Wang

Image-to-Image (I2I) translation is a heated topic in academia, and it also has been applied in real-world industry for tasks like image synthesis, super-resolution, and colorization. However, traditional I2I translation methods train data…

计算机视觉与模式识别 · 计算机科学 2020-10-28 Jialu Huang , Jing Liao , Sam Kwong

Recent advances in diffusion-based text-to-image (T2I) models have led to remarkable success in generating high-quality images from textual prompts. However, ensuring accurate alignment between the text and the generated image remains a…

计算机视觉与模式识别 · 计算机科学 2025-10-01 Jia Jun Cheng Xian , Muchen Li , Haotian Yang , Xin Tao , Pengfei Wan , Leonid Sigal , Renjie Liao

Recent advancements in diffusion models trained on large-scale data have enabled the generation of indistinguishable human-level images, yet they often produce harmful content misaligned with human values, e.g., social bias, and offensive…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Xingqi Wang , Xiaoyuan Yi , Xing Xie , Jia Jia