中文
相关论文

相关论文: One-Prompt-One-Story: Free-Lunch Consistent Text-t…

200 篇论文

Generating a coherent sequence of images that tells a visual story, using text-to-image diffusion models, often faces the critical challenge of maintaining subject consistency across all story scenes. Existing approaches, which typically…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Gopalji Gaur , Mohammadreza Zolfaghari , Thomas Brox

In the text-to-image generation field, recent remarkable progress in Stable Diffusion makes it possible to generate rich kinds of novel photorealistic images. However, current models still face misalignment issues (e.g., problematic spatial…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Leigang Qu , Shengqiong Wu , Hao Fei , Liqiang Nie , Tat-Seng Chua

Maintaining visual and semantic consistency across frames is a key challenge in text-to-image storytelling. Existing training-free methods, such as One-Prompt-One-Story, concatenate all prompts into a single sequence, which often induces…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Ayushman Sarkar , Zhenyu Yu , Mohd Yamani Idna Idris

Text-to-image generative models excel in creating images from text but struggle with ensuring alignment and consistency between outputs and prompts. This paper introduces TextMatch, a novel framework that leverages multimodal optimization…

计算机视觉与模式识别 · 计算机科学 2025-01-28 Yucong Luo , Mingyue Cheng , Jie Ouyang , Xiaoyu Tao , Qi Liu

Recent progress in text-to-image (T2I) generation underscores the importance of reliable benchmarks in evaluating how accurately generated images reflect the semantics of their textual prompt. However, (1) existing benchmarks lack the…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Yibin Wang , Zhimin Li , Yuhang Zang , Jiazi Bu , Yujie Zhou , Yi Xin , Junjun He , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Text to image generation methods (T2I) are widely popular in generating art and other creative artifacts. While visual hallucinations can be a positive factor in scenarios where creativity is appreciated, such artifacts are poorly suited…

计算机视觉与模式识别 · 计算机科学 2023-05-30 Rodrigo Valerio , Joao Bordalo , Michal Yarom , Yonatan Bitton , Idan Szpektor , Joao Magalhaes

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

计算机视觉与模式识别 · 计算机科学 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

人工智能 · 计算机科学 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

The issue of generative pretraining for vision models has persisted as a long-standing conundrum. At present, the text-to-image (T2I) diffusion model demonstrates remarkable proficiency in generating high-definition images matching textual…

计算机视觉与模式识别 · 计算机科学 2023-12-25 Qiang Wan , Zilong Huang , Bingyi Kang , Jiashi Feng , Li Zhang

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

计算机视觉与模式识别 · 计算机科学 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

Text-to-Image (T2I) models have recently achieved remarkable success in generating images from textual descriptions. However, challenges still persist in accurately rendering complex scenes where actions and interactions form the primary…

计算机视觉与模式识别 · 计算机科学 2025-09-22 Vatsal Malaviya , Agneet Chatterjee , Maitreya Patel , Yezhou Yang , Chitta Baral

Existing text-to-image diffusion models primarily generate images from text prompts. However, the inherent conciseness of textual descriptions poses challenges in faithfully synthesizing images with intricate details, such as specific…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Wei Li , Xue Xu , Jiachen Liu , Xinyan Xiao

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

计算与语言 · 计算机科学 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

人机交互 · 计算机科学 2023-09-29 Vivian Liu , Lydia B. Chilton

Text-to-image generation models are powerful but difficult to use. Users craft specific prompts to get better images, though the images can be repetitive. This paper proposes a Prompt Expansion framework that helps users generate…

计算机视觉与模式识别 · 计算机科学 2023-12-29 Siddhartha Datta , Alexander Ku , Deepak Ramachandran , Peter Anderson

The practical use of text-to-image generation has evolved from simple, monolithic models to complex workflows that combine multiple specialized components. While workflow-based approaches can lead to improved image quality, crafting…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Rinon Gal , Adi Haviv , Yuval Alaluf , Amit H. Bermano , Daniel Cohen-Or , Gal Chechik

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

计算机视觉与模式识别 · 计算机科学 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Sedat Porikli , Vedat Porikli

The stories and characters that captivate us as we grow up shape unique fantasy worlds, with images serving as the primary medium for visually experiencing these realms. Personalizing generative models through fine-tuning with…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Yuxin Zhang , Minyan Luo , Weiming Dong , Xiao Yang , Haibin Huang , Chongyang Ma , Oliver Deussen , Tong-Yee Lee , Changsheng Xu

Recently, the impressive generative capabilities of diffusion models have been demonstrated, producing images with remarkable fidelity. Particularly, existing methods for the 3D object generation tasks, which is one of the fastest-growing…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Jaeseok Lee , Jaekoo Lee