中文
相关论文

相关论文: SpotActor: Training-Free Layout-Controlled Consist…

200 篇论文

Text-to-image generation tasks have driven remarkable advances in diverse media applications, yet most focus on single-turn scenarios and struggle with iterative, multi-turn creative tasks. Recent dialogue-based systems attempt to bridge…

计算机视觉与模式识别 · 计算机科学 2025-08-12 Shichao Ma , Yunhe Guo , Jiahao Su , Qihe Huang , Zhengyang Zhou , Yang Wang

Recent advances in text-to-image generation models have unlocked vast potential for visual creativity. However, the users that use these models struggle with the generation of consistent characters, a crucial aspect for numerous real-world…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Omri Avrahami , Amir Hertz , Yael Vinker , Moab Arar , Shlomi Fruchter , Ohad Fried , Daniel Cohen-Or , Dani Lischinski

We present Infinite-Story, a training-free framework for consistent text-to-image (T2I) generation tailored for multi-prompt storytelling scenarios. Built upon a scale-wise autoregressive model, our method addresses two key challenges in…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Jihun Park , Kyoungmin Lee , Jongmin Gim , Hyeonseo Jo , Minseok Oh , Wonhyeok Choi , Kyumin Hwang , Jaeyeul Kim , Minwoo Choi , Sunghoon Im

Recently, diffusion models have achieved great success in image synthesis. However, when it comes to the layout-to-image generation where an image often has a complex scene of multiple objects, how to make strong control over both the…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Guangcong Zheng , Xianpan Zhou , Xuewei Li , Zhongang Qi , Ying Shan , Xi Li

Layout-to-image synthesis is an emerging technique in conditional image generation. It aims to generate complex scenes, where users require fine control over the layout of the objects in a scene. However, it remains challenging to control…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Yibin Wang , Changhai Zhou , Honghui Xu

Recent advances in text-to-image (T2I) generation have led to impressive visual results. However, these models still face significant challenges when handling complex prompt, particularly those involving multiple subjects with distinct…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Lifeng Chen , Jiner Wang , Zihao Pan , Beier Zhu , Xiaofeng Yang , Chi Zhang

Large, text-conditioned generative diffusion models have recently gained a lot of attention for their impressive performance in generating high-fidelity images from text alone. However, achieving high-quality results is almost unfeasible in…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Manuel Brack , Patrick Schramowski , Felix Friedrich , Dominik Hintersdorf , Kristian Kersting

Recent text-to-image models have revolutionized image generation, but they still struggle with maintaining concept consistency across generated images. While existing works focus on character consistency, they often overlook the crucial…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Quanjian Song , Donghao Zhou , Jingyu Lin , Fei Shen , Jiaze Wang , Xiaowei Hu , Cunjian Chen , Pheng-Ann Heng

The recently introduced Consistency models pose an efficient alternative to diffusion algorithms, enabling rapid and good quality image synthesis. These methods overcome the slowness of diffusion models by directly mapping noise to data,…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shelly Golan , Roy Ganz , Michael Elad

Despite the tremendous success in text-to-image generative models, localized text-to-image generation (that is, generating objects or features at specific locations in an image while maintaining a consistent overall generation) still…

计算机视觉与模式识别 · 计算机科学 2023-06-27 Yutong He , Ruslan Salakhutdinov , J. Zico Kolter

Layout-to-image (L2I) generation has exhibited promising results in natural domains, but suffers from limited generative fidelity and weak alignment with user-provided layouts when applied to degraded scenes (i.e., low-light, underwater).…

计算机视觉与模式识别 · 计算机科学 2025-09-03 Wenzhuang Wang , Yifan Zhao , Mingcan Ma , Ming Liu , Zhonglin Jiang , Yong Chen , Jia Li

A layout to image (L2I) generation model aims to generate a complicated image containing multiple objects (things) against natural background (stuff), conditioned on a given layout. Built upon the recent advances in generative adversarial…

计算机视觉与模式识别 · 计算机科学 2021-03-23 Sen He , Wentong Liao , Michael Ying Yang , Yongxin Yang , Yi-Zhe Song , Bodo Rosenhahn , Tao Xiang

Recent advancements in text-to-image (T2I) generative models have shown remarkable capabilities in producing diverse and imaginative visuals based on text prompts. Despite the advancement, these diffusion models sometimes struggle to…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Xiaohui Chen , Yongfei Liu , Yingxiang Yang , Jianbo Yuan , Quanzeng You , Li-Ping Liu , Hongxia Yang

We introduce a novel, training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs). Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Shulei Wang , Wang Lin , Hai Huang , Hanting Wang , Sihang Cai , WenKang Han , Tao Jin , Jingyuan Chen , Jiacheng Sun , Jieming Zhu , Zhou Zhao

Recent approaches such as ControlNet offer users fine-grained spatial control over text-to-image (T2I) diffusion models. However, auxiliary modules have to be trained for each type of spatial condition, model architecture, and checkpoint,…

计算机视觉与模式识别 · 计算机科学 2023-12-13 Sicheng Mo , Fangzhou Mu , Kuan Heng Lin , Yanli Liu , Bochen Guan , Yin Li , Bolei Zhou

Text-to-image diffusion models have shown impressive capabilities in generating realistic visuals from natural-language prompts, yet they often struggle with accurately binding attributes to corresponding objects, especially in prompts…

计算机视觉与模式识别 · 计算机科学 2025-05-05 Do Huu Dat , Nam Hyeonu , Po-Yuan Mao , Tae-Hyun Oh

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

Recent advances in text-to-image generation have been remarkable, but generating multilingual design logos that harmoniously integrate visual and textual elements remains a challenging task. Existing methods often distort character geometry…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Mingyu Kang , Hyein Seo , Yuna Jeong , Junhyeong Park , Yong Suk Choi

Although diffusion models exhibit impressive generative capabilities, existing methods for stylized image generation based on these models often require textual inversion or fine-tuning with style images, which is time-consuming and limits…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Xin Ma , Yaohui Wang , Xinyuan Chen , Tien-Tsin Wong , Cunjian Chen

Existing generative approaches for guided image synthesis of multi-object scenes typically rely on 2D controls in the image or text space. As a result, these methods struggle to maintain and respect consistent three-dimensional geometric…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Léopold Maillard , Tom Durand , Adrien Ramanana Rahary , Maks Ovsjanikov